Re: [Sks-devel] disk full, keys.niif.hu crashed

[tiker]

The problems seem to be caused by a large key.  There's at least 2 different hash values for this key (so probably recently updated) and one of the versions of the key is 22mb.  The size is causing timeouts on some reverse proxies and the constant retries is causing the .log files to be created and growing in the DB directory.

When viewing the key through the web interface (both hash versions so far) one of the UID packets turns into a binary blob of garbage on the screen.  But does seem to end correctly but after the 22mb of junk on the screen, the sub keys appear to be ok at the end.  This might be the cause of the error I posted with my previous message.

I've checked a couple SKS servers for this key and so far, they all seem to have issues with this key.

This key was also appears to have been created yesterday which may explain your two crashes.

I don't think I want to post the key ID here because it's hard on the servers grabbing this key but someone should look at it and figure out what to do with this.  My node only seems to sync with about 10% of its peers.

Thanks.
Rob D

On 2018-06-15 11:53, Keith Erekson wrote:

This has happened to my keyserver twice in the last two days. I assumed
it was some sort of malicious behavior, because it happened quite
suddenly both times and had the effect of a DoS. ;-)

For example, I have over 1700 binary log files like "log.0000002014",
each 10MB, created in the last 24 hours. (It would have kept going, but
the filesystem filled up.)

The timestamps show that often 30 or 40 of them are created in the same
minute.

~Keith


On 06/14/2018 11:54 PM, Kiss Gabor (Bitman) wrote:

Yesterday at 18:15 (CEST) keys.niif.hu started to produce tons
of logs in /var/lib/sks/DB. In less than 2 hours the 40 GB filesystem
got fulfilled.
Deleting files and restarting processes did not help:

recon.log:
2018-06-15 05:50:09 Opening log
2018-06-15 05:50:09 sks_recon, SKS version 1.1.6
2018-06-15 05:50:09 Using BerkelyDB version 5.3.28
2018-06-15 05:50:09 Copyright Yaron Minsky 2002-2013
2018-06-15 05:50:09 Licensed under GPL.  See LICENSE file for details
2018-06-15 05:50:09 recon port: 11370
2018-06-15 05:50:09 Opening PTree database
2018-06-15 05:50:09 Setting up PTree data structure
2018-06-15 05:50:09 PTree setup complete
2018-06-15 05:50:09 Initiating catchup
2018-06-15 05:50:10 DB closed

db.log:
2018-06-15 05:50:09 Opening log
2018-06-15 05:50:09 sks_db, SKS version 1.1.6
2018-06-15 05:50:09 Using BerkelyDB version 5.3.28
2018-06-15 05:50:09 Copyright Yaron Minsky 2002, 2003, 2004
2018-06-15 05:50:09 Licensed under GPL. See LICENSE file for details
2018-06-15 05:50:09 http port: 11371
2018-06-15 05:50:09 Membership: (zimmermann.mayfirst.org 11370)[], ... (keys.jpbe.de 11370)[]
2018-06-15 05:50:09 address for zimmermann.mayfirst.org:11370 changed from [] to
 [<ADDR_INET [2001:470:1:116::6]:11370>, <ADDR_INET [216.66.15.2]:11370>]
...
2018-06-15 05:50:10 address for keys.jpbe.de:11370 changed from [] to [<ADDR_INET [2001:67c:16c8:32cc::1]:11370>, <ADDR_INET [185.120.22.22]:11370>]
2018-06-15 05:50:10 Opening KeyDB database
2018-06-15 05:50:10 Shutting down database

Unfortunately I cannot work on restoration till Sunday evening.

Gabor

_______________________________________________
Sks-devel mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/sks-devel

_______________________________________________
Sks-devel mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/sks-devel

signature.asc
Description: OpenPGP digital signature