Re: [Duplicity-talk] Found signatures but no corresponding backup files.

[Kenneth Loafman]

Please try this with RC12.  On RC9 we moved from BitBucket to Boto as
the S3 backend processor and this may correct your problem.

As the first run, please run 'duplicity --cleanup --force ...' to clean
up any incomplete backups.

...Thanks,
...Ken

Marcus Gustafsson wrote:
> Hello!
> 
> We have just started using duplicity to backup one of our mailservers to
> S3, but we have recently gotten problems that whenever we take a full
> backup 2 incremental backups later the backups seems to become corrupted.
> I googled on the error message, but didn't manage to find out anything
> obvious. Anyone have a good idea of where I should start looking?
> 
> We are running 0.4.3.RC2 and the commands are as follows:
> 
> ========== For the incremental backups (every day except when the full
> backup runs):
> 
> export S3KEY=<S3KEY>
> export S3SECRET=<S3PASS>
> export PASSPHRASE=<GPG PASSPHRASE>
> /bin/nice /usr/bin/duplicity --encrypt-key 0xADB77428 /opt/zimbra/backup
> s3+http://mailserverbucket
> 
> ========= For the full backups (only run once a week):
> 
> export S3KEY=<S3KEY>
> export S3SECRET=<S3PASS>
> export PASSPHRASE=<GPG PASSPHRASE>
> /bin/nice /usr/bin/duplicity --full --encrypt-key 0xADB77428
> /opt/zimbra/backup s3+http://mailserverbucket
> 
> # Remove backups older than one week (Zimbra still keeps backups for
> # much longer, so this is just double storage anyway).
> /bin/nice /usr/bin/duplicity --force --encrypt-key 0xADB77428
> --remove-older-than 1W s3+http://mailserverbucket
> 
> 
> ================ Output from the cron script
> (last incremental before the full backup):
> 
> Network error '(32, 'Broken pipe')'. Trying to reconnect in 10 seconds.
> --------------[ Backup Statistics ]--------------
> StartTime 1186819283.06 (Sat Aug 11 03:01:23 2007)
> EndTime 1186823494.50 (Sat Aug 11 04:11:34 2007)
> ElapsedTime 4211.44 (1 hour 10 minutes 11.44 seconds)
> SourceFiles 870914
> SourceFileSize 162810117608 (152 GB)
> NewFiles 55922
> NewFileSize 7549148023 (7.03 GB)
> DeletedFiles 0
> ChangedFiles 68
> ChangedFileSize 76247 (74.5 KB)
> ChangedDeltaSize 0 (0 bytes)
> DeltaEntries 55990
> RawDeltaSize 4931420210 (4.59 GB)
> TotalDestinationSizeChange 4537891743 (4.23 GB)
> Errors 0
> -------------------------------------------------
> 
> (the full backup):
> Network error 'BitBucketError[500]: Internal Server Error'. Trying to
> reconnect in 10 seconds.
> Network error 'timed out'. Trying to reconnect in 10 seconds.
> Network error 'timed out'. Trying to reconnect in 10 seconds.
> --------------[ Backup Statistics ]--------------
> StartTime 1186903839.85 (Sun Aug 12 02:30:39 2007)
> EndTime 1187002191.86 (Mon Aug 13 05:49:51 2007)
> ElapsedTime 98352.01 (27 hours 19 minutes 12.01 seconds)
> SourceFiles 871257
> SourceFileSize 162832269473 (152 GB)
> NewFiles 871257
> NewFileSize 162832269473 (152 GB)
> DeletedFiles 0
> ChangedFiles 0
> ChangedFileSize 0 (0 bytes)
> ChangedDeltaSize 0 (0 bytes)
> DeltaEntries 871257
> RawDeltaSize 92448690151 (86.1 GB)
> TotalDestinationSizeChange 98091728310 (91.4 GB)
> Errors 0
> -------------------------------------------------
> 
> Warning, found the following orphaned signature files:
> duplicity-new-signatures.2007-08-11T02:30:03-05:00.to.2007-08-13T02:30:02-05:00.sigtar.gpg
> Found signatures but no corresponding backup files
> 
> (The next incremental backup):
> Warning, found incomplete backup sets, probably left from aborted session
> Network error '(32, 'Broken pipe')'. Trying to reconnect in 10 seconds.
> --------------[ Backup Statistics ]--------------
> StartTime 1186992150.62 (Mon Aug 13 03:02:30 2007)
> EndTime 1186992912.82 (Mon Aug 13 03:15:12 2007)
> ElapsedTime 762.21 (12 minutes 42.21 seconds)
> SourceFiles 871811
> SourceFileSize 162846837152 (152 GB)
> NewFiles 966
> NewFileSize 37010360 (35.3 MB)
> DeletedFiles 0
> ChangedFiles 0
> ChangedFileSize 0 (0 bytes)
> ChangedDeltaSize 0 (0 bytes)
> DeltaEntries 966
> RawDeltaSize 12897100 (12.3 MB)
> TotalDestinationSizeChange 19963809 (19.0 MB)
> Errors 0
> -------------------------------------------------
> 
> (And the final incremental one. Everything after this gives the same error):
> Warning, found the following orphaned signature files:
> duplicity-new-signatures.2007-08-11T02:30:03-05:00.to.2007-08-13T02:30:02-05:00.sigtar.gpg
> Found signatures but no corresponding backup files
> 
> 
> Regards,
>  Marcus Gustafsson

_______________________________________________
Duplicity-talk mailing list
address@hidden
http://lists.nongnu.org/mailman/listinfo/duplicity-talk

signature.asc
Description: OpenPGP digital signature