Discussion:
[wal-e] database more than 400GB
l***@gmail.com
2017-07-24 13:55:38 UTC
Permalink
Hi there

I have one database with more than 400GB, and I starting to try wal-e to
make a backup in S3.

I started the base backup and after 8 hours the backup does not completed.

I saw in the s3, and there ware a lot of compacted files, and I looked at
to the instance usage and aparentilly everything is right

Someone knows if i need to change something?

Have you used wal-e for backup on a database of this size?
--
You received this message because you are subscribed to the Google Groups "wal-e" group.
To unsubscribe from this group and stop receiving emails from it, send an email to wal-e+***@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Daniel Farina
2017-07-24 17:59:28 UTC
Permalink
Post by l***@gmail.com
Hi there
I have one database with more than 400GB, and I starting to try wal-e to
make a backup in S3.
I started the base backup and after 8 hours the backup does not completed.
I saw in the s3, and there ware a lot of compacted files, and I looked at
to the instance usage and aparentilly everything is right
Someone knows if i need to change something?
Have you used wal-e for backup on a database of this size?
Yeah, I have. Considerably larger databases, also...is WAL-E doing useful
work, or is it somehow stuck?
--
You received this message because you are subscribed to the Google Groups "wal-e" group.
To unsubscribe from this group and stop receiving emails from it, send an email to wal-e+***@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
l***@gmail.com
2017-07-24 20:15:44 UTC
Permalink
Daniel Farina, your basic backup, how long does it take to average?

I will look again at the consuming of disk, I think that is the bottleneck

Em segunda-feira, 24 de julho de 2017 14:59:41 UTC-3, Daniel Farina
Post by Daniel Farina
Post by l***@gmail.com
Hi there
I have one database with more than 400GB, and I starting to try wal-e to
make a backup in S3.
I started the base backup and after 8 hours the backup does not completed.
I saw in the s3, and there ware a lot of compacted files, and I looked at
to the instance usage and aparentilly everything is right
Someone knows if i need to change something?
Have you used wal-e for backup on a database of this size?
Yeah, I have. Considerably larger databases, also...is WAL-E doing useful
work, or is it somehow stuck?
--
You received this message because you are subscribed to the Google Groups "wal-e" group.
To unsubscribe from this group and stop receiving emails from it, send an email to wal-e+***@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Daniel Farina
2017-07-24 21:14:39 UTC
Permalink
Post by l***@gmail.com
Daniel Farina, your basic backup, how long does it take to average?
I will look again at the consuming of disk, I think that is the bottleneck
A fairly fast machine with the right disk bandwidth can handle 200MiB/s.
But conservatively, 30MiB/s is an easy goal to meet.
--
You received this message because you are subscribed to the Google Groups "wal-e" group.
To unsubscribe from this group and stop receiving emails from it, send an email to wal-e+***@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Loading...