Portal Home > Knowledgebase > Articles Database > backing up using rsync: slow?
backing up using rsync: slow?
| Posted by chamelion, 08-23-2007, 07:09 AM |
| hey guys, i want to back up my entire server, probably 50gb of data.
i have a 20mbit connection at home, and get 1.5+mbytes/second when pushing a file onto my home pc from the server via ftp, so i know the pipe between the two can handle the bandwidth.
i've set up rsync at home but for some reason the transfer rate does not go over 50-60kbytes/sec, i'm guessing cause the files are too small.
is this a problem with my rsync configuration? i havne't set any speed limits...
finally, is there some better solution than rsync to backup my server?
thanks!
command i'm using for rsync:
rsync --links --backup --recursive /mydirectory myserver::backuplocation.
|
| Posted by david510, 08-23-2007, 10:36 AM |
| Did you try to copy via scp command?
|
| Posted by chamelion, 08-23-2007, 10:41 AM |
| does that do the same as rsync though? with that much data to move i'd rather have incrementals, not just a dump/image.
|
| Posted by macker, 08-23-2007, 02:46 PM |
| Are you trying to back up files TO your server, or FROM your server?
Home cable modem will have fine download speeds, but upload speeds will be capped, and you'll see a fraction of the speed.
Try scp. You can also create a tar file first, e.g. 'tar zcvf /root/myserver-home.tgz /home', then copy over the myserver-home.tgz file (which will be compressed)
It's also possible one or both computers are being taxed by rsync's CPU usage excessively, that could throttle it in a way that FTP wouldn't.
|
| Posted by chamelion, 08-23-2007, 04:56 PM |
| back up data from my webserver (large upload/download pipe) to my home computer (large download) which means that transfer rates are fast - as my home pc has a fast download speed...
as i mentioned - if i push a file via ftp from my webserver to my home pc i get incredible speeds.
and, with the amount of data, i can't be zipping 50gb of data and sftp'ing it.
|
| Posted by macker, 08-23-2007, 05:08 PM |
| try zipping a smaller amount of the data as a test, to see if the problem is with the small files, or with rsync, etc.
also, the syntax you gave in the example is ambiguous. 'rsync src dest', it's not clear if 'myserver' is your home PC, or your server at the datacenter. if you had src and dest swapped, this would explain the slowness.
you're asking for help, I'm offering suggestions, based on what I can see.
|
Add to Favourites 
Print this Article
Also Read
Shared Hosting
Shared Hosting
