cPanel & WHM Version 94 has been released, and brings a slew of great updates. Take a look at what is included, and then upgrade today!

rsync with new backup system

kernow shared this idea 7 years ago
Completed

Would like new backup system to use rsync

Best Answer
photo

We have added rsync as a remote destination in version 66. You will see it listed here: https://documentation.cpanel.net/display/66Docs/Backup+Configuration#BackupConfiguration-AdditionalDestinations


You can read about all the improvements on the version 66 Release Site.

Comments (6)

photo
5

It would be great to use rsync to send files across to an offsite location - all from within the WHM interface.

That said, something's changed between the old and new backup systems. There's now hardly any bandwidth saving in using rsync - somehow the compression isn't incrementally efficient. It always used to be - I used to get away with transferring only a third of the size of the total backup.

So there are two parts to this request, in my opinion.

1. Allow rsync as an offsite location in the new backup system.

2. Make the new backup system compression algorithm work with rsync, so that we don't have to transfer 100% of the backups every time.

photo
1

Absolutely, RSYNC for both remote and local backups all within WHM would be wonderful.

photo
3

Agreed, I'm not even sure why rsync wasn't the primary focus of the new backup system since that is what almost everyone is using for off-server backups. We don't use rsync for the compression (though many do), we use it for the ability to keep transfers of home directory files to a minimum (delta changes only) and for much greater control over how files can be stored.


Honestly, I don't see any improvement in the new backup system over the old unless it has tight rsync integration in it. For now we just keep paying for cpremote plugin, bundled with our own separate pkgacct+rsync scripts.

photo
1

This is tough for larger deployments, it would take so long to do backups that when one was done it would be time for another backup. This is a great solution for smaller installs but doesn't work for our use cases.

photo
1

Incremental backups could help in that case, either way it's still a method that would be wise to add untop of all the other remote backup options.

photo
1

Is the issue with rsync not being efficiënt resolved?

photo
1

@ralfonso, I use rsync ssh with just over a dozen web sites, two of them with very large content bases to an appropriate resourced NAS in my office.


NOTE: I am NOT using the rsync feature within WHM but my own scripts. The WHM feature just kept confusing me and causing authentication problems -- which is on me, not on cPanel.


The first backup did take a significant amount of time, but from then on it is barely noticeable. I use the link-dest parameter so literally only those bytes that have changed are transmitted.


I've been running this process for many years and it has yet to let me down.


The challenging part was getting the ssh keys working so that the two machines would talk to one another.


I think all of this can be done with a relatively simple script for a moderately skilled cPanel tech because I did it as an unskilled hobbyists.

photo
1

We have added rsync as a remote destination in version 66. You will see it listed here: https://documentation.cpanel.net/display/66Docs/Backup+Configuration#BackupConfiguration-AdditionalDestinations


You can read about all the improvements on the version 66 Release Site.

Replies have been locked on this page!