cPanel & WHM Version 80 has been released, and brings a slew of great updates. Take a look at what is included, and then upgrade today!
 

Custom S3-compatible backup locations

Mika Epstein shared this idea 3 years ago
Completed

With the advent of S3 backups, allowing for arbitrary ceph locations would be greatly beneficial.


As long as you can change the ceph domain (from s3.amazon.com to whatever.myceph.com) then the majority of aspects work out of the box. That would let people use any host/ceph service they want :)

Best Answer
photo

cPanel & WHM Version 74 has reached the CURRENT tier! Update now to see this additional destination in your WHM Backup Configuration interface!

Comments (11)

photo
1

It is unlikely that the Amazon S3 backup destination accommodating other backup destinations itself will be implemented, as this attempts to modify an intentionally single-organization backup destination to a multi-organization backup destination.


Essentially, we have provided the ability to write your own custom backup destinations precisely for individuals to write their own custom backup destinations. Whether it is DreamObjects or some other backup solution, it's intended that you can write these custom destinations.


Now if there is significant demand/votes for a particular custom backup solution, that provides reason for us to consider writing the backup destination module ourselves and distribute it.


Therefore I encourage you and others to continue to vote on this request, but the Amazon S3 backup destination will likely always remain specific to Amazon S3 itself. It would end up as a new selection in the menu for "DreamObjects"

photo
1

> this attempts to modify an intentionally single-organization backup destination to a multi-organization backup destination.


Except... Literally the only difference is the destination URL. Same everything, different server. So the BEST way for 'us' to write it would be to duplicate everything you did for S3. Which seems really silly. You have the code that works, no need to reinvent the wheel in a way that is more likely to be insecure and messy.

photo
1

The situation is such that DreamObjects is 100% identical to S3. Can you please provide instructions on making our own destination by simply creating a duplicate of the S3 destination and then we can simply tweak the server field? If you at least allow us to duplicate the S3 option, that will facilitate very easy modification for us.

photo
1

Information on creating custom backup transports is available in our documentation: http://documentation.cpanel.net/display/ALD/How+to+Create+a+Custom+Destination

photo
1

You could mount your ceph end point as fuse and do this today.


http://docs.ceph.com/docs/master/cephfs/fuse/

photo
2

The problem with this is a single rm -rf / would wipe both server and backup.

I don't like running backups to a mounted partition.

photo
1

Sure and I do but that's actually significantly harder than amazon S3 is in the current setup. First of all you have to yum up and install fuse, which isn't the latest version anyway, and s3fs and so on.


I speak from experience of having converted many an Amazon S3 tool to generic S3 - this is both doable and would be greatly beneficial to everyone who doesn't want to use Amazon S3 :) It opens cPanel up to work with more systems, and really all it takes is letting someone put in a custom s3 url.

photo
1

Oh I wanted to add, this will let you handle storage without being part of the ceph cluster.

photo
1

While this doesn't exactly answer the request, we have made it much easier for you to build your own custom remote destination in version 66. Take a look, and give it a shot. If you write your own, send me your github link! I'd love to share it.


https://documentation.cpanel.net/display/66Docs/How+to+Create+a+Custom+Destination

photo
1

This feature is in version 74 that is now in the EDGE tier! I recommend setting up an EDGE server (instructions on our blog) and give it some testing!

Release note

photo
1

cPanel & WHM Version 74 has reached the CURRENT tier! Update now to see this additional destination in your WHM Backup Configuration interface!

Comments have been locked on this page!