cPanel & WHM Version 92 has been released, and brings a slew of great updates. Take a look at what is included, and then upgrade today!
This object is in archive! 

BTSync Integration for Backups/File Cluster

deltaend shared this idea 6 years ago
Open Discussion

Please see http://www.bittorrent.com/sync

If you are unfamiliar with BTSync, it is a P2P protocol for syncing files. Integrating this into the client-side cPanel should be easy and should add significant value to clients of ours who want to sync files from their desktop directly to their servers (think website development). Secondly, this solution could be used to help with clients of ours who want to distribute large files to their clients via BTsync (read-only) and want to distribute the load over a second computer such as their home machine so that the bandwidth being used isn't overwhelming for their server. In fact, the more people who want to download the same large file(s) at the same, the more the distributed bandwidth so people could actually distribute lots of large files to a huge amount of users without over-tasking their cPanel sever. Additionally, integrating this as a backup destination for clients should also be simple and could be performed in two separate ways.

  1. The "backups" would be performed by using a local directory above the public_html directory and copying a MySQL + email dump to that location. Additionally the public_html directory would have already been attached as a sync location so syncs of this directory are already happening on a regular basis. BTSync allows for 30 days of versioning so the public_html could be restored at any time by selecting any timeframe within the last 30 days without risk of deletes permanently making their way from the web server to the target location and permanently erasing everything.

  2. Backups could occur as normal to a directory inside of the home directory on the server automatically erasing or updating the compressed file of the last backup. Changes to the file would be carried over to the syncing client(s) as normal. Versioning on the client(s) side would account for the changes and update the client side accordingly but would also allow for restorations up to 30 days ago.

BTSync could also be integrated into WHM backups allowing for a BTSync target folder to be used for backups which would operate in a similar or identical manner to the above mentioned cPanel client BTSync. This would be added as an additional target to the current backup methods or as a stand-alone option.

Lastly, a BTSync option could be added to the WHM side of things to allow for server-2-server file clustering. If set in the WHM, you could allow files to sync between cPanel servers allowing to rudimentary file clustering to occur (think cold-spare, backup-partner, transferring accounts instead of SSH/FTP or possibly configured via unsupported configurations to be utilized as a load-balanced web-host for static files). On the WHM side, you could also set some global options for BTSync on the cPanel Client side such as bandwidth limits.

BTSync has lots of options for both our clients and for internal purposes. Integration is simple and the potential rewards are extremely high. BTSync is backed by BitTorrent, a stable company that will be around for years to come. Finally, BTSync has already been integrated into many NAS products such as Netgear, Snapserver, Seagate, and QNAP, allowing for seamless cPanel/WHM integration directly into off-site backup/file storage solutions, not to mention also having an app for iPhone, iPad, Android, Windows, and Kindle (Amazon Store). Current desktop/server client/server compatibility includes all versions of Windows starting with XP and beyond (32bit and 64bit), Linux (i386, x64, glibc 2.3 [i386+x64], ARM, PowerPC, PPC QorIQ), and FreeBSD (i386 + x64).

Thank you for your consideration.

Comments (7)

photo
1

BTSync is amazing. They just came out with version 1.4 which improves moved folder support, HTTPS link support, and a faster/more optimized BT transfer method.

photo
1

I've heard lots of good things about BTSync. It does sound amazing.


The BTsync eula (http://www.bittorrent.com/legal/eula) prevents use for commercial purposes. In addition their terms of service prevent (re)distribution (http://www.bittorrent.com/legal/terms-of-use). These matters would need addressed before we could integrate their software with cPanel & WHM.


We /might/ be able to implement the API functionality. Actual setup and configuration of the BTsync server is likely something we cannot do until after the above matters are addressed.

photo
1

Kenneth, that is a joint EULA which encompasses multiple BT products and wasn't specifically written for BTSync. Since BTsync is already built into multiple corporate products already (QNAP, Netgear, Snapserver, Seageate, etc...) which is unlike BT's other products, my assumption is that it would be fairly easy to get some clarification directly from BT in regards to this (and permission from them as well). A single email or phone call would likely clear this up and pave the way for implementation.

photo
1

I am contacting Bittorrent for more information.

photo
1

David Prinzing wrote:

Kenneth, that is a joint EULA which encompasses multiple BT products and wasn't specifically written for BTSync. Since BTsync is already built into multiple corporate products already (QNAP, Netgear, Snapserver, Seageate, etc...) which is unlike BT's other products, my assumption is that it would be fairly easy to get some clarification directly from BT in regards to this (and permission from them as well). A single email or phone call would likely clear this up and pave the way for implementation.


The license file in the btsync client download pointed me to those links. I agree that matters could be clarified with some communication with Bittorrent. I'd like to see more input and feedback from potential users of this feature before moving into that step.

photo
1

The cPanel request system needs to be default sorted in such a way as to encourage this. At the moment, feature requests that gain the most responses are always default sorted onto the top, even if that feature is already implemented. Starting at the bottom of the pile, or getting filtered into the middle of the pile as it may be will ultimately bury this request. Kind of frustrating.

photo
1

Kenneth,


Talked to David G[redacted] over at BitTorrent and we briefly touched on a few ideas outlined in this post. If you want details, let's connect via email (you can see my email, correct?). We will be re-touching base hopefully later this week with some further concepts on the possible synergy between the two companies.