How would you backup 15TB of data to multiple drives

backup

I have about 15TB of data across several RAID6 arrays, and it's been growing at a rate of about 10%. I want a cheap solution to back up this data at regular intervals and bring offsite. So I purchased five 3TB drives, hoping to just back them up using a eSATA drive dock. Ideally, I wanted to load up 3TBs at a time, and keep popping in drives until I was done.

However, the filesystems I'm backing up have deep and complex folder structures, so that would rule out doing a folder by folder backup especially as I plan on doing this every few weeks. Incremental backups would be ideal, and I just keep adding drives as needed. However, I wasn't able to find an affordable solution to this (Roxio Retrospect is too pricey).

Does anybody have any suggestions?

Thanks

Best Answer

Assuming you're using linux, you could probably create a single drive volume with greyhole then load them up, and let it take care of the complexity. However this wouldn't work unless you could load up the whole set of drives at once.

There's also applications that split folders of files files into known sizes - dirsplit comes to mind. I have no idea how they'd work with multiple swappable drives tho.

Related Topic