Need a few petabytes of Mac storage? Build your own BackBlaze Storage Pod
One of the largest personal iTunes libraries I've ever seen belongs to a client of mine. This client, who was a DJ in the 50's and 60's, has a huge collection of vinyl albums and singles that he painstakingly digitized, cleaned up, and catalogued in iTunes. Needless to say, opening iTunes on his Mac Pro is an exercise in patience.Thinking about his music storage needs, and the huge amount of digital photos and video that my wife are accumulating, got me musing about other ways to do mass storage inexpensively. At this point, I'm probably OK with a DroboPro, but what if I needed petabytes (1 petabyte = 1,024 terabytes = 1,048,576 gigabytes) of storage? Most solutions at this point in time are quite expensive.
As of 6 AM PDT this morning, off-site backup vendor BackBlaze has put their solution to mass storage needs, the BackBlaze Storage Pod, out to the world as an open source project. Their solution is a relatively inexpensive box (US$7,867 for 67 TB of storage) made up of off-the-shelf components that can be reproduced and/or improved upon by others who also need huge amounts of cheap storage. See those red boxes in the picture to the right? Each one of those contains 67 TB of RAID 6 storage in a 4U box. For a petabyte of storage, you're going to need to spend about $117,000 on about fifteen of the boxes.
BackBlaze invented the Storage Pod for their cloud storage requirements, off-site backups for Mac users like you and me. To keep the cost of their off-site Mac and PC backups incredibly low -- $5 / month for unlimited storage -- they developed their own solution, but realized that to keep improving the design and reducing the cost, making the BackBlaze Storage Pod design open source would streamline the process.
If you have $7,867 burning a hole in your pocket or would like to create your own cloud storage project, be sure to download the design. Any TUAW reader who builds one and connects it to his/her Mac should send us photos for publication.
Share
One of the largest personal iTunes libraries I've ever seen belongs to a client of mine. This client, who was a DJ in the 50's and 60's,...
Add a Comment
Funny
I wonder if anyone has ever used or hear of isilon ? http://isilon.com . They already do this and provide a fault tolerant culstered setup. The best part is they Do it all with FreeBSD .
This solution might be just what I'm looking for, but things like "Chyang Fun Industry (CFI Group) CFI-B53PM 5 Port Backplane" can't simply be ordered from NewEgg.
If I wanted to build 100 of these, I might be able to get a case custom made and deal with international parts manufacturers, but I want just one.
Tim, I appreciate your sharing this, but I wonder how you expect anyone to benefit from it when it is not really made with commodity parts?
"...a huge collection of vinyl albums and singles that he painstakingly digitized, cleaned up, and catalogued in iTunes."
Any chance you can tell us the process he used (hardware/software) for doing this? I'm hoping the way he did this is an improvement on the attempts I've made so far.
Building a new one is a tough task, dont you think to buy one that too if available with heavy disount up to 30%
http://www.kvmstuff.com/server-management/kvm-drawers.html
zfs support that isn't crazy buggy would be nice.
September 02 2009 at 12:36 AM Report abuse Permalink rate up rate down ReplyI am glad to see that the BackBlaze Storage Pod uses IBM's JFS File System. JFS is just awesome. In all my tests it outperforms ext3/4, XFS and ReieserFS. It also runs great on slow PC's.
IBM has done a great job with JFS (which IBM uses on it servers). I believe IBM has even open sourced JFS.
I am always so surprised that it is rarely used as the default file system on Linux / BSD systems.
Don't overlook JFS. Give it a try if you are running Linux or BSD. (I run it on all my Linux and BSD boxes).
One day, I hope Apple adds support for JFS to Mac OS X. But I fear with all the hype surrounding ZFS, it may never happen.
As a college student I stay productive by treating college like a 9 to 5 job so tath i'm always on top of my work.
September 01 2009 at 9:51 PM Report abuse Permalink rate up rate down ReplyUmmm...did anyone talking about the fact this isn't a "real world" solution actually follow the link? If you had, you couldn't have missed a couple facts:
1) The only non-diagram pictures show this in a rack. The box is described as "4u box". Clearly, this isn't meant to be connected to your home network.
2) While the redundancy is a little weak inside the unit, you could buy and run roughly 10 of these vs the next cheapest option, giving you pretty decent opportunities for redundancy.
3) No this doesn't offer every storage option. I believe that's the point of open sourcing it - you can add your own options. Personally, I'd love to have a few of these to play with to see how good a solution I could come up with using FibreChannel and ZFS, and how a PostgreSQL db would run using these as primary.
I guess this is a nice solution, but it would be better if it was ZFS. I really wish Apple could have gotten ZFS support working for Snow Leopard (or Leopard before it) even if it was just read/write support without boot support.
September 01 2009 at 9:08 PM Report abuse Permalink rate up rate down ReplySo I have to ask -- how many GB did your client's iTunes library take up?
September 01 2009 at 7:51 PM Report abuse Permalink rate up rate down ReplyI'm wondering the same thing, and the number of songs?
September 01 2009 at 8:25 PM Report abuse Permalink rate up rate down ReplyHot Apps on TUAW
Deals of the Day
more deals- miFrame Picture Frame Dock for iPad for $64 + $8 s&h
- Refurb Apple iPod nano 8GB MP3 Player for $99 + free shipping, 16GB for $119
- Hannspree Apple-Shaped 28" 1080p LCD HDTV for $270 + free shipping
- Philips wOOx Alarm Clock Radio for Apple iPod / iPhone for $60 + free shipping
- iWatchz Elemetal Collection Bracelet for iPod nano for $75 + free shipping
- iFrogz Luxe Lean Hard Case for iPod touch for $10 + free shipping
Software Updates
more updates- EFI Firmware Update brings Lion Internet Recovery to 2010-model Macs
- OS X Lion 10.7.3 released with Safari 5.1.3, Wi-Fi bug fix
- Aperture updated to 3.2.2, addresses Photo Stream issue
- Apple updates Keynote to address Lion issues
- Google Search app gets new look on iPad
- Apple releases Apple TV Software Update 4.4.3



27 Comments