Google Storage Available to All

Google made its Google Storage API available to all today. This is the service that is likely to make Google AppEngine useful, as the existing BigTable storage system was just too painful for words and not designed for large blobs. Its certainly feels a bit slicker in execution than AWS S3 and has a more polished user experience from a getting started perspective. It was several months after S3 launched before somebody built a third party browser that would allow you to look at you buckets online.

They use a similar model to S3 of unique bucket names, so get in quick in you want a bucket called “test” or “src” 🙂  The naming conventions for objects are restricted, so you cannot expect to upload an arbitrary directory of files and expect it to succeed. The uploading process must perform some kind of name mapping process that converts illegal names to legal ones.

The do make a big deal about allowing developers to specify whether buckets and their contents are located in Europe (where in Europe?) or not  but read the T&Cs carefully. Section 2.2 makes it clear that Google can process your data just about anywhere including the US. It’s only “data at rest” that can be specified as stored in Europe. So all your data is essentially available to US agencies should that choose to take a peak. The most lame restriction in the T&C’s is the restriction on using Google Storage to create a “Google Storage like” system. Let’s put a layer in front of Google Storage that is like Google Storage but slower and less resilient and costs more, oh I definitely want to sign up for that service 🙂

They provide a version of the excellent Boto library that has been repurposed for use against Google Storage, this is the best indication yet that the Google API’s must be pretty close to the S3 APIs in structure. The main difference is the use of OAuth to give fine grained access to the storage objects. This is the biggest win for Google and I hope to see Microsoft Azure, RackSpace CloudFiles and AWS S3 following suite fairly quickly.

It would also be great to see the Boto changes for Google Storage rolled back into the Boto mainline.

Web 2.0 vs Web 1.0

Web 1.0 was about reading Web 2.0 is about writing
Web 1.0 was about companies Web 2.0 is about communities
Web 1.0 was about client-server Web 2.0 is about peer to peer
Web 1.0 was about HTML Web 2.0 is about XML
Web 1.0 was about home pages Web 2.0 is about blogs
Web 1.0 was about portals Web 2.0 is about RSS
Web 1.0 was about taxonomy Web 2.0 is about tags
Web 1.0 was about wires Web 2.0 is about wireless
Web 1.0 was about owning Web 2.0 is about sharing
Web 1.0 was about IPOs Web 2.0 is about trade sales
Web 1.0 was about Netscape Web 2.0 is about Google
Web 1.0 was about web forms Web 2.0 is about web applications
Web 1.0 was about screen scraping Web 2.0 is about APIs
Web 1.0 was about dialup Web 2.0 is about broadband
Web 1.0 was about hardware costs Web 2.0 is about bandwidth costs