Cloud transfers made easy

Transfers made easy

A while back, I wrote about the problem of consumer trust in the cloud – in particular, the problem of what happens when your cloud provider decides to change the T&Cs to your detriment, and how this can erode the trust that consumers, already alert to the technology industry’s much-publicised failures, are in danger of losing.

The issue that prompted this was the massive capacity reduction by Amazon for its cloud storage service – Cloud Drive – from unlimited to a maximum of 5GB. The original price was just £55 a year but Amazon’s new price for 15TB, for example, is £1,500.

So at this point, unless you’re happy to pay that amount, two solutions suggest themselves. The first is to invest in a pile of very large hard disks – twice as many as you need because, you know, backups, and then become your own storage manager. Some excellent NAS devices and software packages such as FreeNAS make this process much easier than it used to be, but you’ll still need to manage the systems and/or buy the supporting hardware, and pay the power bill.

The alternative is to retain some trust in the cloud – while remaining wary. But this is only half the solution; I’ll get back to that later.

This individual has found another cloud provider, Google G Suite, which offers unlimited storage and a whole heap of business services for a reasonable £6 per month. Google requires you to own your domain and to be hosting your own website but if you can satisfy those requirements, you’re in. Other cloud providers have deals too but this was the best deal I could find.

Cloud-to-cloud transfer
So the problem then is how to transfer a large volume of data to the new cloud service. One way is to re-upload it but this is very long-winded: using a 20Mbps fibre-to-the-cabinet (FTTC) connection it will take months, it can clog up your connection if you have other uses for that bandwidth, and for anyone on a metered broadband connection it will be expensive too. And if you don’t run a dedicated server, you’ll need a machine left on during this time.

Cloud-to-cloud transfer services exist to solve this problem, – and after some research, I found cloudHQ. For a reasonable fee – or for free if you blog about it (yes, this what I’m doing here) – cloudHQ will transfer data between a range of cloud services, including Google, Amazon (S3 and Cloud Drive), Gmail, Box, Basecamp, Office 365, Evernote and many more.

CloudHQ does more: it will backup and sync in real time too, forward emails, save them as PDFs, act as a repository for large attachments, and a range of other email- and scheduling related services for Google and other cloud providers.

The basic service is free but this is limited to 20GB and a maximum file size of 150MB – but the next tier up – Premium – costs £19.80 a month and offers pretty much everything the power user could want.

Hybrid clouds and backup
So is cloudHQ the solution to the problem of cloud-to-cloud transfers? Yes, but putting your data in the cloud still leaves you with a single copy without a backup (I said I’d get back to this). So either you need another cloud service, in which case cloudHQ will keep them in sync, or you create a hybrid solution, where the primary data lives under your direct control and management, but the off-site backup lives in the cloud.

This hybrid setup is the one that businesses are increasingly opting for, and for good reason. And frankly, since your irreplaceable personal data – think photos and the like – is at risk unless you keep at least two copies, preferably three, then using both local and cloud storage make huge sense.

New wave of real-time collaboration arrives?

When it comes to document collaboration, things can only get better. We’ve seen Google Wave make a splash (sorry) and, together with collaboration tool Google Docs, you could live and work without ever loading any software. Ever.

But this approach has limitations, not least of which is that you can only use the Google-hosted applications, you don’t get to choose your applications, and you really only get the full benefit when all your data is hosted by Google.

Scary? For some — especially financial and similar enterprises encircled by legislative constraints and cautious customers — yes. Even the rest of us might not feel entirely comfortable about it.

One new company, oneDrum, reckons it’s got an answer: keep the applications and documents you use every day and collaborate with colleagues and others in real time using its Java-based (and so platform-independent) platform.

oneDrum is a British company that’s most of the way towards launching a serious competitor to Google Wave and Google Docs. CEO Jasper Westaway welcomes Wave because, you guessed, it helps educate the market and validate the concept. “Without them, we wouldn’t have gone to the market with this”, CEO Jasper Westaway told me.

Westaway says that what he likes about Wave is the way that it blurs the lines between conventional email, IM chat and so on; oneDrum does the same but you can use any application you like. oneDrum’s eponymous platform is set to launch by the end of July.

I tried it. While the software is a bit flaky — it’s still a private beta — it allows users of Microsoft Office applications to open applications and share documents. If you share a spreadsheet, for example, you can each edit the same sheet transparently, with changes appearing instantly on a cell-by-cell basis as if you had made them locally.

An example scenario could involve a sales manager who sees a presentation being opened up by a junior member of his sales team, and changes being made that aren’t relevant for the client the junior exec is about to visit. The boss can step in and make further changes in real time; he or she could also embed comments along the way, effectively using the application as a chat interface.

It works in Office via the Windows COM interface, which is redirected by the Java sandbox across the collaborative medium — in my case it was the Internet but could be a private network — so that the applications running at either end are unaware that they’re collaborating across the globe. “We use the automation API and detect changes and push them out to open copies”, says Westaway.

The underlying mechanism is a Skype-like peer-to-peer system: there’s no central repository. “The overlap with Google Wave is that we use the same operational transformation algorithms“, the benefit of which is that “the algorithm works at whatever level is appropriate for the content, whether bytes or paragraphs, for example,” says Westaway.

And if you go offline, will any changes that happen to be stored on that machine be replicated? Westaway reckons that it depends: “As long as someone is online, you can pick up the changes, it’ll work.”

You could imagine too that there might be problems with security — in some organisations, they’ll want to know exactly where the data is going, for example. “Next year, we’ll offer enterprises the possibility of hosting a central repository for compliance reasons,” says Westaway. “We’ll roll out features that will be attractive to organisations such as banks who want compliance-ready applications. We say to them that we will be ready for you soon — but not yet.”

To start with, the service will be free, but oneDrum will eventually be releasing a subscription model that will include features such as the ability to backup all changes.

Westaway reckons the business is easy to scale, and that that it’s fairly easy to add new applications to the roster. So Westaway reckons that by the end of 2009, support for OpenOffice, for Office for Mac, and Google Docs will be cooked and ready to go, with more in the pipeline.

We’ll have to wait and see how this early promise holds true but, for the moment, the peer-to-peer service, which will be free, could form the basis of a new wave of collaboration without tears.

Google Wave: is it evil?

I just finished watching the whole hour of Google’s presentation of Wave, its new collaboration tool. It’s a fascinating idea, bringing together a multitude of communication tools, such as email and instant messaging, while making them more intuitive to use.

From the demo of the early developer code, you could see that the threading of conversations happens naturally, even when not all participants are involved from the start, while you can still keep parts of the conversation private. You can see messages in real time as you type (not good for poor typists) or you can do it in a more familiar ‘type and hit Return’ kind of way.

Content isn’t restricted to text, it can be anything that the developer chooses to add; the demo, which happened at Google IO, its recent devcon. And of course it’s all hosted in the cloud: all you need is a browser.

The idea looks great, the elimination of boundaries between IM and email is a liberating idea because you can still use it just like email — that is, you can choose when to answer messages and not be jumping around to someone else’s set of priorities — it’s smarter, and the browser becomes the only communication tool you need.

So why is it that I found myself wondering if this is really such a good thing? Two things: firstly I’m concerned about the fragmentation of email. Let’s assume Google Wave become insanely popular. Even so, there will always be people who aren’t using Wave but who stick to email and IM. It means you now have another communication channel to understand and manage. That’s on top of the Facebooks, the Twitters, the MySpaces and so on, all of which have private channels of communication that you need to check.

And then there’s the deeper concern: am I really comfortable trusting Google with my communications? With email I can choose from hundreds of suppliers and dozens of pieces of software. None of them want to index and understand my content even remotely on the scale that Google does. And when, due to some force majeure, it drops its ‘do no evil’ philosophy (assuming you buy into that idea from a Wall Street-quoted public company), what then?

Is this just me being paranoid?