Digitalquill

Following my recent post about media and backup, Andy from Cloudberry contacted me about his companies product asking me to try it out. It has been some time since I got the software, but last night I finally got the time to give it a try.

If you remember I was discussing the media that we kept, digital video of our Daughter growing up, priceless material and the problems I had of backing up the large amounts of data that this had become. My preferred option is Amazon S3, yes there is a small cost involved, but I currently backup all my digital photographs, web servers, email servers, project files, accounts and more to Amazon S3. I would like to keep all my backups in the same place, so that if the worse comes to the worse I can always recover those priceless memories.

Cloudberry online backup as its name suggests is a Windows application that runs backups. It supports Amazon S3, Dunkel and Walrun backup services. I am of course only interested in the Amazon S3 part, but i do intend to checkout the other two as I have never heard of them. Cloudberry online backup costs $29.99 (about £15 ish) so not costly at all if it makes life a little easier and makes me able to secure all my data.

The install process works exactly as you would expect, a simple wizard takes you through the install process, and the download of the application was fairly small, just a couple of megabytes from memory, so even on my poor Internet connection no problems there.

I installed it on my Windows 7 Media centre, which is where all my media is kept and within 2  minutes I had a backup running, so very simple to use.

When you first open Cloudberry online backup, it shows you a welcome screen, which asks you what you want to do, backup wizard or recovery wizard. After adding in your security credentials for Amazon S3, as described above, creating a backup plan is as simple as following the wizard.  Once you have plans created, you can click on the tabbed interface to manage those backups and check their status. A history panel tells you the details of what has been going on, and on the welcome page it shows the progress of any active backups or when the next one is scheduled to run.

The backup wizard takes you through a series of questions asking you what you want to backup, you simply tick the folders and then choose some more options for if you want to compress the files or not, and in the case of Amazon S3 how many versions of each file do you want to keep. This means that you can recover past versions of changed files if you like. As my Media generally stays the same, I have saved cost on the backup storage and chosen to only keep one copy of each file which should be good enough for my needs, however if I start to use this application for other uses, backup of project files for example I may choose to keep many versions of files.

My First backup plan was for digital media, I chose some videos from our latest holidays, a folder of about 3.3Gb and Apart from the speed, which is my poor broadband (I live in Hull where the only broadband supplier is Karoo who are about 2 or 3 years behind the rest of the country, I get 6Mbs down and 200k up, and at peak times it just grinds to a halt) it seems to be working file, it is still backing up as we speak! It is going to take some time to backup the 100Gb+ that I have!

The system has a built in alerts system, you can choose an email address to have it send alerts to, these alerts can be simply if it encounters a problem, or if you are like me, you will want emails when it completes backups as well so you can monitor the progress.

As I say it has not completed its backup plan yet simply because of the size and the speed of my broadband, however, the files it has backed up to Amazon seem to be fine.

The software also optionally allows you to encrypt your files. I am not sure what type of encryption it uses and would think that this would mean that you have to use the cloudberry software to recover from any disaster, not that this is a problem, it has recovery wizards built into the software so that you can recover files as easily as you back them up. I chose not to encrypt as I like to have access to those files from other Amazon S3 clients such as the Firefox plugin and S3Sync.

A very useful feature is that you can choose to filter what files are backed up, so once you have chosen the folders you want to backup you can further refine that backup by either including or excluding files of a particular type, so in my case I have some log files which I do not want backing up as these just take up space so I exclude log files.

There were a couple of features that I would have liked to see.

Firstly you cant define where to back it up to in your S3 buckets, it just creates folders of the computer name, and then replicates the folder structure on your drive. This is perfectly ok for most scenarios and exactly what you want as a home user, just tick the boxes against what you want backing up and leave the software to it. However it would be nice to have an advanced option so that you can define where the files will be backed up to, so if like me you like to keep your Amazon S3 organized to suit you then the software could follow your choice.

Just to reiterate, the way it works now is fine for 99% of people, I always like that extra little bit of control.

The only other issue I found was that you cant schedule a backup plan that has items from networked drives in it, I run a NAS drive which I currently backup via S3Sync on Linux Command line, however this is difficult to maintain, I would have liked to move all my backups across to Cloudberry, and have the one machine (my media centre) running all the backups to Amazon S3. The software will do the backups but strangely you cant schedule regular backups if you have a networked drive included in the plan.

As a software designer and developer myself I understand the logic here, a network drive may not always exist, and as such it a backup tried to run where the drive was not there this would cause problems, however, perhaps this could be handled with a check to see if the drive was available before the backup started and email the alerts email address if it was not.

I have not yet tried the recovery wizard, but I expect that it is very much like the backup wizard. Recovery will be quicker as the way broadband works you have a far greater download bandwidth than upload bandwidth.

Would I recommend Cloudberry online backup? In a word Yes. Very simple to use, some great features even taking into account that I always want more! If it could do scheduled backups from network drives and also let you choose where in your Amazon Bucket you wanted it to backup to I would not be able to fault it, but as I say for most users these features would not be a necessity.

I have also noticed that on their website they have a coming soon section and they plan to add FTP support, I assume this means that you will be able to backup via FTP. They also have planned Storage cost estimates, which will be good when you select a folder with 100Gb of Data in it like I am about to do, to be able to know how much it will cost you before you start would be perfect.

You can get Cloudberry online backup by clicking here

As you will have recently ready I am backing up all my media to Amazon S3. My photographs are stored on my Western Digital MyBook World which I have hacked to open up the Linux shell, and as such i use S3Sync on command line to back up my photographs. I have even written a bash script that does it as it backs up some other stuff as well.

The rest of the media is on an external drive on the Windows 7 media centre, I am looking for a decent app that will sit there and sync the videos from my digicam to Amazon S3. I have tried loads but they all seem to fall short, either they are buggy and do not work or they can not sync and just manage adhoc single transfers.

I need something that is automated that will sync once a day/week and any changes or new videos will be uploaded to Amazon.

If anyone can recommend any applications free or otherwise?

I have just received a new External Hard Drive from Amazon to try and keep up with a spiraling amount of Media I seem to be collecting, what with the Media centre recording TV, the digital movie archive, digital photos and the HD video from our Digicam we have more media than most.

I have blogged before about windows 7 and how I have bought copies for all the machines we own, the media centre included. I have this setup as a home network so that all the media stored on the media centre is accessible via every machine and as such is accessible wherever you are in the house.

Up until Windows 7, the HD media from the Sony HD Camera had to be converted in order to be viewed, now Windows 7 can play these in their native format, which is msts. This is whey I have bought the new drive so that I can archive all our digital video within the media centre system.

The next challenge is to be able to share some of this media to family and friends. Photographs and Videos are a great way of letting family who are spread out around the country and even internationally, but the big question is how.

In the past I have setup Gallery2 on one of my servers and used that as a gallery for photographs, the problem with that is keeping it updated, uploading the pictures and sorting them into the gallery was always a time consuming task and one that I never kept on top of.

I have been experimenting with Youtube for some time now. On one of my other blogs (On the allotment) I upload videos to Youtube in the format they come out of the camera (M2ts) Up to now this has been a very much one off thing every now and then, but I am looking to see if I can use YouTube with a private video stream to upload many more of my videos straight out of the camera.

The first problem I have experienced is that when uploading from the media centre it powers down in the middle of an upload. I am not sure how to stop this without turning off the power management all together, something that I do not want to do.

The next problem I now have is one of backup. Until now I have uploaded all my Digital photos to Amazon S3 currently standing at around 50gb of data. I would like to do a similar thing for the digital videos, however, this will dramatically increase the data that will be stored as there is currently around 100gb of video data. My current thinking is that the cost of backing this up to Amazon S3 will be relatively low and compared to the value of this data to us as a family keeping it safe from fire or other loss can not be measured.

I am also looking at getting a BluRay writer, I have been holding off until now as I do not like to be an early adopter for this sort of technology, back in the days when Writable CD’s first hit the market, I could have filled all the cafes in England with coasters that I burnt!  I have read that they are now fairly stable and the price of the media is coming down all the time.

BluRay would only be a feasible backup method if I could Geolocate the disks somewhere else and can guarantee that those disks do not get damaged.

I have suffered several computer failures in the past month or so, including a big failure of my web server. This has caused allot of problems for me personally and my businesses.

I have therefore been looking at online backup services which seem to have been popping up all over the place recently.

My first port of call was the most well known one from Amazon S3 however their payment options do not suit my requirements, so while searching I found Memopal.

After signing up for their free trial, I was quickly impresses and signed up for their 150gb service which should allow me to backup most of my important stuff.

The service comes with a client which you install, the windows client has a GUI which is easy to use and setup, you just choose the folders you want to backup and it just does it in the background, it monitors those folders for changes or new items and backs them up as well.

It also keeps revisions of your files, although I have yet to test this.

They also have a linux client, which can be run from command line. This is ideal for backing things up from my NAS drive and directly from my web servers.

The system is fairly quick althought I have asked it to backup my 60gb digital photograph archive which says it will take over 5 days, whcih I gues is not bad, and this will only be an issue at the start as it catches up with the archive of files.

I have at last got my mail serve back on line and checking SPAM although I am not too happy with how much SPAM is still getting through. I will tighten up the rules.

I deliver SPAM to a Spam folder in each users mail boxes, I used to have a script that deleted emails after 7 days, I need to re-write this and get that working again.

There are still some of my sites that are down or out of date. I spent allot of time in the week before the disaster entering all my domains in Domain Name Portfolio and unfortunately did not get a back up of that work so I need to re-enter them all.

I also have some software that I wrote that monitors Google (and others) page rank for all my sites. I also had this as a download on my Digitalquill site, however I must have written this in VIM directly on the production server, which means I do not have a copy of that anywhere. I am hoping that someone who downloaded it will be nice and send me a copy.

I am not sure about all the themes for my blogs, including this one. I had customized themes to be specific to my requirements. I made the fatal mistake of thinking that I did not need to back-up my wordpress folders as I can just download a new copy, but this means of course that both the modified themes and any uploads (media and images) have been lost.

The theme for this blog is not too bad, not sure i like it as much as the old one so I may yet still change it, but the one for Earning From Affiliates is not good enough for what I require, so I will be finding the starting theme that I modified and making my changes to bring it back to what I had.

Other than that, I think we are just about there.

If you have been trying to get to this blog over the last week or so you will have found that it has been down, along with all my other sites. This was due to a hardware failure on my web server, which coming as it did over the Christmas period has been somewhat frustrating. Getting support to act quickly has exacerbated the problem, however I have spent the Christmas period setting up my web and mail servers and recovering all my sites from backups.

I really need to work on my disaster recovery position as the backups I had were not in as good an order as I would have liked.