Backup Software

A blog entry by Ryan Lowe reminded me of an idea I’ve always had for backup software that seems so simple that I can’t believe I haven’t found it yet.

A lot of people–Ryan included–use CD burners to copy critical data like My Documents and store it away somewhere in the event of a crash. This solution gets the job done, but requires manual copying, which means time away from getting “real work” done. It also requires an accessible CD burner. I have a burner, but not on my laptop, which adds steps to this process to copy the data over to another machine. And, while CDs are cheap, they’re somewhat burdensome to juggle and keep track of.

I always wanted a solution to back up my data over our home network. Last year, I bought a 40 GB drive at Best Buy because I got a really great deal. It sits in our home PC, a modest P233, and is largely underused. My main PC, a laptop from work, has a 20 GB drive, about 10 of which is the data that I care about. To my knowledge, though, there really isn’t an easy way to do this kind of backup short of manually copying the files over, which just puts me back to where I started.

I want a TSR (do they call them that anymore?) program that I can set up once. I want to be able to point out the folders that contain my critical data and the backup “server” for which it should be looking (by IP address, DNS name, IPX/SPX, whatever). Then, every time I start my PC, I want the program to wait quietly until it can find the backup server on the current network (no ugly errors if I’m at work or school). Once it finds the machine, it uses just a preset percentage of my bandwidth to copy files to that machine–better yet, it would monitor my bandwidth usage and throttle up or down depending on my decrease or increase in demand.

Being a smart program, the backup software wouldn’t simply copy my entire MP3 collection across the network everytime I was in range of the WLAN. Instead, it would keep a database of which files have been changed when and copy only the files that have been recently updated. Not only would this be an intelligent use of resources, but it brings to light an interesting property of disk usage: I only use some of my files (perhaps even only 10%) most of the time and most of my files some of the time. Most of my files–like music or video–go unchanged indefinitely, while there are a handful of files–like email or databases–that are updated every day.

With the proliferation of home networks in the last few years, this would be a very practical and even profitable idea. Of course, the ideal package would be Open Source. Rather than be relegated to backing up only to a Microsoft machine running the latest and greatest operating system, I want to be able to put the hard drive in a Linux machine and copy my PC and future iMac data to it. So, the client might ideally be written in Java or be a Mozilla app.

And, just for kicks, I’m using the LazyWeb trackback to broaden exposure to this idea and see if there are any takers. ;-)

4 thoughts on “Backup Software

  1. ken,

    look into a product called unisys. I used to use it for exactly this, on my home desktop, and my laptop and my work desktop.

    I kept all my files in synch on all the computers, with a server at home as the unisys server. it communicated with ssh so everything was nice and secure. Once you ahd the initial sync done, it just copied changes around to the 3 machines (through the server).

    I ran everything threw a script so that if networking was done (mainly for my laptop) it would silently die … If there were errors it would email me, with the name of the machine and the error received. (though, after the initial setup errors were rare).

    I’ve been thinking about setting it up again. It was a really nice setup. Minumal bandwidth usage, etc …

    Altp.

  2. The next step would also include sending “important” documents off-site. I use my web space for this. Some people use bank (or fire-proof) safes. If your building has a flood or fire, you don’t want to lose your backup machine with it, otherwise what good are backups? :)

    I had a great chat with an IT guy once about this when I worked at a small software firm. I didn’t realise backing up data was such a huge job but he opened my eyes. My suggestion is to find an IT guy, take him to lunch and pick his brain for good ideas. This is all they think about.

    Thanks for the trackback. :)

  3. Yeah… {Jai’s wheels begin spinning… wait… if Kenny has to ask an IT guy to lunch for IT ideas… then I guess that means Kenny isn’t an IT guy…}…

    Um… and to think I was gonna ask Kenny to lunch to pick his brain for ideas and small crustacians…

    (hehehe a little humor there, slightly askewed even…)

    Backups are a good idea. I like that puzzle you are trying to solve K. Let me in on the logic you come up with when you do, I’d like to understand the conceptual thinking involved.

  4. It all depends on your definition of “IT guy”. Some people say that all computer people are IT people. I separate the programmers and software engineers from the guys that keep the computers running. The guys/girls that keep the computers running I call “IT guys” … so ask them. I don’t maintain the computers/software, I just make new software to maintain. ;)