While working on Priime’s latest products, a large part of my life has been spent closely studying every aspect of photography. The problem of backing up photos came up, and I thought it would be worth writing about my experiences with it.
I have been a photographer most of my life, shooting, consulting and producing for companies ranging from fashion startups to Land Rover, charity events to destination weddings, and more. That being said, the most important photos to me are the personal projects and select highlights from client shoots. The thought of losing even one photo in an original form is devastating.
Through the years, I have researched and tried just about every service in varying degrees. Some just don’t fit the requirements out of the box, others are promising but fall short, and then most are just too complicated or unstructured to put together. But the technology just keeps evolving, and new solutions continuously become available. I most recently reinforced my existing setup, inspired by an updated post by my friend, Paul Stamatiou, who recently put together his own updated post on Storage for Photographers.
To give a bit of a disclaimer, this isn’t a step by step, and I’m not saying this is the absolute best approach. This is the setup that has been working for me, and I included links to some resources that can help you further if you want to learn more about each of the pieces that make this solution whole.
This is an updated post from my previous roundup.
Putting together a list of prerequisites helped me pinpoint what it was I needed. This list evolved over many years. I understood the technology out there, and came up with my wish list. It’s not perfect, but it’s reliable.
- No single point of failure
- Instant access to photos, as if they were on my hard drive
- RAW photo storage at ~75mb each, affordably
- Archiving and not mirroring
No Single Point of Failure
Cloud storage is the perfect solution of not having a single point of failure. Cloud solves this by storing your files in a network of different locations at all times.
Instant Access to photos
I often want access to all my photos with an Adobe Lightroom Catalog on my laptop / iMac. Because of this, storing everything in the cloud can’t be the only place I save my photos. If they’re in the cloud, Lightroom doesn’t see those files as if they are stored on the computer’s drive, and also since they are not downloaded, there is no way to manipulate them until they’re stored locally and then loaded into memory. Thus, I will need a local storage solution that can hold a lot of data securely.
RAW File Storage
Cameras now save gigantic RAW files. My Nikon D800e stores 36 megapixel images that can be over 75mb, and my Sony RX1rm2 does 42 megapixels at who knows what obscene sized uncompressed 14-bit RAW file. The solution to solving this has to be able to affordably store RAW photo files, and not just finished jpeg or iPhone photos.
Archiving and Not Mirroring
There are a lot of cloud services that just mirror your current data. Dropbox does this in a way where it just stores whatever is stored in your Dropbox folders on your hard drive, but if you delete your files, they are removed on Dropbox as well. Mirroring is not what I need on a cloud service. What I need is something that acts like a hard drive that I can fill up and have data kept forever.
Putting all the prerequisites together, here is my current and ideal solution
- Synology NAS DS415+ with Western Digital 4TB red drives
- Crashplan+ $120/year
- Amazon Cloud Drive (Prime) $60/year
- Safe (any real life waterproof / fireproof safe)
How I use this solution
- The Synology NAS is where I store all my photos, starting from when I import them from my memory cards. The NAS is just a computer that holds hard drives, runs some very basic apps, and constantly makes sure your drives are replicated so if one fails, the data is saved on the others. You can read about how RAID works here.
- The Synology is connected to my iMac via a CAT6 cable, and I have the “Photos” folder mounted as a drive for instant access, as if the Synology was a local drive.
- My Lightroom catalog points to all my RAW files which are on my Synology NAS via the mounted drive.
- Crashplan+ runs in the background on my Synology all the time, uploading new files to the cloud. I also seeded my Crashplan+ space with a physical hard drive that we relayed through snail mail, so it didn’t take a long time to get everything ready to go. Crashplan+ is unlimited space for any type of file, and it archives everything and doesn’t just mirror data. This is great because if I lose archived hard drives full of photos, I can still get those back. $120 a year is totally worth it (at $10 a month), especially unlimited data.
- Amazon Cloud Drive also runs in the background on my Synology using their Cloud Sync app. Like Crashplan, it just constantly uploads photos that I store on the Synology. Again, to drive home the point, this is all run on the Synology NAS as if the Synology NAS drives are in the computer itself. My iMac can be completely off and it still does it’s thing. This is very much like Dropbox, where you set it and forget it. If you already pay for Amazon Prime ($60/year) you get unlimited photo storage on Cloud Drive. Photo storage is defined by their file formats, which include most every photo file you will encounter (dng, arw, cr2, nef, jpg, tiff, etc).
- Fireproof / Waterproof safe — I have this safe because when my camera equipment is at home, I like to make sure anyone breaking in can’t get to them easily. I also store five 2TB backup hard drives full of my old photos that I probably won’t need to access anytime soon. These are already all backed up to Crashplan, but it’s good to have them just in case I need access to some old photos and don’t want to sift through Crashplan.
- Dropbox is used to store all my latest processed photos. My processed photos are maximum resolution, but as jpg files so they’re all small enough to fit in Dropbox no problem. I do archive them into my Synology NAS after 2 years.
Running out of space
What happens when you run out of space on the Synology NAS or Crashplan? Well Crashplan is unlimited anything and Amazon Cloud Drive is unlimited for photos, so cloud-wise I am all set. The Synology NAS drives will eventually run out, so when it does, I will archive a lot of the old RAW photos onto a relatively cheap 2TB drive and put it in my safe. I have stockpiled a few of these when they were on sale, so they are ready when I need them. Then I remove the archived photos from the Synology NAS and I’ll have plenty of space again to store more. The good thing is that Crashplan and Amazon Cloud Drive will hold onto those old files, and I have a local copy somewhere in my safe.
Here are a few scenarios:
- A drive in my Synology NAS breaks. It will be fine, because the system is designed to constantly backup on the other drives. I’ll just replace the drive and it will continue on.
- The Synology NAS bricks itself and the data on the drives are ok. In this case, I can probably turn in the NAS to Synology for repair (warranty or not) and be back up and running.
- The Synology NAS and drives totally dead. I get the NAS and drives fixed or replaced, then I restore the whole structure from either Crashplan or Amazon Cloud Drive. Amazon Cloud Drive is much faster and free to download my photos, Crashplan I believe takes a much longer time (data is stored on tape) or I can pay to have the data delivered if I really needed it. Crashplan does, however, store more than just my photos.
- The cloud breaks. Well, this is probably not going to happen. The cloud stores your data across different drives, in different data centers, all over the world. So unless the earth blows up, we’re ok and don’t have to do anything.
- Crashplan or Amazon Prime goes under and stops the service. Unless they both go down, I can just move exclusively from one to another. If they both go down, maybe there’s another solution out there. Either way, I should have time to do something.
Alternatives and Comparisons
I want to quickly touch on a few of the alternatives that I had considered. Each have their pros and cons, and ultimately didn’t work out.
- Backblaze / Carbonite — these two services have been around for awhile, but they mirror your current storage. They were turn offs for me because they didn’t archive your old data. Once you remove an old drive for archiving, Backblaze and Carbonite would eventually remove those as well. Crashplan and Amazon do not.
- Dropbox — it’s pretty expensive and also mirrors. Lately you can archive things away, or maintain history. But for storing gigantic RAW files, it just doesn’t seem like the right solution for the price. Sure it’s instant access, but with a NAS it’s not needed.
- iCloud — if you use a lot of Apple products, iCloud is great for storing your iPhone or processed JPG photos. It syncs across your iPhone, laptop, desktop, iPad, and so on. It is perfect to use for photos I am taking on my iPhone and editing on Priime, or saving out JPGs on my desktop and editing them on Priime from the iPhone. But again, it falls short for the use of storing and archiving RAW photos with a 1TB limit at an expensive price when compared to other solutions. Another drawback is that you can only get to your iCloud files on desktop via sister apps (like Photos.app) or by digging into cryptic file structures. Unless Lightroom integrates CloudKit to access iCloud photos, you won’t have access to them straight from a Lightroom Catalog. I don’t think that will ever happen, as Adobe is pushing hard for their Creative Cloud service
- Google Photos — This is free and does a lot of cool things (makes slideshows, organizes well, etc), but on the free plan it resizes your photos if they are over 16 megapixels. Deal breaker. They do have an option to save the original file size, but then it’s no longer unlimited and you have to pay for Google Drive space.
- Adobe Creative Cloud — It’s not beautifully built in like iCloud Drive, and only seems to work well with Adobe products. At Priime, we considered integrating Creative Cloud into our app, but we have not had any requests for it as most of our users are happy with iCloud. It seems really hard to rely on Creative Cloud until there is a lot more compatibility across more than Adobe products. Users will have already logged into their iTunes account for iCloud to work on their iPhones, and nobody will remember their Adobe ID and password. Adoption of Creative Cloud is difficult because of the need to login.
- Drobo — It looks nice and seems simple, but I have heard too many people that have failed Drobo units that then required the drives to be read only with another working Drobo. And just by memory, I don’t remember hearing of any bad disasters with a Synology NAS. Also, Drobo doesn’t support as many apps and services as the Synology systems do. They have Crashplan, but nothing new like Cloud Drive and such. Also, these Drobo systems used to physically look really nice compared to Synology, but lately the Synology NAS designs have caught up. Overall, I think it should be safe to use a Drobo and that they are a stand up company. But the few advantages of the Synology NAS over the Drobo was enough for me to go that route.
- Custom — You can get a bunch of drives, or even build a RAID yourself in a tower, but it’s still lacking all the fancy features of a Synology system, and I can’t think of anybody who wants to build a RAID and make sure it works. Even being an engineer myself, I can’t imagine trying to put this together myself over just purchasing a pre-built solution.
One Can Dream
So I have written about what solution I have today, but what would my ideal dream setup be? Cloud as the main storage and access. Here is an example: A Dropbox or iCloud like solution that holds unlimited RAW photos affordably and doesn’t mirror onto a hard drive, Priime or Adobe Lightroom can load the photos immediately and be edited and saved back to the cloud. There is never local disk space issue, and you can access the photos anywhere.
- Cloud storage only
- Affordable, unlimited RAW photos
- Priime and Lightroom can immediately access the photos from anywhere
I think we are the closest to the above with iCloud Drive. It holds data seamlessly between devices (as long they are Apple), and you can access your photos with Priime and other apps immediately on desktop and device. Another great feature is that it manages the space on your devices by storing the full images on iCloud when they have been idle and not used, and downloaded as soon as they are needed in full. I just don’t see it being affordable with huge amounts of RAW files, and it’s not as easy as accessing files from OS X apps like a Dropbox solution would yield.
I can confidently say that all my data is securely backed up, and I am not worried about losing anything. Recovery of failures will not be fun, but they will not be devastating.
Technology around backing up is constantly evolving. Bandwidth is improving, storage is become more affordable, and new services are popping up that make it easier and easier. My solution is not evergreen, but it does the best job affordably with what is available today.
If you are looking for your perfect solution, I suggest writing down your prerequisites, how you would like everything to work, and then see what services are available. There could be things that just are not possible yet, but you can get close.
Let me know in the comments or by email your own setup, or if you think there are holes or improvements I can make. I am always open to something new and better I have not discovered yet.
My Adobe Lightroom has instant access to all my RAW files. My RAW files are protected locally via my Synology NAS that has a robust backup system, so it’s highly unlikely that hardware failure will lose any files. My RAW files are automatically backed up to Amazon Cloud Drive and Crashplan, such that if my NAS is somehow completely destroyed or stolen, I can still get a new NAS and fill it back up. And in the case my Safe is gone and archived data destroyed or stolen, Crashplan has everything available to re-download.
- Adobe Lightroom used to organize my photos
- Synology NAS as main photo storage for fast instant access
- Crashplan and Amazon Cloud Drive for historical archiving and rebuilding a failed NAS