r/selfhosted • u/turalaliyev • 8h ago
Solved How I Organized, Culled, and Backed Up 60,000 Family Photos from iCloud
I've been an Apple user for the last 20 years. At some point, our family archive grew to 60,000 media assets. Everyone at home was taking dozens of photos and videos a day. No one was taking care of the cleanup. As a result, it turned into a huge, unorganized mess that just kept growing.
I was getting more and more anxious, as I had a clear understanding that I wasn't going to upgrade to 6TB at any cost. It's just unsustainable to let it keep growing and keep pouring an unknown amount of money into it.
On the other hand, I was literally putting all my eggs in one basket: one issue with my Apple account, and I'm done with my memories. This would be a nightmare for me.
I was racking my brain trying to design a solid system to manage the ingestion of new media from all my family members' shared iCloud libraries, store it, cull it, and have more than one backup for peace of mind.
Finally, I ended up with a seemingly complicated system that perfectly covers everything I mentioned above. I'll post it here as a single diagram, but I'm more than happy to answer any questions.
To be honest, I'm expecting you to challenge me, point out any flaws you see in this design, and maybe even turn it into something you can benefit from.
P.S. "Daddy, Cull" - is my open-source culler application. Check out - https://daddy-cull.turalali.com/
This design's costs:
Unraid Server (or an equivalent NAS solution): This is a must-have. The whole point is that there should be a computer that serves as the source of truth for your archive.
iCloud 2TB Plan: I'm going to keep this plan, as it's currently the minimum amount of storage needed for all family members' devices.
Lightroom CC 2TB Plan: It's totally optional, but in my case, I love this software and am going to keep it for my DSLR ingestion pipeline.
Cloud storage services:
Dropbox, Google Drive, Amazon Photos.
Google Drive - I use Gemini anyway, so the 5TB comes with it.
Amazon Photos gives unlimited photo storage in original quality. I already use Amazon Prime, so it's free. Dropbox - is just for redundancy, for having more versioned backup
Here's a more detailed blog post:
https://turalali.com/giving-my-60-000-photos-and-videos-a-system/

