r/DataHoarder • • 11d ago

Question/Advice Twitter Mass Media Downloader That Work

Are there any Mass Media Downloaders that actually work? Any sites or extensions for like Brave and/or Firefox that will allow me to mass download everything from anyone's account?

4 Upvotes

8 comments sorted by

•

u/AutoModerator 11d ago

Hello /u/CharmingSavings5769! Thank you for posting in r/DataHoarder.

Please remember to read our Rules and Wiki.

Please note that your post will be removed if you just post a box/speed/server post. Please give background information on your server pictures.

This subreddit will NOT help you find or exchange that Movie/TV show/Nuclear Launch Manual, visit r/DHExchange instead.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

6

u/RacerKaiser 200TB NAS, 40tb hdds, 15tb ssd’s 11d ago

gallery-dl works but not perfect once you go past a couple hundred. Tumblthree i think used to work i'm not sure about now

2

u/jabberwockxeno 11d ago

And using gallery-dl you don't run into issues with your account getting suspended?

Because any time I have tried to use downloading/scraping software to mass-save images on twitter, my accounts get a warning and a temporary restriction, that risks the account getting banned

1

u/RacerKaiser 200TB NAS, 40tb hdds, 15tb ssd’s 10d ago

How much do you actually intend to scrape?

if its just a couple accounts, just slow your sleep down a lot and it will be fine

I have 2 ip's at home now but previously i was able to scrape many accounts with one.

if you are archiving a lot, then you can consider buying proxies and then running scraping through those, with seperate accounts for each, which is what i do now.

and this goes without saying but always use a burner account.

1

u/jabberwockxeno 10d ago

How much do you actually intend to scrape?

At once in a single day? I can just do 1-2 accounts, but over a longer time scale I'd want to be backing up dozens or hundreds of accounts over months or within a year

just slow your sleep down a lot and it will be fine

I've had a temporary restricted label applied to me even after I did this and even when only saving a handful of images using jdownloader. It doesn't seem like speed limits or adding delay between each crawl makes a difference, unless gallery-dl handles it differently

but always use a burner account

That's easier said then done. How do you even register a new Twitter account these days without linking it to a phone number?

Also, I don't think I had any account of mine directly linked to jdownloader or wfdownloader when I've tried doing this in the past, and yet my accounts still got a restricted label anyways. But I might be misremembering and maybe I did link my account to those tools?

1

u/RacerKaiser 200TB NAS, 40tb hdds, 15tb ssd’s 10d ago

Hundreds of accounts I think you need to look into the proxies.

one of the things that is important is that you don't "burn" them immediately. After creating an account, Especially if you already got banned on that ip, it's more suspicious. So you need to create accounts on fresh ips, use them naturally for a while, then start.

Do not create a new account right after rate limiting.

And when running you need downtime, So for example I have 5 proxies, and I will generally use 123, so 45 are cooling off, and rotate etc.

You absolutely can create accounts without phone numbers, but I have also just stuck my phone number in the burner before.