I created a program called "Image Source Saver".
If a source url becomes rotten (HTTP 404), the image url id/hash might still be available or accessible in an archive collection.
However, it can be difficult (if not impossible) to get the image url after the source dies. Having the image url in the sources of an e621 post makes it super easy to find and use for any purpose.
After adding these manually with miniscule results for a while, I wanted an easier way to get this done.
The program goes down a list of posts. It gets the image url from a source in a post and adds it to the source list of that post.
If the post contains multiple images, it uses Fluffle to check which image goes to the correct e621 post ID.
There is a cooldown of 60 to 90 seconds after each post in the list (+45 seconds if Fluffle was used).
Link: https://github.com/IsolatedClutch/mgsimagesourcesaver
How to use
0. Install requirements via pip -r requirements.txt
1. Setup gallery-dl.conf, including setting up pixiv via gallery-dl oauth:pixiv (If you cannot use some platforms, comment out any wrappers you don't want to use in all of the root scripts.)
2. Run get_e621_posts.py to get a list of posts without an image source for a platform
3. Run add_image_sources.py to go though the post cache
Be street smart and responsible; don't do dumb shit with this program (going too quick, adding fake sources, way too low fluffle thresholds)
This is licensed under the Unlicense.