Topic: Direct upload whitelist requests

Posted under General

gattonero2001

Janitor

Fanbox pretty please

Site -> https://www.fanbox.cc

Direct URL -> https://downloads.fanbox.cc/images/post/*/*.*

faucet

Member

Site -> https://www.artstation.com/
Direct URL -> I've seen content on both https://cdna.artstation.com/ and https://cdnb.artstation.com/ - not sure if there's more. Might be best to whitelist https://*.artstation.com

J4TAPI

Member

Pillowfort

Site: https://www.pillowfort.social
Direct URL: https://*.pillowfort.social/posts/*.*

Alien Fluff

Janitor

We should consider adding Itaku here:

https://d1wmr8tlk3viaj.cloudfront.net/*

or https://d1wmr8tlk3viaj.cloudfront.net/gallery_imgs/* if you want to be more specific.

flaminhotcheatoes

Member

user_127567 said:
*.desu-usergeneratedcontent.xyz/*

Image servers for desuarchive.org, which archives posts from a handful of 4chan boards. This includes /trash/, which is where most furry stuff on 4chan is concentrated.

Surprised that Desuarchive's STILL hasn't been whitelisted. I've fixed the direct URL entry for the subdomain as well as adding the main site.

Site: https://desuarchive.org/

Direct URL: desu-usergeneratedcontent.xyz/

Updated

AoBird

Member

Baraag url has been changed it seems 

https://media.baraag.net/media_attachments/files/*/*/*/*/*/*/original/*.*

AlricKyznetsov

Member

I'd like to suggest

Site: 

https://imgbb.com/

Direct Example: 

https://i.ibb.co/xxxxxxxx/xxxxxxx.png

A lot of Russian artists seem to use it

Benjiboyo

Blocked

Not sure if said already, but... Since i'm uploading stuff from this. Kemono cc?

Site: https://kemono.cc/

Direct URL: https://kemono.cc/*/*/*/*.jpg

Also... How do i know when it's accepted/rejected?

Shitposter

Member

alien_fluff said:
We should consider adding Itaku here:

https://d1wmr8tlk3viaj.cloudfront.net/*

or https://d1wmr8tlk3viaj.cloudfront.net/gallery_imgs/* if you want to be more specific.

This has changed.

https://itaku.ee/api/media/gallery_imgs/*

For thumbnails and page previews they remove the file extension and add /lg.jpg or /xl.jpg (there may be others, I didn't check)

Example that I grabbed off the front page:
https://itaku.ee/api/media/gallery_imgs/FnaYcXrXwAAvbo3_fwup5aK.jpg
https://itaku.ee/api/media/gallery_imgs/FnaYcXrXwAAvbo3_fwup5aK/lg.jpg
https://itaku.ee/api/media/gallery_imgs/FnaYcXrXwAAvbo3_fwup5aK/xl.jpg

alphamule

Privileged

Hmm, from wording used, this seems to not apply at all to sources. Is there some restricted domains in source editing? As opposed to the URL used when trying to upload from another booru directly('hot linking').

giuth43284o

Member

Cohost should be added to the whitelist.
https://staging.cohostcdn.org/* excluding https://staging.cohostcdn.org/*?*
Links with anything with the ? portion of the url should be excluded as those images are resized.

alphamule

Privileged

Image server: img.comicfury.com
Example of site relying on it: https://divineacid.com/comics/107/
Example image link: https://img.comicfury.com/comics/201/46125a1602539053b74147f1137804650.png

Note: Uploading with permission of comic author.

I assume this domain is used by a lot of webcomics. It sounds like a hosting service according to their main page.

ComicFury webcomic hosting is a free, easy to use and advertisement-free tool that will help you easily set up and host a website for your webcomic, without any technical knowledge. All you will have to worry about when using ComicFury is actually making the comics, the rest is provided by us.
ComicFury gives your webcomic a completely customizable website, you can make your own layout, configure a ton of settings and it even comes with an author blog, RSS feeds and comment system.
You can also add your own domains (like www.mywebcomic.com) to your webcomics, giving you everything you would ever want, even as a professional webcomic-creator!

I don't know if smaller comic hosting services like Duck or Comic Genesis are normally whitelisted. I don't see them, either, even though I do see some multi-comic domains listed (Palcomix for example).

Benjiboyo

Blocked

Japan seems to be replacing pawoo or twitter with this
Site: https://misskey.io/
Direct URL: https://media.misskeyusercontent.com/io/*.png

alphamule

Privileged

benjiboyo said:
Japan seems to be replacing pawoo or twitter with this
Site: https://misskey.io/
Direct URL: https://media.misskeyusercontent.com/io/*.png

Isn't just like baraag and pawoo and other 'instances'? I haven't looked at it enough to tell if Mastodon, Matrix, etc. Mainly because soooooo much flashing images and hyperactive automatic scrolling making it hard to find text on the page. j/k but it is a pretty horrible UI design. https://github.com/misskey-dev/misskey Here it is.

Benjiboyo

Blocked

alphamule said:
Isn't just like baraag and pawoo and other 'instances'? I haven't looked at it enough to tell if Mastodon, Matrix, etc. Mainly because soooooo much flashing images and hyperactive automatic scrolling making it hard to find text on the page. j/k but it is a pretty horrible UI design. https://github.com/misskey-dev/misskey Here it is.

I agree that it's stupidly flashy, but apparently, it lets you post over 4 images in 1 "toot" basically. and those don't get shown on pawoo/mastadon. you'd have to download the image for instances like those.

Earlopain

Former Staff

faucet said:
Site -> https://www.artstation.com/
Direct URL -> I've seen content on both https://cdna.artstation.com/ and https://cdnb.artstation.com/ - not sure if there's more. Might be best to whitelist https://*.artstation.com

gattonero2001 said:
Plurk pretty please

Site -> https://www.plurk.com

Direct URL -> https://images.plurk.com/*

mairo said:
https://www.plurk.com/

Formatting:

justfortheapi said:
Pillowfort

Site: https://www.pillowfort.social
Direct URL: https://*.pillowfort.social/posts/*.*

abadbird said:
Artconomy

Site: https://artconomy.com
Direct URL: https://artconomy.com/media/art/*/*/*/*.*

giuth43284o said:
Cohost should be added to the whitelist.
https://staging.cohostcdn.org/* excluding https://staging.cohostcdn.org/*?*
Links with anything with the ? portion of the url should be excluded as those images are resized.

benjiboyo said:
Japan seems to be replacing pawoo or twitter with this
Site: https://misskey.io/
Direct URL: https://media.misskeyusercontent.com/io/*.png

I added these. Someone else updated baraag and added itaku a while ago.

kora viridian

Member

vuccala said:

It looks like the direct URL for that site would be at least

https://illustrators.ru/uploads/illustration/image/*

.
There is another possible path that starts with https://illustrators.ru/uploads/product/image/, but that appears to be for artists who are selling the artwork shown, so images in that path might be against the "no pay content" guideline.

Vuccala

Privileged

kora_viridian said:
[...]There is another possible path that starts with https://illustrators.ru/uploads/product/image/, but that appears to be for artists who are selling the artwork shown, so images in that path might be against the "no pay content" guideline.

Not in the same paywall manner as Patreon/SubscribeStar though. The /product/ path is used by https://illustrators.ru/mart which looks to be a marketplace for physical artwork (paintings, crafts, etc.), and original-resolution digital art files (for printing, etc).

Maryland P Sevenson

Member

satuputra796 said:
Please whitelist YouTube. It is the most popular video-sharing website owned by Google (Alphabet) that activated in February 14, 2005 and started as a video-dating site.

e.g.: https://youtube.com/shorts/MntuWFoL-sw?si=2vpK9vr9ArGd15p1 / https://youtu.be/kKohxOug2m0?si=bm_vrZrMkUyivOUl

I don't think YouTube even hosts any filetypes we can use (other than video thumbnails, I guess), I'm fairly certain YouTube only hosts .mp4 video files at this point. and the only video files we allow are .webm.

Watsit

Privileged

sipothac said:
I don't think YouTube even hosts any filetypes we can use (other than video thumbnails, I guess), I'm fairly certain YouTube only hosts .mp4 video files at this point. and the only video files we allow are .webm.

They do have webm files. However, it's far from straight forward to actually get the files (in fact, they aren't even files, but file chunks that get muxed by the player), and it uses a kind of algorithm to find and grab the proper chunks. You can't specify the actual file source to be able to whitelist them.

sunofureiku

Member

New Paheal CDN:
Site: https://rule34.paheal.net
Direct URL: https://*.paheal-cdn.net/*/*/*

hGJ1cwNfgl

Privileged

Buzzly.art: https://submissions.buzzly.art/*

Sheezy.art: https://cdn.sheezy.art/*

hGJ1cwNfgl

Privileged

VixenControlled.netIt's an archive of the defunct furry art site VCL and contains tons of rare early 2000s art that is at risk of being lost. I would like to upload some from the site and being able to direct upload by URL would be very useful.https://vixencontrolled.net/Artists/*/*.* should work?

Updated

kora viridian

Member

dsco said:
VixenControlled.net

It's an archive of the defunct furry art site VCL

I don't know if I would exactly call it an archive. According to the person who set up VixenControlled.net , a lot of the image files have been recompressed or had their format changed: GIF -> PNG, PNG -> WebP, big JPEGs -> AVIF. e621 doesn't accept WebP or AVIF files, and it's probably not a good idea to re-convert them into a format e621 accepts.

It's probably useful in that if you know the name of an artist who posted to VCL, it's easier to browse and find their stuff on VixenControlled.net than on archive.org or similar. But, once you find a picture on VixenControlled that you want to upload to e621, you should probably try to find it on archive.org, if possible, and upload the file from archive.org to e621.

Wolfmanfur

Blocked

kora_viridian said:
GIF -> PNG, PNG -> WebP, big JPEGs -> AVIF

This is a joke, right?

I can get behind JPEG -> AVIF for compression, but the other 2 are so stupid.
WEBP is very limited, it doesn't support everything PNG supports. If somebody converts a file from PNG to WEBP and they're not careful they can get a lossy conversion. We've had this conversation a few months ago.
GIF to PNG is a whole lot more baffling to me. What is the file gaining by being converted into an animated PNG? Without manual cleanup, it is still just a GIF in all its 256 colors glory that takes more space due to the APNG format.

Sorry for the rant, but I'll never understand people who do this shit. Files are at their highest quality when they are in their original filetype.

kora viridian

Member

wolfmanfur said:
GIF to PNG is a whole lot more baffling to me. What is the file gaining by being converted into an animated PNG?

I think they mean converting a static GIF to a static PNG.

When VCL started, static GIF was used in much the same way furry artists use static PNG now. It had lossless compression, which was handy when a lot of people had 0.05 megabit connections and small hard drives. It only supported 256 colors, but that didn't matter so much when a lot of people were still moving from VGA to Super VGA. It was relatively fast to decompress and display, which was important when the fastest x86 PC you could buy had an 0.1 GHz CPU. It had been out as a standard for 7+ years, so there were GIF viewers available on most of the popular platforms. If your art program couldn't save as GIF, programs that could convert to GIF were readily available.

GIF probably didn't start meaning "animation" to most people until the late 1990s, when it got popular for small animations on Web pages. Even then, it was still relatively common to see static GIFs on web pages for several more years.

Wolfmanfur

Blocked

kora_viridian said:
I think they mean converting a static GIF to a static PNG.

When VCL started, static GIF was used in much the same way furry artists use static PNG now. It had lossless compression, which was handy when a lot of people had 0.05 megabit connections and small hard drives. It only supported 256 colors, but that didn't matter so much when a lot of people were still moving from VGA to Super VGA. It was relatively fast to decompress and display, which was important when the fastest x86 PC you could buy had an 0.1 GHz CPU. It had been out as a standard for 7+ years, so there were GIF viewers available on most of the popular platforms. If your art program couldn't save as GIF, programs that could convert to GIF were readily available.

GIF probably didn't start meaning "animation" to most people until the late 1990s, when it got popular for small animations on Web pages. Even then, it was still relatively common to see static GIFs on web pages for several more years.

Point still stands, there is no meaningful improvement by changing the filetype from GIF to PNG.

Watsit

Privileged

wolfmanfur said:
Point still stands, there is no meaningful improvement by changing the filetype from GIF to PNG.

In some cases it does produce smaller files, and as long as it's done correctly, it is a lossless conversion.

faucet

Member

Can we get commishes.com added to the whitelist, especially now that we know it's a favorable source in some instances? howto:sites_and_sources_-_a_to_h#commishes

These patterns match most image URLs

https://*.commishes.com/*
https://commishes.io/images/*
Example URLs

Updated

hGJ1cwNfgl

Privileged

kora_viridian said:
I don't know if I would exactly call it an archive. According to the person who set up VixenControlled.net , a lot of the image files have been recompressed or had their format changed: GIF -> PNG, PNG -> WebP, big JPEGs -> AVIF. e621 doesn't accept WebP or AVIF files, and it's probably not a good idea to re-convert them into a format e621 accepts.

It's probably useful in that if you know the name of an artist who posted to VCL, it's easier to browse and find their stuff on VixenControlled.net than on archive.org or similar. But, once you find a picture on VixenControlled that you want to upload to e621, you should probably try to find it on archive.org, if possible, and upload the file from archive.org to e621.

I was unaware of this, thank you!

Donovan DMC

Moderator

Trello would be nice to add for direct uploads, as downloading the files then reuploading them is a bit tedious
Quite a few artists share finished commissions or example pieces on Trello at a higher quality than other sites allow, so trello boards can be a good source for art

The only urls I've seen is https://trello.com/1/cards/*/attachments/*/download/* & https://trello.com/1/cards/*/attachments/*/previews/*/download/*
There seems to be no difference in what is returned from either of these

https://e621.net/wiki_pages/26055#trello Lists trello as whitelisted, though this seems to have changed (their image url has changed, and https://trello-attachments.s3.amazonaws.com doesn't seem to be whitelisted either)

hGJ1cwNfgl

Privileged

Couple sites I've found when making artist entries:

Artfol: https://artfol-image.me/*/* - Image cannot be retrieved without inspect element, but it is possible and I believe this is the URL scheme.
Threads: https://scontent.cdninstagram.com/v/t51.29350-15/* - I'm unsure if there are other numbers for the "t" section? I've only seen this one, but maybe wildcarding that part would be a good idea?
Misskey: https://media.misskeyusercontent.jp/io/*
Aethy: https://cdn.aethy.com/media_attachments/files/*

I have also seen Inkblot quite a few times but I can't get profiles to load for me.

Alien Fluff

Janitor

nimphia said:
I have also seen Inkblot quite a few times but I can't get profiles to load for me.

That site puts a massive effort into security to make sure that users can only view images uploaded by artists and not download them, even through a user's browser cache. There's no chance that we are ever whitelisting that site and it's not worth bothering with.

hGJ1cwNfgl

Privileged

alien_fluff said:
That site puts a massive effort into security to make sure that users can only view images uploaded by artists and not download them, even through a user's browser cache. There's no chance that we are ever whitelisting that site and it's not worth bothering with.

Ooooof, gotcha. Unfortunate.

RakuStrike

Member

Fantia would be really nice to be added, although it's got a quite funky url pattern.
site url: https://fantia.jp
download url: https://cc.fantia.jp/uploads/post_content_photo/file/*/*

Example link:
https://cc.fantia.jp/uploads/post_content_photo/file/<7 digit>/<uuid>.png?Key-Pair-Id=[A-Z0-9]&Policy=[aA-zZ0-9_]&Signature=[aA-zZ0-9~_-]

J4TAPI

Member

Cara seems to be getting more popular, might wanna add that.

Site URL: https://cara.app
Direct URL: https://cdn.cara.app/production/posts/*

pamadan

Member

tonycoon said:
Uploading by URL is now possible again, but it's limited to whitelisted domains only. Therefore we need to start filling out said whitelist. If you have a site to suggest, please post it here, along with the domain that all images from that site reside on (for example d.facdn.net or *.deviantart.net).

Cohost: https://www.cohost.org
It has images in the higher side of the quality spectrum.

Nonbearnary

Janitor
  • https://*.host.bsky.network/xrpc/com.atproto.sync.getBlob?* (Bluesky, original size URL - a list of Bluesky CDN servers can be found here https://bsky-debug.app)
  • https://bsky.social/xrpc/com.atproto.sync.getBlob?* (Bluesky, original size URL - old schema, currently redirects to the one above)
  • https://medias.meow.social/media_attachments/files/* (Meow.social, overwhelmingly popular furry Mastodon instance)

spe

Admin

Added Meow.social, Bluesky, imgbb, Cara, and updated Danbooru. Cohost was already supported.

Updated

ShadyGuy

Privileged

For the howto:sites and sources page: Newgrounds now allows full size uploads in multi-image posts. It still converts to .webp but you can just change the extension in the URL to get the original one.
Older posts are unaffected.

smbsml

Privileged

New repositories for pics crossposted from 4chan drawthreads, as booru domains seem to be getting phased out:

The /co/llection (/co/ and /aco/ deliveries)
Site ---> http://co.llection.pics
Direct URL --->http://co.llection.pics/_images/*

Vidya Booru (/v/ deliveries)
Site ---> http://vidya.pics
Direct URL ---> http://vidya.pics/_images/*

Updated

SCTH

Member

New URL for Patreon uploads:

https://*.patreonusercontent.com/*

Might be able to get more specific; the ones I'm seeing are specifically https://c10.patreonusercontent.com/4/patreon-media/p/post/* but there could be others I just haven't seen.

  • 1
  • 2
  • 3