Topic: Site Too Slow

Posted under Site Bug Reports & Feature Requests

Not sure if it's worth adding my 2 cents here, but I too have been getting some odd connection issues. I have a script that slowly archives the site and within the past month or so I've noticed it frequently halting with "Remote end closed connection without response" after around 2 hours of running. It doesn't always happen, but I never used to see that. My delay between images is 6-7 seconds and the script used to run every 5 hours. I assumed it was a Cloudflare anti-AI thing but if static1 isn't behind Cloudflare then that's not the issue.

you know I heard a rumor that the reason is due to server moving but honestly I have no idea

jhudson said:
if incognito dodges the slowdown, you probably just need to clear your cache and cookies since incognito doesnt use those
a classic turn it off and on again but for browser stuff

Incognito mode only appears to mitigate the slowdown because you get served much lower quality versions of the content when not logged in, so it loads much faster. In reality the issue is still there.

The site is basically unusable for what seems like a decent amount of people now and the fact that no-one's willing to acknowledge there's a problem is infuriating. Routing issues are still issues. That said, it's the same for me even if I use a proxy to the US or not, which implies it's not really a routing issue either.

mrbees said:
Incognito mode only appears to mitigate the slowdown because you get served much lower quality versions of the content when not logged in, so it loads much faster. In reality the issue is still there.

The site is basically unusable for what seems like a decent amount of people now and the fact that no-one's willing to acknowledge there's a problem is infuriating. Routing issues are still issues. That said, it's the same for me even if I use a proxy to the US or not, which implies it's not really a routing issue either.

What annoys me, are the folks claiming it's all down to Cloudflare, when it really isn't, it is the site itself. I've swapped different DNS, tweaked my router and everything, and only this site is the one having issues loading something as simple as an image file. Either folks don't know zip and want to act like they know something they don't (like 2 pages ago pinning it on Cloudflare), or others aren't willing to admit something is going on behind the scenes (because the site has been acting slow ever since the drama surrounding internet censorship bills started showing up and nowhere near this bad before).

All I want is a simple answer and why it's happening.

Donovan DMC

Former Staff

sunstreaker said:
What annoys me, are the folks claiming it's all down to Cloudflare, when it really isn't, it is the site itself. I've swapped different DNS, tweaked my router and everything, and only this site is the one having issues loading something as simple as an image file. Either folks don't know zip and want to act like they know something they don't (like 2 pages ago pinning it on Cloudflare), or others aren't willing to admit something is going on behind the scenes (because the site has been acting slow ever since the drama surrounding internet censorship bills started showing up and nowhere near this bad before).

All I want is a simple answer and why it's happening.

The people pinning it on cloudflare clearly haven't seen the multitudes of times it's been said that the static server is not behind cloudflare
It being behind cloudflare would likely nullify the problem entirely because of caching at edge servers, that caching doesn't exist because there's only a single central server to hit

I'd also like to point back to this on the last page:

hal_greaves said:
If you’re encountering performance issues, these are likely regional. Connections from locations far from Arizona may experience latency due to the need to pass through multiple networks, and any one of those networks might be encountering issues. Additionally, users in countries with restrictive policies on pornography may face intentional rate-limiting by local ISPs.

Due to no local edge servers for caching any request needs to go all the way to arizona, who knows how many hops it's going through to get there depending on where you are and who your network provider is

I've tried a VPN, clearing cache, turning on and off my internet, and my image quality is already at Sample, still slow at points but sometimes it's not
I don't have another device to try e621 on and this definitely began once the ui changes started happening
I also had my internet boxes renewed earlier this year like the person who made this post so it's not that

It may just be due to traffic at certain times but it's frustratingly slow when it happens

Tested on mobile data and wifi right now.
"Sample" image quality, loading 150 images per page.

Results are weird: data loads content faster than wifi, which should not be happening. Still much slower than even worst "usable" data connection I've tried to load e621 on. Regardless of connection, thumbnails behave as if they were generated on device itself rather than loaded from server or cache. Tag suggestions are lagging so much it's easier to keep them in plaintext file and type manually.

Site was gradually slowing down on its own already, but full new UI rollout essentially killed whatever was left of performance (not claiming it was new UI itself, could have been anything else, hopefully not tinfoilhat-y).

P.S. same results when loading 20 images per page.

... can it be that e621 tries loading full image regardless of user settings? This would explain some things, including "why changing quality to "sample" from "fit (horizontal)" doesn't change much in terms of image loading speed?" Local thumbnail generation would explain the rest.

Updated

… Honestly I can attest to this even if I have no idea what the deal is.

I’m on mobile on private and lately e6 feels slower. Tabs not loading making me repeatedly tap the link, comment posting taking much too long and making me have to refresh and potentially lose the comment… It’s not me being an impatient skink with shitty hardware because I know it used to run better than this. Glad to see I’m not insane.

Site functionality is barely there atm. I have to click or reload multiple times even just to go to or upvote a post.

Ruppari

Privileged

I'm having issues as well. I keep getting timeout errors, and often pages are stuck loading unless I hard refresh the page a time or two.

I'm having loading issues on Firefox on top of liking and favoring posts will error out. Sometimes refreshing the page works but not all the time. Opening a new tab sometimes results with the new tab in loading limbo. Forced to open a new tab.

I keep running into slowdowns today, particularly accessing infra that definitely is behind Cloudflare (I had a Cloudflare timeout page show up). Unresponsive search suggestions, slow listing pages, slowly applied ratings/favourites, etc.

It looks like the servers themselves are overloaded, not Cloudflare. And I haven't heard of having to wait a solid minute solely due to hops from the US to Europe.

If it helps at all and this is indeed a regional issue, here's CF ray ID from when it timed out for me a couple of hours ago: 974204dd6b00e294

I don't think I had issues with static servers. Media seems to load fine.

crystali_cast said:
Site functionality is barely there atm. I have to click or reload multiple times even just to go to or upvote a post.

That's not going to help, you should instead wait for the page/action to complete rather than instinctively keep trying over again. That only makes the issue worse.

Updated

Counterintuitive as it may be, but using desktop version in mobile browser may load pages faster.

I was having the same issues as lightwo yesterday (including at least one Cloudflare time out). But today the site's speed seems OK again.

Noticing some major slowdowns where it takes around 3 to 5 minutes to even load a page. I know it's not my internet, I've got 50 Mbps download speed and 45 Mbps upload speed, plus I'm in the Midwestern US, so I shouldn't be too far from the server in Arizona. Wonder what's going on

shinra33459 said:
Noticing some major slowdowns where it takes around 3 to 5 minutes to even load a page. I know it's not my internet, I've got 50 Mbps download speed and 45 Mbps upload speed, plus I'm in the Midwestern US, so I shouldn't be too far from the server in Arizona. Wonder what's going on

I'm going with there being some kind of major peering issue going on as if I use my phone hotspot or a VPN it works normally.

Started having the same slow down issue a couple days ago. I'm running Firefox (142.0) on Linux. I found that clearing site data and cookies will start things loading normal again, but it doesn't seem to last. Did it yesterday morning and everything started loading fine, this morning, things were back to loading slow (if at all). Cleared site data and cookies again, and once again the site is back to normal. Have to change site settings and re-login, but at least things work.

Android, Firefox Beta 142.0b9
Clearing Firefox RAM allocation (≈1GB) for now sped up both browser and website, remains to be seen if improvements "stick".

The biggest reason for slowness is that e621 does not have a content delivery network implemented. everything you see or do is retrieved from a single server in US west. Bandwidth and congestion and all that.
Edit: I'm wrong. e621 uses cloudflare. though still hosts their content on a single server

Updated

Donovan DMC

Former Staff

mothership said:
The biggest reason for slowness is that e621 does not have a content delivery network implemented. everything you see or do is retrieved from a single server in US west. Bandwidth and congestion and all that.
Edit: I'm wrong. e621 uses cloudflare. though still hosts their content on a single server

You are both wrong and not wrong in some aspects

  • The main site (e621.net) is behind cloudflare, the host for the images (static1.e621.net) is not
  • The site runs on 7 dedicated servers (mentioned in forum #435779)

donovan_dmc said:
You are both wrong and not wrong in some aspects

  • The main site (e621.net) is behind cloudflare, the host for the images (static1.e621.net) is not
  • The site runs on 7 dedicated servers (mentioned in forum #435779)

Noted. Glad to be aware of it now.

My connection earlier from Europe was garbage however connected to my VPN hooked it to Denver absolutely fine now.

It seems either cloudflare or ISPs is the problem could someone be network throttling?
Or could it be e621 has issues lately connecting from Arizona?

Also side note a month ago when the site started making design changes here and there when connecting my VPN to Phoenix Arizona I got the same connection problem as I'm getting in Europe. Connecting to Denver or Mexico no slow downs.

Could the ISP for e621 be doing something dodgy like throttling?

There are days where this gets so bad it takes me over 5 minutes to load a 8 MB image, not to mention videos that take half an hour to watch even when they are 3 minutes long because of the load times. Other sites load instantly, so it can't be my connection.

E621 has some sort of DDos pervention where if you connect from adresses that download too much or something it will throttle you down to absolute minimum so you can't use your sight properly. My provider does not give me private ip adress so I assume there is a ton of horny people trying to browse e621 trough it or something and e621 antiddos kicks in. Either way, I just pop mobile data and its fine

Aacafah

Moderator

redfields said:
E621 has some sort of DDos pervention where if you connect from adresses that download too much or something it will throttle you down to absolute minimum so you can't use your sight properly. My provider does not give me private ip adress so I assume there is a ton of horny people trying to browse e621 trough it or something and e621 antiddos kicks in. Either way, I just pop mobile data and its fine

Do you have a source for this? It's plausible, but I've never heard of this, & we already have rate-limiting for users making too many requests; if a user was eating through to much bandwidth, I imagine we'd just cut them off instead of throttling their connection speed.

Nope slow as hell tonight. Can barely load a single video. Hopefully gets fixed at some point. Not having issues with other sites and tried two different browsers.

Can confirm that it's really slow - It loads 2 thumbnails per second. I don't know if it's related but the site became slower for me after the UI changes in general

Updated

I'm getting this now. Only started in the last 12 hours or so, though.
edit about 10 hours later: And now it's gone like it never happened.

Updated

It is funny, yesterday I was having r34 not load pages unless I opened a new tab and e621 was completely fine.
Today r34 is fine but e621 is extremely slow to the point that thumbnails don't load, and the ones that do load won't open the full image cause it's too slow.

Oh lordy! haha

Ruppari

Privileged

The site has been alternating between loading just fine, and dial up speeds all day for me. It's currently so bad that it does not even load tag auto complete suggestions. Trace route reveals nothing out of ordinary for me, and I tried swapping between two different internet connections, which changed nothing.

Since yesterday the entire site is very slow for me, almost like old dial up conection.
is there any problem reported with the site?

Same here. Opening a new window of e takes several minutes now, while normally it takes only a couple of seconds (even lately). Something strange must be going on.

It apparently has gone really bad. I have to wait for like a minute just to load a single page, Tag Suggestions are not popping at at any rate.

Ruppari

Privileged

Earlier today everything I did and every page I opened took at minimum one minute to load. I left because the site is completely unusable to me like this. I came back couple hours later, and everything was again loading just as fine. And now it's doing that thing again. Everything is taking at minimum one minute to load, sometimes pages just don't load at all. I know it's not in my end, because every time the lag spikes happen, other people pop up in this thread to complain about same issues I am having.

Watsit

Privileged

donovan_dmc said:
Yes, we've all seen it, but it's either outdated or a damn lie
I run a status checker and I have seen no less than 100 request timeouts over the last 24 hours
That isn't some coincidence

... the need to pass through multiple networks, and any one of those networks might be encountering issues. Additionally, users in countries with restrictive policies on pornography may face intentional rate-limiting by local ISPs.

I have seen a few problems with gateway errors or cloudflare saying e621 wasn't responding, but these were short-lived problems some time ago. I otherwise haven't seen any significant issues with performance when other people here are saying the site is being unusably slow, suggesting that statement still holds. It's likely some intermediary network between the user and e6 causing slowdown, either on purpose by rate-limiting the site, or in error because it's encountering its own problems.

If you're on a system with such a tool, try running traceroute e621.net when you see the site being slow, and see which server in between you and e6 the slow down is occurring with (be careful with its output! it will show your IP address and the IPs and names of the servers near you that you're connecting through, potentially allowing people to locate where you are, if you're concerned about that).

donovan_dmc said:
Yes, we've all seen it, but it's either outdated or a damn lie
I run a status checker and I have seen no less than 100 request timeouts over the last 24 hours
That isn't some coincidence

Any reason why I am not experiencing the supposed debilitating slowness that everybody here is complaining about?

Donovan DMC

Former Staff

watsit said:
I have seen a few problems with gateway errors or cloudflare saying e621 wasn't responding, but these were short-lived problems some time ago. I otherwise haven't seen any significant issues with performance when other people here are saying the site is being unusably slow, suggesting that statement still holds. It's likely some intermediary network between the user and e6 causing slowdown, either on purpose by rate-limiting the site, or in error because it's encountering its own problems.

If you're on a system with such a tool, try running traceroute e621.net when you see the site being slow, and see which server in between you and e6 the slow down is occurring with (be careful with its output! it will show your IP address and the IPs and names of the servers near you that you're connecting through, potentially allowing people to locate where you are, if you're concerned about that).

I'm not seeing cloudflare errors, I'm seeing a 408 Request Timeout
Cloudflare does not serve up a 408 in any capacity, so that response is coming from an origin server

Loading e621 through Opera on wifi or mobile data (different IPs, speeds) is met with not just slowness but browser's own error page. Enabling Opera "VPN" with default location vaguely in America (I'm not paying for it) loads site instantaneously. Europe and Asia regions are slower, provided connection isn't derping out.

Firefox won't load e621 at all, but Firefox itself now has issues rendering regular news sites and forums regardless of extensions' type and presence, so... Opera it is for now.
Anyway, why such difference?

Even accounting for users' (assumed and expected) frantic downloads of art all throughout the year, it was not as bad as now. E6Ai is about as slow but at least sort of loads pages.

Edit: dependent on time of day for some reason. Now both browsers are fine with it.

Updated

donovan_dmc said:
I'm not seeing cloudflare errors, I'm seeing a 408 Request Timeout
Cloudflare does not serve up a 408 in any capacity, so that response is coming from an origin server

We don't have a straight physical connection to e621/Cloudflare, there's lots of cruft in the middle. Do a traceroute.

Donovan DMC

Former Staff

lemurbutts said:
We don't have a straight physical connection to e621/Cloudflare, there's lots of cruft in the middle. Do a traceroute.

A traceroute is not going to help, reread "Cloudflare does not serve up a 408 in any capacity", It's listed in their documentation
Cloudflare will not return a 408, they return a 521 (web server is down), 522 (connection timed out), 523 (origin is unreachable), or 524 (a timeout occurred)
There's nothing else but my host in the middle, and they've already confirmed they are not the issue

Ruppari

Privileged

I did some poking around yesterday, traceroute showed absolutely nothing unusual, but this seems to affect europe (some website issue reporting sites I checked had multiple reports from various european countries + when I tested a VPN, picking europe as location was just as laggy, but picking US got rid of all lag).

Donovan DMC

Former Staff

ruppari said:
I did some poking around yesterday, traceroute showed absolutely nothing unusual, but this seems to affect europe (some website issue reporting sites I checked had multiple reports from various european countries + when I tested a VPN, picking europe as location was just as laggy, but picking US got rid of all lag).

My server that's experiencing significant issues is based in the eu, and I've raised my request timeout from 5 seconds to 45 seconds and I'm no longer seeing complete timeouts, requests are just insanely slow
I'm requesting /posts.json?limit=0, so this should load near instantly

thegreatwolfgang said:
Any reason why I am not experiencing the supposed debilitating slowness that everybody here is complaining about?

Ya know, just because you're not experiencing anything doesn't mean everyone else is just making things up.

Watsit

Privileged

busterdrag said:
Ya know, just because you're not experiencing anything doesn't mean everyone else is just making things up.

No one said people are making it up, what was said before was it's likely something outside of e6's servers, some intermediary server(s) between the affected users and e6, and not something e6 can do anything about.

busterdrag said:
Ya know, just because you're not experiencing anything doesn't mean everyone else is just making things up.

Did I mention people are making things up? I'm pointing out the possibility this is not a server-side issue and it could be client-side (though I'm not completely ruling things out yet).

From what people are saying so far:

  • E6's servers are actually choking to the point it is unusable.
  • E6's servers are periodically choking, probably due to peak traffic hours.
  • Browsers are partially the issue.
  • Locations are partially the issue, with VPNs connecting directly to the US resolving it.

Updated

thegreatwolfgang said:
From what people are saying so far:

  • E6's servers are actually choking to the point it is unusable.
  • E6's servers are periodically choking, probably due to peak traffic hours.
  • Browsers are partially the issue.
  • Locations are partially the issue, with VPNs connecting directly to the US resolving it.

Might also be device-specific (by type and specific device). Two phones on one network with same Firefox versions with same extensions behave differently: one has issues loading e621 while the other doesn't.

Updated

This issue is also affecting Australia - same thing. Got gigabit, DNS is CloudFlare, Opera GX

Am saying the site is slow for me right now. I don't know the exact reason, yes I've read the other comments here but that doesn't mean I know why.
Am just saying it's effecting me as well.

Can also attest to it being super slow. I tried loading it last night on my phone, thought it was just down so I didn't bother, but I'm trying to do it again today on my PC this time, and it's still so damn slow. I refuse to believe it's something on my end because it's LITERALLY just E621 being affected. Youtube is fine, FA is fine, Twitter is fine, etc.

For me it's intermittent. Sometimes the site loads fine, sometimes it doesn't load at all.

I did a bit of testing, and at least for me, the slowdown seems specific to static1.e621.net. Meanwhile the safe mode host, e926 seems to work just fine.
I also noticed that the safe mode image host is also hosting all the explicit/questionable images. So with a bit of help from ChatGPT (I'm not a coder, I just knew what i wanted the code to do and asked it nicely) I wrote a simple tampermonkey script that seems to fix all my slowdown issues by simply pulling images from the static1.e926.net host instead of the 621 host. Might not be a solution to everyone experiencing slow loading of images/videos, but fixed my issue perfectly. I put the script up on Sleazyfork just in case it helps anyone else.

https://sleazyfork.org/en/scripts/550897-e621-image-mirror-replacer

As for why the e621 mirror is ultra slow and the e926 mirror is just fine... Not sure, but I suspect some ISP throttling or something similar.

Donovan DMC

Former Staff

felixgryph said:
I did a bit of testing, and at least for me, the slowdown seems specific to static1.e621.net. Meanwhile the safe mode host, e926 seems to work just fine.
I also noticed that the safe mode image host is also hosting all the explicit/questionable images. So with a bit of help from ChatGPT (I'm not a coder, I just knew what i wanted the code to do and asked it nicely) I wrote a simple tampermonkey script that seems to fix all my slowdown issues by simply pulling images from the static1.e926.net host instead of the 621 host. Might not be a solution to everyone experiencing slow loading of images/videos, but fixed my issue perfectly. I put the script up on Sleazyfork just in case it helps anyone else.

https://sleazyfork.org/en/scripts/550897-e621-image-mirror-replacer

As for why the e621 mirror is ultra slow and the e926 mirror is just fine... Not sure, but I suspect some ISP throttling or something similar.

forum #463524

felixgryph said:
I put the script up on Sleazyfork just in case it helps anyone else.

donovan_dmc said:
forum #463524

On other words: please don't.

Can static servers prioritise some regions over others on a schedule? For example Europe connection slows down at night when Americas have daytime?

website is ultra slow all of a sudden... I got 128mb/s and every other website is doing alright So i doubt it's from me only. Anyone else ?

Experiencing extreme slowdown of e621.net (takes ~2 minutes to load the login page)

static1.e621.net, e926.net and static1.e926.net work not as slow, but still feels like they're slowed down

I use VPN, so I suspected it had something to do with the ISP of my VPN server. Tried other locations... found out that I'm experiencing this problem at least in Netherlands, and at least with ISPs -- Akamai International B.V. and Scalaxy B.V.

Same issue today.
I thought it was because of storms in my area but everything else works fine.
edit: it took around 10-15 seconds to only load my pfp lmao

Recently, we have been periodically experiencing transiently regional issues. Our servers are not distributed all over the world, and they seem to be running fine during most of these incidents, so this seems to be an upstream issue, which is hard for us to diagnose.
Things to try:
- You can run a traceroute and see what node is causing issues. You can try another VPN region and other network resets to bypass this.
- You can run a speed test.

We may need a way to post simple reports of issues on GitHub discussions, a google forum, or something like that to get more details.

Updated

catt0s said:
You can see what app server you are on in the footer (app2 or app3).

Perhaps I'm just blind again, but I can't seem to find that in the site footer.
I can only see the links to Rules, Takedowns etc. and the current version of the site, but no app server.
Searching through the current page html also didn't yield any results.
Maybe only staff accounts can see that?

Donovan DMC

Former Staff

snedmano said:
Perhaps I'm just blind again, but I can't seem to find that in the site footer.
I can only see the links to Rules, Takedowns etc. and the current version of the site, but no app server.
Searching through the current page html also didn't yield any results.
Maybe only staff accounts can see that?

Yes, it's staff only

catt0s said:
Recently, we have been periodically experiencing transiently regional issues. Our servers are not distributed all over the world, and they seem to be running fine during most of these incidents, so this seems to be an upstream issue, which is hard for us to diagnose. You can see what app server you are on in the footer (app2 or app3).
Things to try:
- You can run a traceroute and see what node is causing issues. You can try another VPN region and other network resets to bypass this.
- You can run a speed test.

We may need a way to post simple reports of issues on GitHub discussions, a google forum, or something like that to get more details.

The site has been unusable for a good few months for me. The pages load fine but actual media from the static servers are garbage. Download speed is between 50 and 150KB/s from it. Every other site, game, service, etc works fine. Line is symmetric gigabit.

Here's a trace and an example image download speed result.

tracepath static1.e621.net
1?: [LOCALHOST] pmtu 1500
1: _gateway 0.373ms
1: _gateway 0.506ms
2: [REDACTED] 13.345ms
3: [REDACTED] 25.125ms
4: [REDACTED] 13.559ms
5: [REDACTED] 13.650ms asymm 6
6: lo0.bdr1.thn.as42611.net 13.687ms asymm 5
7: zayo-ntt.mcs1.lhr15.uk.eth.zayo.com 96.340ms asymm 14
8: ae-2.r23.londen12.uk.bb.gin.ntt.net 94.501ms asymm 14
9: ae-13.r27.asbnva02.us.bb.gin.ntt.net 97.569ms asymm 13
10: ae-4.r22.dllstx14.us.bb.gin.ntt.net 129.106ms asymm 16
11: ae-2.a02.phnxaz02.us.bb.gin.ntt.net 151.219ms asymm 17
12: ae-2.a00.phnxaz02.us.bb.gin.ntt.net 153.305ms asymm 20
13: no reply
14: 206.168.191.180 147.594ms asymm 17
15: no reply
16: no reply
17: no reply
18: no reply
19: no reply
20: no reply
21: no reply
22: no reply
23: no reply
24: no reply
25: no reply
26: no reply
27: no reply
28: no reply
29: no reply
30: no reply
Too many hops: pmtu 1500
Resume: pmtu 1500

Download: 100%[==========================>] 3.37M 104KB/s in 41s

Not fun.

It's happening to me right now. I search an artist and the images don't appear. Is it happening to anyone else?

Happening to me right now, got a 502 error at one point. Lagtastic on Firefox while logged in, works fine on Chrome while logged out.

The site loads images very slowly. It's pretty much impossible to do anything. Also isitdownrightnow shows static1.e621.net as down.

I don't recall if this was said here, but we've been having reports of sporadic regional problems for some time now; our current hypothesis is that there's a node in Eastern Canada or Europe that's not properly routing traffic from our servers in Arizona to users in affected regions. Depending on your region, using a VPN to try & make the data take a different path might resolve this. We're working to resolve this, but as the fault lies downstream from us, our options are drastically limited.

I'll have to look into the VPN option myself. For whatever reason for the last while the site has been unusable more often than not, ancient dial-up speeds if images don't fail to load at all.

Original page: https://e621.net/forum_topics/47511?page=3