Topic: Slow set requests

Posted under Site Bug Reports & Feature Requests

Sorry if this doesn't belong in bug reports but I'm getting very slow/laggy response times for anything to do with sets (adding, listing sets to add to, etc) that can take up to 10 seconds per request. I don't think it's my network because my speed is about a gigabit and I don't have anything that isn't very typical to cause problem. If there is anything I can do on my end I'll do it but if not then I guess I'm posting to make aware of this. Everything else on the site loads fine and quickly Images and all

Donovan DMC

Former Staff

Sets get slower and slower the larger they get, recently it has been significantly worse where rather than sets starting to break down around ~7000 posts it can start as early as 200 posts
Why I'm not sure about, it's possible that was an existing issue I didn't notice due to the increased db query timeout (9 seconds compared to the normal member's 3) given to former staff and above, but it's now 3 across the board

You can't really do anything about it, these kinds of issues are due to inefficiencies with how sets are handled, we're sitting on years of code debt so it isn't really any particular person's fault and with the size of the site it's near impossible to fix without temporarily getting the feature and redesigning it from scratch, which no one wants to dk

Recently i've also been getting "Error: The database timed out running your query."
is this also in relation to the slow set problems?

donovan_dmc said:
Sets get slower and slower the larger they get, recently it has been significantly worse where rather than sets starting to break down around ~7000 posts it can start as early as 200 posts
Why I'm not sure about, it's possible that was an existing issue I didn't notice due to the increased db query timeout (9 seconds compared to the normal member's 3) given to former staff and above, but it's now 3 across the board

You can't really do anything about it, these kinds of issues are due to inefficiencies with how sets are handled, we're sitting on years of code debt so it isn't really any particular person's fault and with the size of the site it's near impossible to fix without temporarily getting the feature and redesigning it from scratch, which no one wants to dk

donovan_dmc said:
Sets get slower and slower the larger they get, recently it has been significantly worse where rather than sets starting to break down around ~7000 posts it can start as early as 200 posts
Why I'm not sure about, it's possible that was an existing issue I didn't notice due to the increased db query timeout (9 seconds compared to the normal member's 3) given to former staff and above, but it's now 3 across the board

You can't really do anything about it, these kinds of issues are due to inefficiencies with how sets are handled, we're sitting on years of code debt so it isn't really any particular person's fault and with the size of the site it's near impossible to fix without temporarily getting the feature and redesigning it from scratch, which no one wants to dk

I feared it might be so. It might not be high priority but I hope it gets improved sometime.

I use to have the a set that reached the limit of ten thousand yet had little to no issues. So it's gotten worse recently.

Original page: https://e621.net/forum_topics/59132