Mod Archive Forums
Community => News => Topic started by: looper231 on September 15, 2025, 10:22:58
-
:breakpage:
:breakhead:
Recently, Modarchive has been experiencing major slowdowns. The frequency of this happening was not that big in the beginning, but now it reached to am almost daily thing now. At first we thought it was just a DDoS, but now it's apparent, that TMA is being targeted by AI scrapers.
So far, We've tried a number of solutions which proved to be ineffective. We're trying our best to fight this problem. I am very sorry for the inconvenience this brought over the past months.
// LooPeR231
:breakhead:
:breakpage:
-
Hi - Use goaway (https://git.gammaspectra.live/git/go-away) or Anubis (https://github.com/TecharoHQ)
These scripts stop bots - I wish you luck
--- Details ---
This is the official message from this script
Why am I seeing this?
You are seeing this because the administrator of this website has set up Anubis to protect the server against the scourge of AI companies aggressively scraping websites. This can and does cause downtime for the websites, which makes their resources inaccessible for everyone.
Anubis is a compromise. Anubis uses a Proof-of-Work scheme in the vein of Hashcash, a proposed proof-of-work scheme for reducing email spam. The idea is that at individual scales the additional load is ignorable, but at mass scraper levels it adds up and makes scraping much more expensive.
Ultimately, this is a hack whose real purpose is to give a "good enough" placeholder solution so that more time can be spent on fingerprinting and identifying headless browsers (EG: via how they do font rendering) so that the challenge proof of work page doesn't need to be presented to users that are much more likely to be legitimate.
Please note that Anubis requires the use of modern JavaScript features that plugins like JShelter will disable. Please disable JShelter or other such plugins for this domain.
Protected by Anubis from Techaro. Made with ❤️ in 🇨🇦.
Link to Anubis (https://github.com/TecharoHQ)
Proof-Of-Work (https://anubis.techaro.lol/docs/design/why-proof-of-work)
You can see, this script does as little effort to stop a whole flood of bots.
Here are several pages - under the following lines - that employ this script.
FFMPEG's ultra powerful multimedia utility that I personally use (https://trac.ffmpeg.org/) - I made my animated Avatar with this! (http://ibn.im/i/cyzNLgH)
Another example, using an external YouTube video player (https://inv.nadeko.net/watch?v=PWGawtEFL8w) - It uses goaway (https://git.gammaspectra.live/git/go-away) - Useful to save on bandwidth, but bots attacked it often too. Not anymore - It uses a variant that does not use modern JavaScript. Cool! This is the only variant I can run in Internet Explorer. Not that you should follow old browsers.
-
To briefly periphrase an explanation of Saga Musix: This is simply not possible to implement, because of the way TMA operates on the server machine.
-
Glad to see a response as quick as you made it!
Looks like limitations exist on the implementation... :'(
I saw that sometimes either one of the two work - It is always good to try ^^