It took a year to ship WebAssembly in Anubis
Anubis, a server protection system designed to thwart AI companies from scraping websites, faced a significant challenge - loading its JavaScript. The server may have been overwhelmed, causing the error message "It took a year to ship WebAssembly in Anubis" to appear. This issue arose due to the administrator's efforts to safeguard the server against the harmful practices of AI scraping companies.
However, these measures inadvertently led to website downtime, rendering resources inaccessible for users. Anubis employs a Proof-of-Work scheme, similar to Hashcash, to mitigate excessive load during scraping activities. While this approach may seem negligible at individual scales, it becomes substantial when faced with mass scraping endeavors, making the scraping process considerably more expensive.
This system acts as a temporary solution, allowing for more time to be dedicated to identifying and fingerprinting headless browsers, which are often utilized by scrapers. It is essential to understand that Anubis necessitates the utilization of modern JavaScript features, which plugins like JShelter may disable. Users are advised to disable such plugins specifically for the Anubis domain to ensure proper functioning.
Written by urgent.news from Hacker News's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
This story
This is one outlet's version. Read the fullest account.
- It took a year to ship WebAssembly in Anubis anubis.techaro.lol