1 hour ago · Tech · 0 comments

I have done what I can to prevent increased traffic from creepy crawly scraping bots, but it seems mostly useless unless I make things more complicated for humans. When I tried to find answers on how to block headless user agents, all I got were ways to circumvent those blocks. If that’s where we’re at, being annoying is the next step. But I don’t have high hopes that LLMs will be well poisoned.I wanted to do the same as Heydon Pickering describes in Poisoning well, where every article also has a nonsensical version, but using my stack of Craft CMS and Twig templates. I ended up with two versions and theorised how I could send the scraping bots on an endless journey, which Heydon originally did too but has since reverted based on reasonable user concerns.Potion of poisonMake a partial template, like a copy of your regular article template, and name it using an underscore as the first character.Set up a dynamic route similar to your existing route for your articles, but with something…

No comments yet. Log in to reply on the Fediverse. Comments will appear here.