Perplexity is repeatedly modifying their user agent and changing IPs and ASNs to hide their crawling activity, in direct conflict with explicit no-crawl preferences expressed by websites.
  • @AceFuzzLord@lemmy.zipEnglish
    3•13 days ago

    Anubis is a godsend, so long as A"I" companies cannot break it… and so long as we get people to switch to browsers like Mull and Ironfox.