KDE Social
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
digicatM to blueteamsec@infosec.pubEnglish • 14 days ago

Perplexity is using stealth, undeclared crawlers to evade website no-crawl directives

blog.cloudflare.com

external-link
message-square
0
fedilink
  • cross-posted to:
  • cybersecurity@sh.itjust.works
  • technology@lemmy.zip
2
external-link

Perplexity is using stealth, undeclared crawlers to evade website no-crawl directives

blog.cloudflare.com

digicatM to blueteamsec@infosec.pubEnglish • 14 days ago
message-square
0
fedilink
  • cross-posted to:
  • cybersecurity@sh.itjust.works
  • technology@lemmy.zip
Perplexity is repeatedly modifying their user agent and changing IPs and ASNs to hide their crawling activity, in direct conflict with explicit no-crawl preferences expressed by websites.
alert-triangle
You must log in or register to comment.

blueteamsec@infosec.pub

!blueteamsec@infosec.pub

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !blueteamsec@infosec.pub

For [Blue|Purple] Teams in Cyber Defence - covering discovery, detection, response, threat intelligence, malware, offensive tradecraft and tooling, deception, reverse engineering etc.

  • 15 users / day
  • 67 users / week
  • 308 users / month
  • 308 users / 6 months
  • 454 subscribers
  • 421 Posts
  • 54 Comments
  • Modlog
  • mods:
  • digicat
  • BE: 0.19.3
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org