The majority of the traffic on the web is from bots. For the most part, these bots are used to discover new content. These are RSS Feed readers, search engines crawling your content, or nowadays AI bo

The one-liner:

dd if=/dev/zero bs=1G count=10 | gzip -c > 10GB.gz

This is brilliant.

  • just_another_person@lemmy.worldEnglish
    802·
    20 hours ago

    I believe he’s returning a gzip HTTP response stream, not just a file payload that the requester then downloads and decompresses.

    Bzip isn’t used in HTTP compression.

    • sugar_in_your_tea@sh.itjust.worksEnglish
      20·
      21 hours ago

      Brotli is an option, and it’s comparable to Bzip. Brotli works in most browsers, so hopefully these bots would support it.

      I just tested it, and a 10G file full of zeroes is only 8.3K compressed. That’s pretty good, though a little bigger than BZip.