Creepy crawlies

Simon Willison··作者 Simon Willison

资讯摘要

7th September 2026 - Link Blog Creepy crawlies ( via ) Konstantin Ryabitsev discusses how bad the "background radiation" of abusive crawlers has become from the perspective of git.kernel.org , the official Git repository for the Linux kernel: TL;DR: we spend more CPU cycles rendering commits for scrapers than we spend on all other kinds of legitimate access, including git clones. At any one time, across 5 geo-distributed nodes, there are 14 CPU cores doing nothing but rendering git commits as html.

来源与参考

  1. 原始链接
  2. Creepy crawlies

收录于 2026-09-09