These bring it up to 16 months of logs posted.  Most of this traffic is from bots.  I’ll probably post some thoughts about today.

So, when I say most of the traffic is from bots, crawlers, scrapers, agents, scripts and automated processes I mean like 99.9%.  There are dozens and dozens of them.  I don’t know what the hell they’re doing.  To the few actual humans who do view this site I say, Hi mom! Hi Felix!

I could block them I guess, but outside of energy consumption concerns, what would be the reason?  And regardless of energy costs they could generate a petabyte of traffic, I still get charged the same.  No wonder MSFT\GOOGL\AAPL\NVDA need nuclear power plants.  Just checked, the internet uses estimates of 1% – 2% of the Earth’s total power output.

Security, research, cataloging, training…who knows but there are so many.  Almost makes me feel guilty for having a WordPress front page that is typically half a gig of .gif animations.  Based on the amount of data transferred most of the bots are downloading the animations and don’t ever really seem to have any size or file type filters in place to stop them.  And bots like Baidu or Bytespider have downloaded the same things over and over hundreds if not thousands of times.

And I can remember people yelling at me for posting .jpg’s that were too big.