$ cat /var/log/thoughts

DevOps + Security + Web Dev

Posts matching all selected tags.

Filters3

Categories

AllTutorialsGuidesMeta AnalysisOpinionToday I Learned

Tags

AI Coding32API Design3Architecture3Astro1Auth1Automation6Bun3Caching1Career3Claude Code18CLI11Cloudflare4Comparison7Containers1Debugging1Developer Tools37DevOps3DNS1Docker3Domains1Encryption1Entrepreneurship1Freelancing3Java1JavaScript6Linux3ML3MCP5Mobile1Monitoring2Networking2Next.js1Nginx1Node.js4Observability2Open Source1Performance7Productivity22Python1React2SaaS1Security7Self-Hosting6Testing1Trend Commentary13TypeScript11Vercel1Vim / Neovim1Web Dev10Windows1
Clear filters

Showing page 1 of 1 (1 total posts)

How to Block AI Crawlers From Destroying Your Site

AI crawlers from OpenAI, Meta, and Anthropic are hammering sites with millions of requests per month. robots.txt alone does not stop them. Here are the 4 layers that actually work.

GuidesSecurityDevOpsWeb DevNginxCloudflare1 min read · Apr 11, 2026