Commit Graph
6 Commits
Author SHA1 Message Date
tbenandClaude Opus 5.5 be4bebaa22 Add robots.txt generation and sitemap chunking
- bunext sitemap now writes public/robots.txt (configurable via the
  robots config key; robots: false or --no-robots to skip). Hand-written
  robots.txt files are never overwritten without a robots config
- Large sitemaps are split into public/sitemap-chunks/sitemap-N.xml
  (sitemap.chunk_size, default 10,000, max 50,000; 50MB per file) with
  sitemap.xml as a sitemap index; stale chunks are cleaned up
- Export bunextGenerateRobotsTxt
- Run tests in publish.sh

Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-10-14 18:02:52 +01:00
tben 632881e174 Add sitemap generation utility 2026-10-14 17:41:50 +01:00
tben 60ee353bf0 Refactor Server Paradigm. 2026-03-24 07:18:57 +01:00
tben 49d6781170 Update web-page handler: add more detailed error logs 2026-03-22 10:56:48 +01:00
tben 98d3cf7da7 Add features: custom server and websocket. Minor refactoring 2026-03-21 07:42:38 +01:00
tben 7ef114ee70 Handle browser Errors. 2026-03-21 06:34:32 +01:00