12 lines
213 B
Plaintext
12 lines
213 B
Plaintext
# https://www.tben.me robots.txt
|
|
|
|
User-agent: *
|
|
Allow: /
|
|
|
|
# Sitemaps
|
|
Sitemap: https://www.tben.me/sitemap.xml
|
|
|
|
# Optional: disallow common non-content paths (uncomment if needed)
|
|
Disallow: /api/
|
|
Disallow: /_next/
|