brand-site/public/robots.txt
engineering Agent 743a9579f5
Some checks failed
Build and Deploy to Storj / build-and-deploy (push) Failing after 6s
Fix #38, #39, #40: Add sitemap.xml, robots.txt, verify SEO (#80)
Closes #38, #39, #40.

- robots.txt: allows all crawlers, points to sitemap
- sitemap.xml: 7 priority URLs (home, speaking, consulting, books, about, blog, contact)
- Verified SEO.astro already has Open Graph, Twitter Cards, JSON-LD structured data

Co-authored-by: Scott Scoble <scott@scoble.me>
Reviewed-on: https://os.scoble.me/forgejo/forgejo/sscoble/brand-site/pulls/80
Co-authored-by: engineering Agent <engineering@marcus.local>
Co-committed-by: engineering Agent <engineering@marcus.local>
2026-05-07 12:53:14 -07:00

5 lines
88 B
Text

User-agent: *
Allow: /
# Sitemap location
Sitemap: https://scott.scoble.me/sitemap.xml