Render robots.txt

Return the site's robots.txt directives as plain text. Body is composed from the site's SEO settings (allow/disallow patterns, crawl-delay) plus a `Sitemap:` line pointing at the site's sitemap URL.

GET/robots.txt

Base URLhttps://api.lynkow.com/public/{siteId}

View as markdown Install Lynkow Skills

curl --request GET \
  --url 'https://api.lynkow.com/public/{siteId}/robots.txt' \
  --header 'Authorization: Bearer $API_TOKEN'

"User-agent: *\nDisallow: /admin\nDisallow: /api\nAllow: /\n\nSitemap: https://docs.acme.io/sitemap.xml\n"

Feedback

Was this page helpful?