User-agent: * Allow: / # The JSON data endpoints (/api/models, /gpu-rates, /market-curves, /compute-index, # /gpu-history-matrix, /gpu-avg-price-matrix, ...) are deliberately NOT disallowed: # the pages render their content client-side from them, and Googlebot obeys # robots.txt for a page's own subresources too -- blocking them made every page # render as an empty shell. They're kept out of the index via an # `X-Robots-Tag: noindex` response header instead (main.py). Disallow: /dashboard Disallow: /admin/ Disallow: /status Disallow: /gpu-status Disallow: /market-status Sitemap: https://cheap-gpus.com/sitemap-index.xml