Back to Intelligence Hub

SEO Architecture: sitemap.xml & robots.txt

lodhi.net implements search engine indexing files configured for optimal crawling by major search engines and authorized AI knowledge aggregators. Internal architecture views and scaffolding tools are explicitly excluded.

robots.txt (Disallowing /scaffold/)
User-agent: *
Allow: /
Disallow: /scaffold/
Disallow: /private/
Disallow: /api/

# AI Crawler Directives (Authorized Indexing)
User-agent: GPTBot
Allow: /
Disallow: /scaffold/
User-agent: ClaudeBot
Allow: /
Disallow: /scaffold/
User-agent: PerplexityBot
Allow: /
Disallow: /scaffold/

Sitemap: https://lodhi.net/sitemap.xml
sitemap.xml (Filtered)
<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <url>
    <loc>https://lodhi.net/</loc>
    <lastmod>2026-03-28</lastmod>
    <changefreq>daily</changefreq>
    <priority>1.0</priority>
  </url>
  <url>
    <loc>https://lodhi.net/articles</loc>
    <lastmod>2026-03-28</lastmod>
    <changefreq>daily</changefreq>
    <priority>0.9</priority>
  </url>
  <url>
    <loc>https://lodhi.net/glossary</loc>
    <lastmod>2026-03-28</lastmod>
    <changefreq>weekly</changefreq>
    <priority>0.8</priority>
  </url>
  <url>
    <loc>https://lodhi.net/editorial</loc>
    <lastmod>2026-03-28</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.6</priority>
  </url>
  <url>
    <loc>https://lodhi.net/sitemap</loc>
    <lastmod>2026-03-28</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.3</priority>
  </url>
  <url>
    <loc>https://lodhi.net/calculators/insurance</loc>
    <lastmod>2026-03-28</lastmod>
    <changefreq>weekly</changefreq>
    <priority>0.9</priority>
  </url>
  <url>
    <loc>https://lodhi.net/calculators/mortgage</loc>
    <lastmod>2026-03-28</lastmod>
    <changefreq>weekly</changefreq>
    <priority>0.9</priority>
  </url>
  <url>
    <loc>https://lodhi.net/legal/editorial-policy</loc>
    <lastmod>2026-03-28</lastmod>
    <changefreq>yearly</changefreq>
    <priority>0.3</priority>
  </url>
  <url>
    <loc>https://lodhi.net/legal/privacy</loc>
    <lastmod>2026-03-28</lastmod>
    <changefreq>yearly</changefreq>
    <priority>0.3</priority>
  </url>
  <url>
    <loc>https://lodhi.net/legal/terms</loc>
    <lastmod>2026-03-28</lastmod>
    <changefreq>yearly</changefreq>
    <priority>0.3</priority>
  </url>
  <url>
    <loc>https://lodhi.net/articles/mortgage-rate-forecast-2026-fixed-vs-adjustable</loc>
    <lastmod>2026-03-28</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.9</priority>
  </url>
  <url>
    <loc>https://lodhi.net/articles/comprehensive-auto-insurance-deductibles-guide</loc>
    <lastmod>2026-03-22</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.9</priority>
  </url>
  <url>
    <loc>https://lodhi.net/articles/term-vs-whole-life-insurance-wealth-transfer</loc>
    <lastmod>2026-03-19</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.8</priority>
  </url>
  <url>
    <loc>https://lodhi.net/articles/actuarial-umbrella-risk-modeling</loc>
    <lastmod>2026-10-04</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.9</priority>
  </url>
  <url>
    <loc>https://lodhi.net/articles/ai-presettlement-funding-cpc-algorithms</loc>
    <lastmod>2026-10-04</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.9</priority>
  </url>
  <url>
    <loc>https://lodhi.net/articles/enterprise-saas-pricing-gai-dividend</loc>
    <lastmod>2026-10-04</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.9</priority>
  </url>
  <url>
    <loc>https://lodhi.net/articles/geo-arbitrage-cross-border-mortgages</loc>
    <lastmod>2026-10-04</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.9</priority>
  </url>
  <url>
    <loc>https://lodhi.net/articles/micro-captive-insurance-regulatory-arbitrage</loc>
    <lastmod>2026-10-04</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.9</priority>
  </url>
  <url>
    <loc>https://lodhi.net/articles/nmls-gaps-multi-state-licensure-mortgage-volume</loc>
    <lastmod>2026-10-04</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.9</priority>
  </url>
  <url>
    <loc>https://lodhi.net/articles/private-credit-agreement-clarity-math</loc>
    <lastmod>2026-10-04</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.9</priority>
  </url>
  <url>
    <loc>https://lodhi.net/articles/top-7-best-umbrella-insurance-policies-2026</loc>
    <lastmod></lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.9</priority>
  </url>
  <url>
    <loc>https://lodhi.net/articles/what-is-piti-explained</loc>
    <lastmod>2026-10-04</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.9</priority>
  </url>
</urlset>