# ========================================== # Optimized Robots.txt for CoverTrader.com # Handcrafted by Senior SEO Consultant # ========================================== User-Agent: * # 1. WordPress Core & Ajax (Standard Rules) Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php # 2. Block All RSS Feeds (Fixing Crawled Not Indexed Issue) Disallow: */feed/ Disallow: /*/feed/ Disallow: /feed/ Disallow: /comments/feed/ # 3. Block Internal System Pages & Panels (Fixing Security & Trap Leaks) Disallow: /wp-login.php Disallow: /go-to-panel Disallow: /go-to-panel/ Disallow: /wp-*.php # 4. Block Low-Value Architecture & Duplicate Content Disallow: /author/ Disallow: /search/ # 5. Fix Strange Wildcard Leaks (Discovered in Search Console) Disallow: /wp-content/plugins/* Disallow: /wp-content/themes/* Disallow: /wp-content/uploads/*.webm Disallow: /wp-content/uploads/*.mp4 # 6. Block Specific Query Parameters Traps Disallow: /*?service_category=* Disallow: /*?replytocom Disallow: /*?TB_iframe=* # 7. Ensure Google Can Render CSS & JS (Vital for Core Web Vitals) Allow: /*.js Allow: /*.css Allow: /wp-includes/*.js Allow: /wp-includes/*.css Allow: /wp-content/themes/*.css Allow: /wp-content/themes/*.js Allow: /wp-content/plugins/*.css Allow: /wp-content/plugins/*.js # 8. Main Sitemap Declaration Sitemap: https://covertrader.com/sitemap_index.xml