Sitemap Management

Automatically crawl your site and enable intelligent internal linking.

Initial Sitemap Crawl

Starting Your First Crawl

1. Go to Sitemap in the sidebar
2. Select your WordPress site from dropdown
3. Click Crawl Sitemap
4. Wait 30-60 seconds for completion
5. Review indexed URLs in the results table

What Gets Discovered

The crawler extracts:

• Page titles: Used for link anchor text
• Meta descriptions: Context for link suggestions
• Target keywords: SEO keyword analysis
• URL status: Active, broken, or redirected
• Last modified: Content freshness indicator

Automatic Re-crawling

Sitemaps are automatically re-crawled:

• Daily at 2:00 AM (in your configured timezone)
• After manual trigger (when you click “Crawl Now”)
• On WordPress site updates (optional webhook)

Configuring Auto-Crawl

1. Go to Settings → Sitemap
2. Enable/disable automatic crawling
3. Set crawl frequency (daily, weekly, monthly)
4. Choose crawl time
5. Save settings

Manual URL Management

Adding URLs Not in Sitemap

Some pages may not appear in your sitemap:

1. Click Add URL button
2. Enter the full URL
3. Add page title
4. Add target keywords (comma-separated)
5. Add meta description (optional)
6. Click Save

Use cases:

• Landing pages excluded from sitemap
• Important category pages
• External resources on your domain

Removing Outdated URLs

1. Find URL in the list
2. Click Delete icon
3. Confirm deletion
4. URL removed from internal linking suggestions

Editing URL Metadata

1. Click Edit on any URL
2. Update title, keywords, or description
3. Save changes
4. Improved link suggestions use new data

Using Internal Links in Content

Automatic Link Suggestions

When generating content:

1. System analyzes your target keyword
2. Searches sitemap for relevant pages
3. Suggests 5-10 best matches
4. Shows relevance score for each

Selecting Links to Include

1. Review suggested links list
2. Check relevance scores (0-100)
3. Select 2-5 most relevant links
4. Click Include Selected
5. Links automatically inserted in content

Link Placement

Links are intelligently placed:

• In relevant paragraphs
• With natural anchor text
• Not clustered together
• Distributed throughout article

Best Practices

How many internal links:

• 2-5 links per article (recommended)
• At least 1 link for SEO benefit
• Maximum 10 to avoid over-linking

Choosing relevant links:

• Match topic context
• Link to related content
• Prioritize high-authority pages
• Vary anchor text naturally

Sitemap Statistics

View in Sitemap → Stats

Available Metrics

URL Overview:

• Total URLs indexed
• Active URLs
• Broken links detected
• Last crawl date/time

Performance Data:

• Average crawl time
• URLs per second processed
• Failed URL count
• Success rate percentage

Link Usage:

• Most linked pages
• Pages never linked
• Link distribution
• Popular anchor texts

Broken Link Detection

Identifying Broken Links

During crawls, the system checks:

• HTTP status codes
• Response times
• Redirect chains

Status Indicators:

• ✅ 200 OK: Active and working
• ⚠️ 301/302: Redirected (update URL)
• ❌ 404: Not found (broken)
• ❌ 500: Server error

Fixing Broken Links

1. Go to Sitemap → Broken Links
2. Review list of broken URLs
3. Options:
   • Update URL if page moved
   • Delete if page permanently removed
   • Ignore if false positive

Multi-Sitemap Support

For sites with multiple sitemaps:

Sitemap Index Files

If your site uses a sitemap index (sitemap pointing to other sitemaps):

1. Enter main sitemap index URL
2. System automatically discovers sub-sitemaps
3. All URLs indexed from all sitemaps

Example structure:

/sitemap.xml (index)
  ├─ /post-sitemap.xml
  ├─ /page-sitemap.xml
  └─ /category-sitemap.xml

Custom Sitemap URLs

If sitemap isn’t at default location:

1. Click Custom Sitemap URL
2. Enter full sitemap URL
3. Save and crawl

Troubleshooting

“Sitemap Not Found”

Solutions:

1. Verify sitemap exists: visit domain.com/sitemap.xml
2. Check robots.txt isn’t blocking sitemap
3. If using custom location, enter full URL
4. Generate sitemap using SEO plugin (Yoast, RankMath)

“Crawl Timeout”

Solutions:

1. Large sitemaps take longer (normal for 1000+ URLs)
2. Check site response time
3. Try crawling during off-peak hours
4. Split large sitemaps into smaller ones

“No URLs Found”

Solutions:

1. Verify sitemap has URLs listed
2. Check XML format is correct
3. Ensure WordPress is generating sitemap
4. Add URLs manually as fallback

“Connection Refused”

Solutions:

1. Check site is online and accessible
2. Verify no firewall blocking
3. Confirm WordPress REST API enabled
4. Test site connection in WordPress settings

Advanced Features

URL Filtering

Filter sitemap URLs by:

• Post type: Posts, pages, custom types
• Status: Active, broken, redirected
• Date range: Recently modified URLs
• Keyword: Find URLs by keyword

Bulk Operations

Select multiple URLs and:

• Delete selected
• Refresh metadata
• Export as CSV
• Update keywords

Export Options

Export sitemap data:

1. Click Export
2. Choose format (CSV, Excel, JSON)
3. Select columns to include
4. Download file

Use cases:

• Backup URL data
• Share with team
• Analyze in spreadsheet
• Import to other tools