Client & Targets
Select a client and choose which domains to crawl
or enter URL manually
Include in Crawl
Toggle which domains to crawl
Crawl Configuration
Settings apply to all selected websites
Activity Log
No activity yet
Existing SF Data
Browse crawl data stored in Supabase
Select a client to browse existing data
Crawl History
All past crawls for the selected client — client, competitor, daily, manual, and uploaded
Select a client to see crawl history
Scheduled Crawls
Nightly full crawl (master-deep) · Starts 2 AM CT · 10 min gap between clients
Loading clients...