WebCrawlerPro
DevelopmentProfessional Web Crawling Extension
Overview
WebCrawlerPro is a professional Chrome extension for automated web content crawling with offline storage. The tool enables systematic website crawling with configurable depth, URL filters, and content types. Downloaded pages are stored locally and accessible without an internet connection. Data export to JSON, CSV, and HTML enables further analysis and processing. WebCrawlerPro is an open-source project, available on the Chrome Web Store. It has over 200 automated tests with full code coverage and complies with WCAG 2.0 AA accessibility guidelines.
Key Features
- Automated website crawling with live progress view and configurable depth
- Offline page storage — access downloaded content without internet
- Data export to JSON, CSV, and HTML for further analysis and processing
- Automatic attachment and related resource downloads
- Open-source — full code transparency, over 200 automated tests
- Multi-level crawling with URL filters, WCAG 2.0 AA compliant
Quick Info
- Status
- Development
- Available on Chrome Web Store
- Offline storage and browsing
- Export: JSON, CSV, HTML
- Automatic attachment downloads
- Open-source
- 200+ tests, WCAG 2.0 AA compliant
Why This Product?
Professional Web Crawling Extension
Chrome and Firefox
Extension available for the two most popular browsers — a consistent user experience regardless of platform.
Offline storage
Downloaded pages available without internet — ideal for archiving, analysis, and fieldwork without connectivity.
Data export
JSON, CSV, and HTML — export collected data in the format that fits your analysis and processing needs.
Configurable crawling
5 depth levels, URL filters, automatic attachment downloads. Precise control over what gets downloaded.
WCAG 2.0 AA accessibility
Extension compliant with accessibility guidelines — an interface usable by everyone, regardless of limitations.