# Web Crawler

Use the Endtest Web Crawler to discover every page on a site, detect broken links, and feed URLs into automated checks at scale.

Part of the Endtest documentation (Web Tests). Canonical URL: https://endtest.io/docs/web-tests/web-crawler

---
## Introduction
    
The `Start Web Crawler` action allows you to check all the pages of your web application.
    
## Solution
    
All you have to do is provide a URL, and our Web Crawler will access it, automatically fetch all the hyperlinks, visit each one, and retrieve the page load time and a screenshot for each.
    
If something goes wrong and a page doesn't load, you'll see the error and the details in the **Results** for that test execution.
    
![endtest web crawler](https://app.endtest.io/images/web_crawler_2.png)
    

> **Info:** The number of hyperlinks that our Web Crawler will visit is limited by default. If you want to remove that limit for your account, please send us a message.