During a security test, Beagle Security crawls your application to discover pages, endpoints, and other accessible URLs. These discovered URLs help define the application’s attack surface and form the foundation for security testing.

You can view and download the list of crawled URLs for a completed test at any time.

Understanding crawled URLs

Crawled URLs are the web pages and endpoints identified during the crawling phase of a security test.

The crawling process helps map your application’s structure and discover:

• Publicly accessible pages

• Application endpoints

• Dynamic URLs

• Hidden or less obvious URLs

• Additional areas that may require security testing

These URLs help Beagle Security build a comprehensive view of the application’s attack surface and identify potential vulnerabilities across different parts of the application.

Access the crawled URLs

• Go to Applications.

• Select the application you want to review.

• Open the Results tab.

• Click Show result.

• Click the Crawled URLs icon

This will open the crawled URLs window.

Download the crawled URLs list

The crawled URLs window displays the file generated during the crawl.

To download the file:

• Click Download next to the crawled URLs file.

• Save the file to your local system.

The downloaded file contains the URLs discovered during the crawling process and can be used for review, auditing, troubleshooting, or validation purposes.

Updated on: 30/06/2026