> For the complete documentation index, see [llms.txt](https://docs.tutelar.io/tutelar-api-document/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.tutelar.io/tutelar-api-document/tutelar-api-document-v2/web-crawling.md).

# WEB CRAWLING

- [Initiate Crawl API](https://docs.tutelar.io/tutelar-api-document/tutelar-api-document-v2/web-crawling/initiate-crawl-api.md): The Crawling Initiating API lets users submit URL with customizable parameters to start a web crawler. This crawler navigates the URL, parses the content, and extracts data based on specific rules
- [Status Check API](https://docs.tutelar.io/tutelar-api-document/tutelar-api-document-v2/web-crawling/status-check-api.md): The Status Check API allows users to retrieve the status of a website's crawling process by querying with a caseId. It returns details like website name, crawl progress, status and other metrics
- [Crawled Results](https://docs.tutelar.io/tutelar-api-document/tutelar-api-document-v2/web-crawling/crawled-results.md): The Results API delivers the crawling outcome of a website in JSON format, using a unique caseId to provide insights into the URL's performance and content extracted
- [Crawled Download Pdf ](https://docs.tutelar.io/tutelar-api-document/tutelar-api-document-v2/web-crawling/crawled-download-pdf.md): The Results API delivers the crawling outcome of a website in JSON format, using a unique caseId to provide insights into the URL's performance and content extracted
- [List API](https://docs.tutelar.io/tutelar-api-document/tutelar-api-document-v2/web-crawling/list-api.md): The API lists crawling results for websites based on a client identifier, providing a summary of crawl status and completion percentage for each website associated with the client