Initiate Crawl API
The Crawling Initiating API lets users submit URL with customizable parameters to start a web crawler. This crawler navigates the URL, parses the content, and extracts data based on specific rules
Initiate crawl
POST
https://secctrl.tutelar.io/api/v1/web-crawling/website-crawl
{ "message": "Invalid authentication credentials" }
Post parameters description is given below,
Post Parameter | Type | Is Mandotory | Description |
---|---|---|---|
website | String | Yes | For Crawling The Website, Need To Give Absolute URL of The Website |
level | String | Yes | Mention The Level Of Crawling Like Basic/Advance |
merchant* | Object | Yes (trade_name only Mandatory) | For Idintify The Merchant Details & Merchant Business Details |
Sample post parameters
Success Response
Failure Response
Last updated