POST /1/crawlers/{id}/urls/crawl

Crawls the specified URLs, extracts records from them, and adds them to the index. If a crawl is currently running (the crawler's reindexing property is true), the records are added to a temporary index.

Servers

Path parameters

Name Type Required Description
id String Yes

Crawler ID.

Request headers

Name Type Required Description
Content-Type String Yes The media type of the request body.

Default value: "application/json"

Request body fields

Name Type Required Description
save Boolean No

Whether the specified URLs should be added to the extraURLs property of the crawler configuration. If unspecified, the URLs are added to the extraUrls field only if they haven't been indexed during the last reindex.

urls[] Array Yes

URLs to crawl.

How to start integrating

  1. Add HTTP Task to your workflow definition.
  2. Search for the API you want to integrate with and click on the name.
    • This loads the API reference documentation and prepares the Http request settings.
  3. Click Test request to test run your request to the API and see the API's response.