Automatical crawling of URL's in Web Crawler | Voters

Automatical crawling of URL's in Web Crawler

Umber brown Ptarmigan

I would like to automatically crawl my URL's in the Web Crawler every X time, instead of having to manually select 'Crawl' to recrawl my URL's

Created by Milou Wolsing

Umber brown Ptarmigan

I think ones a day and mayve max 5 urls

Fleur Nouwens

Hey Umber brown Ptarmigan, thanks for your feedback! Following up on this:

What specific types of URLs do you want the crawler to target?
How frequently would you like the URLs to be crawled?
Are there any specific data points or information you want to extract from the crawled URLs?