Automatically crawl URL's | Feature requests

Automatically crawl URL's

Freek Vermolen

I would like to automatically crawl my URL's in the Web Crawler

Created by Milou Wolsing

Freek Vermolen

I think ones a day and mayve max 5 urls

Fleur Nouwens

Hey Freek Vermolen, thanks for your feedback! Following up on this:

What specific types of URLs do you want the crawler to target?
How frequently would you like the URLs to be crawled?
Are there any specific data points or information you want to extract from the crawled URLs?