Puppeteer Scraper
Pricing
Pay per usage
Go to Apify Store
Puppeteer Scraper
0.0 (0)
Pricing
Pay per usage
1
1
1
Last modified
7 years ago
Pricing
Pay per usage
0.0 (0)
Pricing
Pay per usage
1
1
1
Last modified
7 years ago
useRequestQueuebooleanOptional
Request queue enables recursive crawling and the use of Pseudo-URLs and Link selector.
Default value of this property is true
pseudoUrlsarrayOptional
Pseudo-URLs to match links in the page that you want to enqueue. Combine with Link selector to tell the crawler where to find links.
Default value of this property is []
linkSelectorstringOptional
CSS selector matching elements with 'href' attributes that should be enqueued. To enqueue urls from '<div class="my-class" href=...>' tags, you would enter 'div.my-class'.
proxyConfigurationobjectOptional
Choose to use no proxy, Apify Proxy, or provide custom proxy URLs.
Default value of this property is {}
debugLogbooleanOptional
Debug messages will be included in the log. Use context.log.debug('message') to log your own debug messages.
Default value of this property is false
browserLogbooleanOptional
Console messages from the Browser will be included in the log. This may result in the log being flooded by error messages, warnings and other messages of little value, especially with high concurrency.
Default value of this property is false
downloadMediabooleanOptional
Crawler will skip downloading media such as images, fonts, videos and sounds. This helps to speed up the crawl, but may break certain websites.
Default value of this property is false
downloadCssbooleanOptional
Crawler will skip downloading CSS stylesheets. This helps to speed up the crawl, but may break certain websites.
Default value of this property is false
ignoreSslErrorsbooleanOptional
Crawler will ignore SSL certificate errors.
Default value of this property is false
maxRequestRetriesintegerOptional
Maximum number of times the request for the page will be retried in case of an error. Setting it to 0 means that the request will be attempted once and will not be retried if it fails.
Default value of this property is 3
maxPagesPerCrawlintegerOptional
Maximum number of pages that the crawler will open. 0 means unlimited.
Default value of this property is 0
maxResultsPerCrawlintegerOptional
Maximum number of results that will be saved to dataset. The crawler will terminate afterwards. 0 means unlimited.
Default value of this property is 0
maxCrawlingDepthintegerOptional
Defines how many links away from the StartURLs will the crawler descend. 0 means unlimited.
Default value of this property is 0
maxConcurrencyintegerOptional
Defines how many pages can be processed by the scraper in parallel. The scraper automatically increases and decreases concurrency based on available system resources. Use this option to set a hard limit.
Default value of this property is 50
pageLoadTimeoutSecsintegerOptional
Maximum time the crawler will allow a web page to load in seconds.
Default value of this property is 60
pageFunctionTimeoutSecsintegerOptional
Maximum time the crawler will wait for the page function to execute in seconds.
Default value of this property is 60
customDataobjectOptional
This object will be available on pageFunction's context as customData.
Default value of this property is {}
