headless-chrome

Rendertron should be configured with an allow-list and behind a reverse proxy, rather than exposed to the open internet.

This should be reflected in the readme as well as the documentation.

Real User-Agent is detectable with <iframe> when using "puppeteer-extra-plugin-stealth". To prevent it use "'--disable-features=site-per-process'" argument for puppeteer.launch(). See explanation: puppeteer/puppeteer#2548

Real screen size is also detectable with iframe, to prevent it I used preload() script.

OS: Windows 10
"puppeteer": 3.0.4
"puppeteer-extra": 3.1

Main examples at Apify SDK webpage, Github repo and CLI templates should demonstrate how to manipulate with DOM and retrieve data from it.

Also add one example of scraping with Apify SDK + jQuery to https://sdk.apify.com/docs/examples/basiccrawler

Feedback from: https://medium.com/better-programming/do-i-need-python-scrapy-to-build-a-web-scraper-7cc7cac2081d

I lost an hour trying to make

Sometimes we have weird issues due to the different environments of our users: #114 #84 #65

Debugging those environments is a real pain. What we could do is provide an official Docker image for PuPHPeteer (in a new repository). There are already some unofficial images but by providing our own image we would ensure to have better control on the fi