Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Camoufox Integration #326

Closed
Ehsan-U opened this issue Nov 9, 2024 · 3 comments
Closed

Camoufox Integration #326

Ehsan-U opened this issue Nov 9, 2024 · 3 comments
Labels
enhancement New feature or request

Comments

@Ehsan-U
Copy link

Ehsan-U commented Nov 9, 2024

scrapy-playwright is great but often lacks stealth against modern anti-bot measures. Thats the only reason folks go for undetected-chromedriver (Selenium).
Camoufox is fully compatible with playwright, only have to change browser initialization. It bypasses all currently available anti-bot measures. It would be a great opportunity to make scrapy-playwright stealthy.

@elacuesta
Copy link
Member

Interesting, thanks for the request. Unfortunately it's not quite simple to integrate given the current handler design, but I will look into it.

@elacuesta elacuesta added the enhancement New feature or request label Nov 11, 2024
@elacuesta
Copy link
Member

As a workaround, it's possible to launch a remote instance and connect to it using the PLAYWRIGHT_CONNECT_URL setting.

@Bookbinder209
Copy link

@Ehsan-U
I can't access the github for scrapy-camoufox. Would you be able to share any documentation or usage instructions? Also, is it necessary to integrate both scrapy-playwright and scrapy-camoufox for this to work effectively, or can one be used independently of the other?

@Ehsan-U Ehsan-U closed this as completed Feb 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants