ZenRowsinZenRowsHow to Change User Agent in Python RequestsLearn why the User Agent in Python Requests is getting your scraper blocked, how to change it, and the steps to randomize it at scale.Oct 17, 2023Oct 17, 2023
ZenRowsHow to Scrape a Website that Requires a Login with PythonLearn how to bypass security measures and scrape login-protected websites using Python.Oct 12, 20231Oct 12, 20231
ZenRowsHow to Read robots.txt for Web ScrapingFollow this guide to understand how to read robots.txt files and comply with the rules to avoid getting blocked while web scrapingOct 8, 20231Oct 8, 20231
ZenRowsSelenium comes with a default WebDriver that often fails to bypass scraping anti-bots.Supercharge your Selenium headless browser with Undetected ChromeDriver, a complementary tool to avoid getting blocked while web scraping.Sep 27, 2023Sep 27, 2023
ZenRowsHow to Use a Proxy with Python RequestsLearn how to use rotating proxies with Python Requests to avoid being blocked while web scraping.Sep 18, 2023Sep 18, 2023
ZenRows10 Best Residential Proxies for Web ScrapingDiscover the best residential proxies to ensure anonymous and ban-free web scrapingSep 16, 2023Sep 16, 2023
ZenRowsHow to Use a Proxy with Selenium in PythonScraping dynamic websites can be challenging, but Selenium makes it easy with its powerful automation features. However, there is still a…Sep 5, 2023Sep 5, 2023
ZenRowsHow to Avoid Detection with PuppeteerThese days, websites use anti-bot systems that can detect scrapers. The best way to ensure a seamless scraping process is using proper…Apr 28, 2023Apr 28, 2023
ZenRowsReact Crawling: How to Crawl JavaScript-Generated Web PagesBefore dynamic websites took over the web, crawling was relatively straightforward. Virtually all websites relied on client-side scripting…Apr 26, 2023Apr 26, 2023
ZenRowsPlaywright vs Puppeteer in 2023: Which Should You ChooseThe Playwright vs. Puppeteer debate is a big discussion since both are fantastic Node.js libraries for browser automation. Although they do…Apr 24, 2023Apr 24, 2023