ZenRowsinZenRowsHow to Change User Agent in Python RequestsLearn why the User Agent in Python Requests is getting your scraper blocked, how to change it, and the steps to randomize it at scale.8 min read·Oct 17, 2023----
ZenRowsHow to Scrape a Website that Requires a Login with PythonLearn how to bypass security measures and scrape login-protected websites using Python.11 min read·Oct 12, 2023----
ZenRowsHow to Read robots.txt for Web ScrapingFollow this guide to understand how to read robots.txt files and comply with the rules to avoid getting blocked while web scraping4 min read·Oct 8, 2023--1--1
ZenRowsSelenium comes with a default WebDriver that often fails to bypass scraping anti-bots.Supercharge your Selenium headless browser with Undetected ChromeDriver, a complementary tool to avoid getting blocked while web scraping.7 min read·Sep 27, 2023----
ZenRowsHow to Use a Proxy with Python RequestsLearn how to use rotating proxies with Python Requests to avoid being blocked while web scraping.8 min read·Sep 18, 2023----
ZenRows10 Best Residential Proxies for Web ScrapingDiscover the best residential proxies to ensure anonymous and ban-free web scraping9 min read·Sep 16, 2023----
ZenRowsHow to Use a Proxy with Selenium in PythonScraping dynamic websites can be challenging, but Selenium makes it easy with its powerful automation features. However, there is still a…8 min read·Sep 5, 2023----
ZenRowsHow to Avoid Detection with PuppeteerThese days, websites use anti-bot systems that can detect scrapers. The best way to ensure a seamless scraping process is using proper…9 min read·Apr 28, 2023----
ZenRowsReact Crawling: How to Crawl JavaScript-Generated Web PagesBefore dynamic websites took over the web, crawling was relatively straightforward. Virtually all websites relied on client-side scripting…8 min read·Apr 26, 2023----
ZenRowsPlaywright vs Puppeteer in 2023: Which Should You ChooseThe Playwright vs. Puppeteer debate is a big discussion since both are fantastic Node.js libraries for browser automation. Although they do…10 min read·Apr 24, 2023----