Make your life easier with this library of helper functions. — Introduction If you’re coming from languages like Javascript or Python, you could have some surprises programming in Go. You’ll quickly notice that all those functions such as filter, map or reduce are not part of this ecosystem. The fact that you don't have a built-in function to check if an element…

Let’s unleash the power of Go and Colly to see how we can scrape Amazon’s product list. Introduction This post is the follow up to my previous article. If you haven’t already done it, I’d recommend that you have a look at it so you can have a better understanding of…

Let’s scrape Amazon to see how fast this can be. But first, let’s learn about the basics. — Introduction In this article, we’ll explore the power of Go(lang). We’ll see how to create a scraper able to get basic data about products on Amazon. …

Let’s build a real-time scraper with Python, Flask, Requests, and Beautifulsoup! — Introduction In this article, I will show you how to build a real-time scraper step-by-step. Once the project is done, you’ll be able to pass arguments to the scraper and use it just like you would use a normal API. This article is similar to one in my previous article where…

You’ll be able to apply what you learn to any web application. — Introduction Here is the definition of Selenium given by their official website: Selenium automates browsers. That’s it. This is the most representative definition of what Selenium is. With this library, you’ll be able to control a web browser and interact with websites. …

Introduction Scrapy is a free and open-source web crawling framework written in Python. It allows you to send requests to websites and to parse the HTML code that you receive as response. With Scrapyrt (Scrapy realtime), you can create an HTTP server that can control Scrapy through HTTP requests. …