Increase your scraping speed with Go and Colly! — The Basics

Let’s scrape Amazon to see how fast this can be. But first, let’s learn about the basics.

Introduction

In this article, we’ll explore the power of Go(lang). We’ll see how to create a scraper able to get basic data about products on Amazon.
The goal of this scraper will be to fetch an Amazon result page, loop through the different articles, parse the data we need, go to the next page, write the results in a CSV file and… repeat.

In order to do this, we’ll use a library called Colly. Colly is a scraping framework written in Go. It’s lightweight but offers a lot of functionalities out of the box such as parallel scraping, proxy switcher, etc.

This article will cover the basics of the Colly framework. You can find the follow-up article here:

Increase your scraping speed with Go and Colly! — Advanced Part

Let’s inspect Amazon to determine the CSS selectors