Feb 26
3 min read
Designing a distributed web crawler part 2 — components and in-depth design
Let’s dive deep into the components of a web crawler
In part 1, we have established the fundamentals and requirements for designing a distributed web crawler. In this part, we are going to actually dive deep into the design.
