Scrape a site with Node and Cheerio in 5 minutes

Dylan Sather
Aug 14 · 7 min read
Scraping 101: fetch sample HTML, extract some basic text from it

What is Pipedream?

A quick overview of Pipedream. Click on the GIF to learn more.

Step 1 — Use axios and Cheerio to scrape example.com

example.com

Running this code on Pipedream

Run this Node code on a schedule
Click Run Now, and you’ll see the logs show up once your job finishes
You can use cron expressions to schedule your job at any frequency

Step 2 — Send the results somewhere

Email yourself page content

Save results to Amazon S3

Add your bucket name in the Bucket field. You can modify the Prefix and Payload fields, too.
$event.html = $.html()

Learn more

Dylan Sather

Written by

Building https://pipedream.com . I love making programming simple for beginners and experts alike!

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade