Nov 27, 2019Prioritizing issues with 👍s, ❤️s and 🎉sAnalyzing Github Issue Reactions using Node.js, Pipedream, Google Sheets, and pandas — At Pipedream, we use Github Issues to track feature requests, bugs, and new app integrations. Anytime a user has a new idea, we send them to the roadmap to make sure the idea gets captured. Anytime someone suggests an idea that’s already been captured, we send them to the roadmap…Github5 min read
Oct 29, 2019Airflow is overkillLast year, I taught a Data Analytics bootcamp at UC Berkeley Extension. In 6 months, students who’d never programmed before learned Excel, Python, pandas, JavaScript, D3, basic machine learning, and more. What would you guess was the toughest thing for most students to learn? Machine learning? JavaScript and D3? Deploying…Pipedream4 min read
Aug 21, 2019Processing webhooks with Node.jsIngest, transform and route HTTP requests with no server, and no cloud resources. Just Node. — At Pipedream, we process webhooks from every service that provides them. We usually write (Node) code to transform and act on these webhooks, but don’t want to run an HTTP server or serverless stack for each one. We developed Pipedream in part to solve this problem, so I’d like to…AWS11 min read
Aug 14, 2019Scrape a site with Node and Cheerio in 5 minutesWebsite scraping is a common problem with a common toolset. Two approaches dominate the web today: Automate a browser to navigate a site programmatically, using tools like Puppeteer or Selenium. Make an HTTP request to a website, retrieving data on the page using tools like Cheerio or BeautifulSoup. The first…AWS7 min read
Jun 20, 2019Airtable Webhooks with Slack + PipedreamWe love Airtable here at Pipedream. But Airtable lacks one killer feature — webhooks. We took advantage of Airtable’s Slack notifications and built a way to send webhooks to an HTTP endpoint every time a record is created or updated in a base. …Airtable7 min read
May 26, 2018Building your first Python command-line appBuilding your own Python app and deploying it to PyPi can seem daunting. It’s not! If you know Python and have a a little familiarity with the command line, you can get an app out the door in a day. I recently built a small tool to solve for a…Python4 min read
May 15, 201810 ways to spend less time in meetingsHave you ever been in a meeting that could have been an email? 🙋♀️🙋♂️ I’ve attended terrible meetings. I’ve led many of them. They could have been shorter. Half the people didn’t need to be there. And they probably didn’t need to be meetings at all. But I’ve also been…Meetings8 min read
May 8, 2018AWS RSS feeds: one-stop shop for AWS news and updatesFirst: if the letters “RSS” don’t mean anything to you, read this first. I use AWS a lot and like to keep track of a few key updates from the platform: New features Security bulletins Service health / incidents I didn’t have a good way to keep track of new…RSS2 min read
Published in Rate That Meeting·Apr 10, 2018Beware the hour-long meetingHave you ever been in an hour-long meeting that should have taken 15 minutes? Google Calendar is partly to blame (those of you on Outlook aren’t safe quite yet — read on). Google sets your default event length to 60 minutes. …Meetings3 min read
Jan 16, 20188 ways to crush your 2018 goalsThis year, I’ve set a goal to write more, so a post about goals seemed like a good way to start. It’s difficult to wish goals into happening. You’ve got to have a system for accomplishing them. …20184 min read
