How to create an automated scraper with BrowseAI and Airtable

In today’s lesson you’re going to combine your scraping and automation skills using Browse AI and Airtable.

How to create an automated scraper with BrowseAI and Airtable
Do not index
Do not index
Hello there!! 👋
In today’s lesson you’re going to combine your scraping and automation skills using Browse AI and Airtable.
Time to build 👨‍💻

Shot of Inspiration ☕

"The illiterate of the 21st century will not be those who cannot read and write, but those who cannot learn, unlearn, and relearn.” -Alvin Toffler

Context Building 🏔

🧱 Project: Build an Automated Content Scraper
⏲️ Estimated time: 30 minutes
🛠️ Tools: Browse AI, Airtable
Imagine you’re a newsletter creator, and you spend lots of time checking multiple resources to curate the best resources for your audience.
Let’s say you have a newsletter featuring the top tech stories from all the major tech outlets. Every day you check 20 tech websites to curate the top stories each day.
With an automated content scraper you can skip the manual part of this research. You can build a content scraper without code that will collect all the information that you usually review manually.
Today you’ll do just this! You’ll use your familiar friend Browse AI to scrape content each day and then send this information to Airtable.
By the end of the lesson, you will be able to:
  • Set up an automated content scraper of top articles
  • Set up daily scraping in Browse AI
  • Send scraped data to Airtable

Let's Prep 🥗

So far you’ve scraped data and you’ve created automations. Today, you’re going to take this up a level by repeating this process automatically each day using Browse AI’s ‘Monitor’ feature. This feature allows you to repeat the automation of a task at your own set time and frequency.
In today’s lesson example, you’ll pretend that you’re a newsletter creator, and you want to scrape tech websites for their top stories each day as you curate these for your newsletter.
You’ll just use one website example today (The Verge) so that you can get a feel for how the process works.
🔥 Get ready to build!
To make your life easier when you build, it’s good to get some practical stuff out the way first. Follow these steps so you’re ready to build:
  • Sign up for an account with Browse AI and add their Chrome extension
  • Sign up for an account with Airtable and log in to your dashboard

Time to Cook 👩‍🍳

  1. Open Browse AI and Airtable in separate browser tabs.
  1. Follow this step-by-step guide to complete today’s lesson.
 
That’s a wrap, we hope you found this lesson helpful!
  • If you have any questions, feel free to reach out.

The easiest way to learn practical tech skills in 100 days.

Join other 40,231+ learners now!

Subscribe

Written by

Max Haining
Max Haining

Founder of 100School.com