Perks

Beginner Friendly!

• Prerequisite: Python

• You're taught everything!

• Time Commitment is determined by you, the member

• Freedom to explore: Build a database, build more web scrapers, work with APIs

Weekly Educational Guides & Demos

Technical Knowledge

• Python

• Web Scraping

• Developer Tools

• Headless Browsers

• Browser Automation

• SQLite

• APIs

Timeline

Week 1: Static Scrapers

Content:

• Intro to Web Scraping (Ethics & Motivation)
• HTML and CSS
• Static Webpages

Tech Stack: Python, Requests, BeautifulSoup

Difficulties: New Information, CSS Selectors

Resources: Remote Work Demo, Week 1 Overview

Teams: Inexperienced members can pair up to build webpage scraper. Rest can work individually.

Week 2: Dynamic Scrapers

Content:

• Dynamic Webpages
• Javascript
• Headless Chrome
• Selenium

Tech Stack: Selenium, Headless Chrome

Difficulties: Debugging, Installation, Sensitive Info

Resources: BearFounders Demo, Week 2 Overview

Teams: Inexperienced/Less motivated members can pair up to build webpage scraper. Rest can work individually.

Team: Split between those debugging their static web scrapers and those who want to move on.

Week 3: APIs

Content:

• Web Scraping vs APIs
• Airtable API

Tech Stack: Airtable API

Difficulties: Debugging, Splitting teams

Resources: Airtable Demo

Team: Split between those who want to work on database management (1-3 members) and APIs (1-2 members).

Week 4: Database Management (if there's time)

Content:

• SQLite3
• Database Management
• Pandas

Tech Stack: SQLite3, Pandas

Difficulties: Debugging, Installation

Resources: SQL Demo, Week 3 Overview

Team: Split between those who want to work between web scrapers and database management (1-3 members).