Week 6 - Web scraping and programming
Harvesting data from the web, writing functions, and iteration 🕸️
Spider web. Photo by Thomas Bishop on Unsplash
Tasks
- Watch the videos
- Complete the readings
- Complete the assignments
Videos
You can access the course videos on YouTube. You can also find a playlists for all course videos on YouTube here.
No. |
Title |
YouTube |
Slides |
Length |
|
|---|---|---|---|---|---|
| 01 | Web scraping | 14:25 | |||
| 02 | Scraping top 250 movies on IMDB | 24:15 | |||
| 03 | Web scraping considerations | 8:54 | |||
| 04 | Functions | 21:58 | |||
| 05 | Iteration | 13:54 |
Class Activities
Activity |
Title |
Date |
|---|---|---|
| Project | Proposal Review | Tue, 1 Mar |
| Lab 04 | UoE Art Collection | Thu, 3 Mar |
Assignments
Assignment |
Title |
Due |
|---|---|---|
| Due this week | ||
| Project | Proposal, take 2 (Graded) | Sat, 5 Mar, 23:59 EST |
| Q 05 | Scrape + iterate | Sun, 6 Mar, 23:59 EST |
| Due next week | ||
| Lab 04 | UoE Art Collection | Wed, 9 Mar, 23:59 EST |
| HW 05 | Legos | Sat, 12 Mar, 23:59 EST |
| Q 06 | Review | Sun, 13 Mar, 23:59 EST |
Readings
| 📄 | Selector Gadget | Required |
| 🧰 | Selector Gadget Chrome Extension | Required |
| 📖 | R4DS: Chp 19, Functions | Required |
| 📖 | R4DS: Chp 21, Iteration - Only the following sections: 21.1, 21.2, 21.5.1, and 21.5.2 | Optional |
| 📖 | Wizard Zines: Heck Yes, CSS! and other zines | Optional |
Code-along
The data come from TidyTuesday. TidyTuesday is a weekly social data project for the R community. Read more about TidyTuesday here.
You can find starter code for this session on RStudio Cloud, in the project titled Code Along 02 - College tuition, diversity, and pay.
Interactive R tutorials
The following are interactive R tutorials, designed to give you more practice with R. These are optional, but they will show up in your next homework assignment, so you should gain familiarity with it. If you’re struggling with any of the topics covered this week, we strongly recommend you work through the interactive tutorials.
| Money in US Politics | Related to HW 06 |
| Write functions (Function basics, How to write a function, and Arguments) | Optional |
| Iterate (Introduction to iteration, Map, and Map shortcuts) | Optional |
