HomeОбразованиеRelated VideosMore From: DevTips

Recursion ➰ for Paginated Web Scraping

232 ratings | 6397 views
Sponsored by: Brilliant, thanks! Be one of the first 200 people to sign up with this link and get 20% off your annual subscription with Brilliant.org! https://brilliant.org/DevTips/ We figure out how to deal with the paginated search results in our web scrape. RECURSION is our tool - not as difficult as you might think!! 🗿 MILESTONES ⏯ 00:12 Fika 🍪 ⏯ 13:10 Extracting the next page number with regex ⏯ 16:50 Encounter with prettier... 🌋 ⏯ 18:39 ➰ Recap ⏯ 20:15 TIME FOR RECURSION 😎 ⏯ 29:00 Quick Google rant 🌋 ⏯ 29:23 ➰➰ Rerecap by Commenting the Code See the previous episode where we explain Puppeteer and finding the data to scrape ▶️ https://www.youtube.com/watch?v=pixfH6yyqZk The code used in this video is on GitHub 🗒 https://github.com/chhib/scraper/tree/5d00bb08c6ec4ea8cbaec7ea78fb90a10a864f8b Puppeteer - Headless Chrome browser for scraping (instead of Phantom JS) 🔪 https://github.com/GoogleChrome/puppeteer The editor is called Visual Studio Code and is free. Look for the Live Share extension to share your environment with friends. 💻 https://code.visualstudio.com/ DevTips is a weekly show for YOU who want to be inspired 👍 and learn 🖖 about programming. Hosted by David and MPJ - two notorious bug generators 💖 and teachers 🤗. Exploring code together and learning programming along the way - yay! DevTips has a sister channel called Fun Fun Function, check it out! ❤️ https://www.youtube.com/funfunfunction #recursion #webscraping #nodejs
Html code for embedding videos on your blog
Text Comments (57)

Would you like to comment?

Join YouTube for a free account, or sign in if you are already a member.