Web Scraping

Things learned today:

• From minimaxir’s blog post:
  • Kimono Labs offers a nice option to make web scraping easier.
  • In the case of BuzzFeed, it was unusable because of a 10-page archive limit.
  • BeautifulSoup with Mechanize is a more flexible option. (Guide)