Subject
3 entries
Data Collection
Bookmarks
Web Scraping Open Project
A GitHub repository collecting open knowledge about web scraping in Python — covering tools, techniques, anti-scraping countermeasures, and best practices. Community-built reference for practitioners building data collection pipelines.
Announcing Portia — Open Source Visual Web Scraper
Scrapinghub's Portia is an open-source visual web scraper — a point-and-click interface on top of Scrapy that lets you build scrapers without writing code. It made web scraping accessible to non-programmers while keeping Scrapy's power underneath.
Data Hacking and Coffee
A coffee tasting experiment turned into a data project: 80 samples, 4 bean varieties, 3 brewing methods, TF-IDF scoring of flavor descriptors, and a Meteor/MongoDB web app for collection. A clever example of applying text analysis methods to sensory rating data.