{"id":2287,"date":"2010-12-04T16:38:38","date_gmt":"2010-12-05T00:38:38","guid":{"rendered":"http:\/\/www.chesnok.com\/daily\/?p=2287"},"modified":"2010-12-04T21:41:57","modified_gmt":"2010-12-05T05:41:57","slug":"open-data-hackathon-day-oregon-business-license-registry","status":"publish","type":"post","link":"https:\/\/www.chesnok.com\/daily\/2010\/12\/04\/open-data-hackathon-day-oregon-business-license-registry\/","title":{"rendered":"Open Data Hackathon Day: Oregon Business License Registry"},"content":{"rendered":"

\"\"<\/a><\/p>\n

At the Portland Software Summit on Thursday<\/a>, a couple people mentioned that it was hard to keep track of new businesses that pop up, and that merger and acquisition activity wasn’t being sufficiently publicised. <\/p>\n

I thought – maybe we could get this information in an automated way!<\/p>\n

I started with the state of Oregon’s business registry search site<\/a>. Unfortunately, they limit search results for business searches to 1000, and they don’t paginate their results. So, we kicked ScraperWiki into gear, and wrote a very simple scraper with @maxogden<\/a>: http:\/\/scraperwiki.com\/scrapers\/oregon_business_registry\/<\/a><\/p>\n

Next, I wanted to find out information about businesses specifically in Portland. The City releases information about this, but in PDF form: http:\/\/www.portlandonline.com\/omf\/index.cfm?c=32192<\/a><\/p>\n

I wrote a quick and dirty Python script to scrape out information, and am getting probably 250 of the 300+ businesses in the November release. Next, I want to cross reference this data with what’s in the Oregon site. I’ll be publishing the Python scripts over the weekend. Hopefully ScraperWiki will add pyPDF to their Python repo support and I will be able to publish the transform there so it can be easily linked to the Oregon data.<\/p>\n

Two lessons today: <\/p>\n