bengaluru-food-census/parse_listing.rb

require 'nokogiri'
require 'csv'
require 'date'

restaurants = []

Dir.glob('html/restaurants-*.html') do |file|
  page = Nokogiri::HTML(open(file))
  page.css('.plr10').each do |div|
    puts div.css('a')[0]['href']
  end
end
Adds parser and CSV generator 2018-01-01 19:15:51 +00:00			`require 'nokogiri'`
Minor style changes 2018-01-14 20:31:40 +00:00			`require 'csv'`
write file to date 2018-03-30 08:20:03 +00:00			`require 'date'`
Adds parser and CSV generator 2018-01-01 19:15:51 +00:00
			`restaurants = []`

Now, although it takes 5GB to run this once, we get a more detailed CSV 2020-07-29 22:18:57 +00:00			`Dir.glob('html/restaurants-*.html') do \|file\|`
			`page = Nokogiri::HTML(open(file))`
			`page.css('.plr10').each do \|div\|`
			`puts div.css('a')[0]['href']`
Adds parser and CSV generator 2018-01-01 19:15:51 +00:00			`end`
			`end`