nemo
/
bengaluru-food-census
1
0
Fork 0
Code Issues 1 Pull Requests Releases 4 Wiki Activity
Keep track of restaurant openings and closures in the city. https://twitter.com/BLRFoodCensus
You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
17 Commits
2 Branches
4 Tags
43 KiB
Ruby 85.5%
Shell 14.5%
 
 
master
ci
v0.0.1
v0.0.2
v0.0.3
v0.0.4
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'master'
${ noResults }
Go to file
Nemo 5921640da3 Now, although it takes 5GB to run this once, we get a more detailed CSV 3 years ago
.gitignore Move to data/ directory 5 years ago
Gemfile Removes unused gems 5 years ago
Gemfile.lock Upgrade bundler 3 years ago
README.md Adds stats script 4 years ago
bootstrap.sh Run parallel and only download missing files 3 years ago
parse_dir.rb Initial commit 5 years ago
parse_listing.rb Now, although it takes 5GB to run this once, we get a more detailed CSV 3 years ago
parse_restaurants.rb Now, although it takes 5GB to run this once, we get a more detailed CSV 3 years ago
stats.rb Adds stats script 4 years ago

README.md

bengaluru-food-census

Keep track of restaurant openings and closures in the city.

Quirks

  • Zomato does not support HTTP/1.1, so wget can't be used.

Tech

This project uses GNU Parallel, Ruby, Nokogiri, and curl.

Features

  • Keep track of historical data using regularly generated CSV files
  • Does not use the API (since the rate-limit is too low at 1k/day)
    • We need to checkout around 15k restaurant status (closed or not)
  • Keep track of whether restaurant is still alive or not
  • Tweet any restaurant closures (or any new openings)

For now, run the following command to get a diff of new restaurants not in the old listings:

q -d , "SELECT * from ./2018-MM-DD.csv WHERE c1 not in (SELECT c1 from 2018-MM-DD.csv)"