nemo
/
bengaluru-food-census
1
0
Fork 0
Code Issues 1 Pull Requests Releases 4 Wiki Activity
Keep track of restaurant openings and closures in the city. https://twitter.com/BLRFoodCensus
17 Commits
2 Branches
4 Tags
43 KiB
Ruby 85.5%
Shell 14.5%
 
 
Go to file
Nemo 5921640da3 Now, although it takes 5GB to run this once, we get a more detailed CSV 2020-07-30 03:48:57 +05:30
.gitignore Move to data/ directory 2018-04-08 23:01:29 +05:30
Gemfile Removes unused gems 2018-01-02 07:04:08 +05:30
Gemfile.lock Upgrade bundler 2020-07-29 22:36:33 +05:30
README.md Adds stats script 2018-12-25 19:58:04 +05:30
bootstrap.sh Run parallel and only download missing files 2020-07-29 22:46:39 +05:30
parse_dir.rb Initial commit 2018-01-02 00:19:07 +05:30
parse_listing.rb Now, although it takes 5GB to run this once, we get a more detailed CSV 2020-07-30 03:48:57 +05:30
parse_restaurants.rb Now, although it takes 5GB to run this once, we get a more detailed CSV 2020-07-30 03:48:57 +05:30
stats.rb Adds stats script 2018-12-25 19:58:04 +05:30

README.md

bengaluru-food-census

Keep track of restaurant openings and closures in the city.

Quirks

  • Zomato does not support HTTP/1.1, so wget can't be used.

Tech

This project uses GNU Parallel, Ruby, Nokogiri, and curl.

Features

  • Keep track of historical data using regularly generated CSV files
  • Does not use the API (since the rate-limit is too low at 1k/day)
    • We need to checkout around 15k restaurant status (closed or not)
  • Keep track of whether restaurant is still alive or not
  • Tweet any restaurant closures (or any new openings)

For now, run the following command to get a diff of new restaurants not in the old listings:

q -d , "SELECT * from ./2018-MM-DD.csv WHERE c1 not in (SELECT c1 from 2018-MM-DD.csv)"