Holistic Smart Map (Outline for final project)

Sanghyun Son
Data Mining the City
3 min readNov 23, 2017

background

a. social network changed our lives

social data: twitter, yelp, facebook, etc. + urban data: 311 complaint data, pluto data, environment data, property tax data, etc.

b. important factors making up neighborhood quality

spatial analysis: visibility, sky exposure, open space, daylighting, etc.

approaches:

holistic map:

data (quantitative) + spatial (qualitative) analysis

after that, creates new type of map for finding optimal path.

process 01: datamining & cleaning

a1: Yelp dataset

datamining (json) through yelp API, in postman (Oauth2.0 protocol)

cleaning data in excel 2016

a2: Twitter dataset

datamining (json file) through twitter API, in spyder (python and tweepy)

cleaning data in excel 2016

a3: pluto dataset from NYC planning

a4 : 311 noise complaint data from NYC

also, working on other dataset (trees, parks, landmarks, etc.)

process 02: mapping & visualization

  • yelp rating: 4.5~5.0 restaurant mapping (heatmap type)
  • twitter messages & event density: mapping (heatmap type)
  • 311 noise complaint density: mapping (heatmap type)
  • pluto data, building density: mapping (3D)
  • shortest walk distance: spatial analysis & visualization

working on other mapping & visualization

also, working on concept narrative / background / specific target-user / final formula / research on the concept of controlling google’s path algorithm / final conclusion

--

--