Quattroshapes

View project onGitHub

The Global Polygon Gazetteer

Foursquare needs quality place data to power its geocoding engine to ensure the best recommendations. When someone searches for the best coffee in Brooklyn, a simple venue to place point or venue to place bounding box search can result in venues in Manhattan and Jersey City overwhelming the results for Brooklyn.

To improve recommendations, we have created an authoritative source of polygons around a curated list of places. This gazetteer of non-overlapping polygons provides more relevant results than simple point geometries.

View preview images ยป

This work is based on foursquare checkins, geo tagged photos from Flickr, an extended version of Natural Earth, and open government data. Concordance is provided between quattroshapes, geonames.org, and Yahoo! GeoPlanet unique IDs in the gazetteer.

The quattroshapes technique calculates the dominant place ID for a given area based on heterogeneous inputs. This work is an extension of alphashapes and betashapes (thanks Aaron and Schuyler!) and is used to backfill countries without complete open data.

Geocoding can be the hardest part about going open source - and reverse geocoding is even harder. Reverse geocoding reports the gazetteer place for a latitude and longitude map location or address string and is useful when source data needs to be normalized. This new polygon gazetteer data is used in TwoFishes, the coarse splitting geocoder (and reverse geocoder) written in scala from David Blackman at foursquare.

The quattroshapes code and resulting 30 gb of data are licensed under CC-BY, but includes data licensed from many governments around the world. Check the License file for full details and limitations.

Enjoy!


Downloads

Shapefiles are in WGS84 (geographic) projection and UTF-8 character encoding.

Note that these do not currently have geonames concordances baked in. We'll be posting matched files soon. In the meantime, you can use shputils to do the matching, following the instructions here: https://github.com/foursquare/twofishes#reverse-geocoding-and-polygons

Goodies

quatroshapes gazetteer:

Other

Preview

Administrative level 1 (below) States and provinces in orange; regions shown in red. Mix of national mapping agency and Natural Earth. Administrative level 2 (below) Counties in bright blue; regions shown in dark blue. National mapping agency data. Local administrative level (below) In green. This level of government assumes municipal type control over the central town and surrounding countryside. National mapping agency data. Localities (below) In yellow. In the USA this is the smallest unit of government with legal boundaries. For most other countries the localities here are informal parts of local administrative areas. Mix of national mapping agency, quattroshapes enumeration using foursquare checkins & custom data. Administrative level 0 (below) In gray. Mix of national mapping agency and US State Department data. Neighborhoods (below) In purple. Quattroshape enumeration from geo tagged photos in Flickr using GeoPlanet hierarchy. Gazetteer (below) In light purple. Over 1 million administrative and populated places with around 800,000 having concordance between GeoNames.org and Yahoo! GeoPlanet WOE unique IDs.