There’s A Map For That: Part Two

Can Foursquare/Swarm or other social media be viable in life logging and plotting on a map?

Overview

When Foursquare first appeared I was a very happy camper. The app allowed you to “check in” to locations and share with your friends where you were and where you’ve been. It was the perfect way to keep track of places in this digital landscape. Over time they added gamification features like points and badges based on where you’ve checked in. It encouraged a sense of adventure and discovery. For people who wanted to retain their privacy the app still allowed you to check in to locations to add to your digital map. For a time, they focused on features like seeing your history on a map and allowing you to export your checkins.

In 2014 Foursquare split the checkin functionality off to another app: Swarm. Foursquare was to focus on finding businesses, restaurants and providing reviews like Yelp.

Swarm since has consistently updated its app, but has focused on the game features rather than the digital life map. There are still ways to get your checkins out of Swarm to plot on a map, but they are a bit more complicated.
This post will outline the high level steps of what is needed to export and plot your data. It will assume the reader will have knowledge of CSV files, manipulating data within a spreadsheet, and access to Google Drive. 

Exporting Your Data From Foursquare/Swarm

Fortunately Foursquare still has a page to export your data, even though they’ve gone on record that they do not support this feature any longer.

By navigating here you can download a KML of your checkins, or a CSV. Each will allow you to plot on Google Maps, but what they do not retain is the latitude and longitude of the location, rather, they rely on geocoding1 to plot on a map. This is problematic as addresses can change. Additionally each of these export methods export every checkin which can get convoluted if you check in to locations multiple times. Checking in to the same location multiple times makes sense from a journalistic format, but if you want to plot places you’ve been to it can quickly over-clutter your map.

You’ll need to modify the URL of the export link in order to include all of your checkins. I suggest modifying it 9999. Example: https://feeds.foursquare.com/history/THISISANEXAMPLESOWHATCOMEATME.rss?count=9999

Optional parameters: You can specify a ‘?count=25’ to pull down a different number of checkins from your history. If you are requesting the ICS or Google Calendar formats your entire history is exported.

Foursquare Export Options
Foursquare Export Options

Cleaning Your Data From Foursquare

One other format that Foursquare allows you to export as is GeoRSS. GeoRSS is an older format2 but it does contain latitude and longitude information. If you export your data out of Foursquare this way, you can retain latitude and longitude, but you will still have all of your duplicate entries. From here you can go to this site and convert your GeoRSS format to a CSV file which will allow you to modify this data in your favorite spreadsheet application. (See example below)

Export Example. You may need to play with these settings a bit to ensure it exports the way you need it.
Export Example. You may need to play with these settings a bit to ensure it exports the way you need it.

Within your favorite spreadsheet application (mine is Google Spreadsheets), you can remove duplicates based on a certain column. Now you should have a list of unique location checkins that you can export in CSV, or XLSX.

Plotting Your Data

Google has another application in it’s Google Drive suite called Google Fusion Tables. Fusion Tables allows you to import large data sets and display them in some sort of relevant fashion. Within Fusion Tables you can import your newly created Foursquare export data, and then plot it on a map within Fusion Tables. Once imported you can create a map view.

Google Fusion Table Map Plot
Google Fusion Table Map Plot

If you were to leave your duplicate entries intact you can display heat map data to show how often you are in certain areas. Additionally you could choose to filter this data based on your checkin dates, and more.

Once you make your fusion table downloadable you can then finally export your information as a KML file for plotting in Google Earth, Google Maps, or your personal backup.

Summary

So the answer to “Can Foursquare/Swarm or other social media be viable in life logging and plotting on a map?” is: Yes, but damn is it complicated for something that should be simple. I am surprised Swarm isn’t tapping into this a bit more in addition to the gamification options.

Hopefully you’ve found this informational3. Other social media sites that allow you to check in or store additional location data like Flickr4 are a bit harder to work with. Maybe someday I’ll find a way to show you how to work with those. At least while Foursquare allows you to export your data this is still a viable method. I hope other apps will allow you to do stuff with what is and should be your own data.

Next time, I’ll show you what you can do with an old handheld GPS unit.


  1. Geocoding is the process of reverse engineering an address to a physical location like latitude and longitude. Fortunately this is possible now but constantly needs to be updated with government information. 
  2. “but it checks out.” 
  3. If you are one of the tens of people looking for this. 
  4. Flickr used to be one of the innovators and advocates of geotagged information. They automatically geotagged photos from your EXIF metadata and plotted them on a map. Unfortunately you haven’t been able to see all of your photos on one map in a long time. But I hope one day this will be possible directly from Flickr. 

There’s A Map For That: Part One

How To Make Your Own Digital Map

Fortunately there are several free tools out today that allow you to store your own created maps. The best by a large margin is Google, who has put an amazing amount of effort into their mapping business since 2005. Anyone who recalls the Mapquest days can attest to this.

Google offers a feature called My Maps. My Maps allows you to easily create your own maps with pins, or routes, or even areas. You’ll need a Google Account in order to use this.

Google My Maps
Google My Maps

From there it is pretty simple. You can search for addresses or businesses or if you know the exact latitude and longitude, that’s available as well.

You can choose from different map views such as street view or aerial imagery. You can put your pins into different sets, add hyperlinks, or other information. You can even select different markers.

Google Maps Interface
My Maps Interface

Google allows you to share maps privately or publicly. If you share them publicly you can embed them on a website. Like so:

Once you’ve saved your map, it’s saved in THE CLOUD (Google Drive). But if you want to take things a bit further, there are more options. You can export your map, print it, or save it to a PDF.

How to export your data.
Export your data.

The export feature allows you to save your map in a KML format, which stands for Keyhole[1] Markup Language. KML is based on XML, and has become a standard for displaying location-based information on a map along with GPX (which we’ll get to in Part Three). As of right now, KML is a fairly reliable way of storing your location data to import into other programs, such as Google Earth, where you have more options to manipulate your data.

Unfortunately Google doesn’t currently allow you to edit My Maps on iOS, but they can be viewed in the Google Maps app on iOS. This is unfortunate as you’re most likely going to have your phone on you when you want to record your location. Android users are a little more fortunate. You can, however, send yourself a link of where you are, and add it once you get to a computer. Hopefully they fix this in the future.

My incomplete map of places Ive been
My incomplete map of places I’ve been

 

There are other ways of recording your locations on your phone without ever touching a computer. My suggestions for this are:
* Day One: A journaling app for iOS and Mac OS that allows you to record your location and more.
* Gaia GPS: A more advanced GPS app for your phone that allows you to store maps on your phone without a cellular signal, and record hikes or runs and export them a number of ways.

Now with this general information you can start building your own digital map. In Part Two, I’ll go over some social media apps like Foursquare/Swarm and Flickr, and show you how you can use them to add to your lifelong digital map, which will be a bit more advanced with xml data types. So if you want to go more in depth, stay tuned.


  1. Before Google Earth was Google Earth, it was Keyhole. Surprisingly the founder and CEO of Keyhole is the founder and CEO of Niantic, the creators of the new popular app Pokémon Go.  ↩

Google Streetview Turns 1

Google Maps feature Streetview has turned one year old today.  To celebrate they added 37 new areas and expanded coverage for 15 areas.

  • MA: Springfield
  • NY: Buffalo, Rochester, Syracuse
  • NJ: Newark
  • VA: Virginia Beach
  • NC: Charlotte, Winston-Salem
  • SC: Columbia, Greenville
  • GA: Atlanta
  • FL: Boca Raton, Cape Coral, Ft. Lauderdale, Jacksonville, Sarasota, West Palm Beach
  • AL: Huntsville
  • MS: Jackson
  • TN: Knoxville
  • KY: Lexington, Louisville
  • OH: Cincinnati, Columbus, Dayton, Toledo
  • MI: Ann Arbor
  • MO: St. Louis
  • KS: Topeka
  • NE: Lincoln
  • OK: Oklahoma City, Tulsa
  • NV: Reno
  • CA: Bakersfield, Fresno, Sacramento, Stockton

The best part for me is they added several Ohio cities, including Columbus and its suburbs.

And as an added bonus they got a photo of my Dad’s ass…. just in time for Father’s Day. I don’t think their face blurring technology will fix that. He’s not going to be pleased when I show him.


View Larger Map

The coverage of Ohio is impressive.

You can read more about the update at the Google Lat Long Blog.