running data

Tired runner

Running Data: Damn Nike – Part 2

In Part 1 of this series I gave a “brief” outline of my journey through running and how I ended up using particular training tools and apps. The purpose of this post is to highlight an issue that is important to me, but echoed by a startling minority. The scary part is that it basically affects anyone who uses a device to track fitness, activity or workout data – and yet the number of people table-flipping, making a fuss or even aware of the issue, is depressingly low.

I am talking about data access (or ownership). The Fitbit on your wrist, the GPS watch you’re using for your runs or even your smartphone, are all recording data that you generate and send to companies who analyse the data and give you interesting insights on your activities. They can tell you how much REM sleep you get at night, give you an overview of how active you were during the day, or summarise how well you did on a training run (by providing information on splits, pace, cadence and/or heart rate).

Werable devices on wrist

Wear all the wearables! Source.

In the rapidly growing industry of wearable technology, companies are trying to add as many analytics and features to their devices as they can. Unsurprisingly, their shotgun approach can still not provide the specific insights you’re after. But it’s ok, you can just dive through the data yourself and easily pull out the metrics you need or are interested in, right? NOPE. What, not even simple data you could look at using the built-in functions of Excel? HELL NOPE.

And this is the problem. The data is there. You’ve created it – it’s a quantification of you and it’s just sitting there. Sometimes, you can jump through certain hoops to get it, and other times you have to drag yourself over a mile of broken glass… using only your face.

Man screaming in frustration

The frustration (or pain) is real. Source.

The problem can be split into two interacting parts:

  1. Current apps don’t provide analytics or metrics that are of interest to you, or if they do they charge you for it (these can vary from really basic information to advanced analyses).
  2. These apps make it difficult or impossible to export your data.

The first part wouldn’t be so bad if not for the second. The only reason I can think of for companies to make it difficult to take data out is to force platform (and brand) loyalty. This is complete and utter bullshit. If a company’s product is good enough to solve any issues I would have with problem #1 then I wouldn’t even want to extract my data. Basically, the company is aware their product is below-par and the only way they can keep people using it is to lock them in. That is not sustainable.

I’m going to talk about the running apps I am familiar with and you should be able to get an idea of the scale of offending that is out there.

Runkeeper

Runkeeper is actually the best out of the three when it comes to exporting training data. Reason being – they actually let you. You can export all your data within a custom period to a .zip of GPX files (these contain GPS data) which can be easily imported into other platforms. Fantastic! The metrics and analyses Runkeeper provides are quite basic. Individual workout data is fine – but if you want to look at how you’ve gone over time (to see how training is going) the only thing you can look at is distance. Duration, speed, pace, heart rate, or elevation? Bah, who needs that info? Unless you want to pay for it (30 USD a year)! No thank you, but I am grateful they made it easy to get all my data out (‘Export Data’ is in the ‘Settings’ menu), and do not contribute to problem #2.

Runkeeper logo

You’re doing good Runkeeper. Not fantastically… but good.

Endomondo

Similar to Runkeeper, Endomondo requires a subscription (29.99 USD a year) for you to see any type of data that includes more than one workout. However, they also contribute to problem #2, by limiting data exporting to one workout at a time (manually). I have 152 workouts on Endomondo so uh… if it takes me about 2 min to download one workout (navigating to the workout and saving it)… that’d take me… five freakin’ hours. That’s the thanks I get for subscribing for a year.

See, most people wouldn’t bother trying to get there data out so in a way their strategy of locking people to their platform must be working to some extent. However, as soon as I found out I had to continue my subscription to see detailed analytics, I was ready to jump ship.

Fortunately in the case of Endomondo, there is an easy solution. Endomondo Export is a handy tool that allows you to bulk export your data with an easy-to-use interface. I did have some problems with missing elevation data in the GPX file outputs, and wrote a Python script to help clean these. I suspect the data was bad because of my phone (Galaxy SII), but if anyone else tries to use the export tool and has problems let me know, and I’ll see if my script can help you out too. If you are a bit more technically inclined, there is also this Python script but I cannot verify its effectiveness.

Bear in mind that Endomondo can change access to their API at any time which could make either of these tools defunct. I would suggest you create backups now, while you still can – otherwise you may find yourself in the same situation as I did with the final app…

Apparently this hand gesture indicates "meh".

Apparently this hand gesture indicates “meh”.

Nike

I use a Nike+ GPS Sportswatch and I love it. However, for a 100 billion dollar company whose market ranges from suburban mums to the world’s most elite athletes, the design of their website and app is absolutely terrible. For the few years I’ve been using it, there have been no significant improvements in the user interface design or functionality of the website, which in this fast-paced world is totally crap. I’ve had problems logging in, maintaining sessions, viewing activity data, and browsing friends’ data. Admittedly, it’s all free – but that is not a valid excuse. Individual workout metrics are fine and over time metrics include things such as average distance and pace changes. Still not as in-depth as it could be, but sufficient for most people.

That being said, my recommendation is to stay away from Nike+ and its Running app. This is the absolute worst example of a company trying to lock you into their platform. You absolutely CANNOT export any data – not even individual workout data. Previously, you could use third party tools similar to Endomondo Export that would allow you to bulk export workouts from Nike. However, Nike have recently shut off access to their APIs except for official “Fuel Lab Partners” or whatever they’re calling them. Basically, other companies that Nike are working with because despite their wealth and resources, they can’t build a decent app on their own.

The closing off of their API has meant that the third party tools I used no longer work, and the developers of those apps have retired them or stopped updating them to keep up with Nike’s changes. I have figured out a way to still get my data out and export it to my platform of choice (RunningAhead: I can’t say enough about how good it is, even if just to park data). At the moment, the process is a little convoluted, but I am interested to know whether there are people who do want to get data out from Nike. If there are, I will try turn it into a web solution – or at the very least, post how to do it and wait to see how long it takes Nike to do something to prevent or block it.

In the meantime, I’m syncing my data to RunningAhead and saving up as fast as I can for a new running watch.

Ironically, the Nike tick showed up when I image searched "good". Fortunately, I was able to find enough fingers to give it.

Ironically, the Nike tick showed up when I image searched “good”. Fortunately, I was able to find enough fingers to give it.

 

Running Data: Why Is it an Uphill Battle? – Part 1

I originally started writing this post in October 2015. Life has been quite hectic since then, so I didn’t quite get around to publishing it. Recent events have caused me to revisit it, and I think some of it may still be interesting for people to read. I will be following this post up with an up-to-date rant and a couple of other running-related posts.

I have the attention span of a gnat, and as a result I am abysmal or at best mediocre at most of my pursuits. However, two anomalies to this trend are running (inexplicably) and data analysis (pretty much my job while working at Uni).

I picked up running about 5 years ago and when I first started I neither followed a training plan nor logged my workouts. However, after a few years I was becoming more and more addicted to the endorphins and began to get more serious. On the recommendation of a friend, I started using Runkeeper with my phone to track runs. At the time, its popularity stemmed from its integration with Facebook, which made it really easy to find friends and quietly judge them for not running enough.

Image of a Woman Being Judged

What silly clothes to run in too. Source

My training plans up to 2013 had always been pretty much, “run lots”, and I was getting faster mostly because I was building the muscles used in running, which up to this point I’d never really developed. Another friend recommended Endomondo to me, and I was intrigued by its offering of a dynamic, “smart”, training plan. I paid for the premium service and had a plan that gave me pacing indication, distances and structure to my training runs. It would also adapt my workouts if it found I was maintaining faster/slower paces to what it recommended.

As smartphones counter-intuitively increased in size, I could no longer tolerate running with mine (a Samsung Galaxy SII) and switched to a Nike GPS watch for tracking my runs. I’m really happy with the change and if you’re serious, I highly recommend investing in a decent watch. It beats lop-siding your gait by strapping a brick to your arm or the struggle of fitting it into a waist belt. The workout data from my watch is manually synced to Nike+, a platform that stores activity data from all of Nike’s devices and Running app (which gives the same experience as the watch but uses a phone’s in-built GPS).

I continued using the Endomondo training plan with the Nike+ watch, and herein began my initial foray into the war of fitness data platforms. It seems to be that most platforms, in addition to the ones I’ve used, such as Strava and MapMyRun, try and force user loyalty by making it either impossible or incredible difficult to move data around platforms. This meant that the data from my Nike watch could not be easily taken out and uploaded into Endomondo to contribute to my training program tracking.

In fact, Nike+ has no option to export any data. I was enraged, because it’s my data! It appears that many others shared my feelings and as such, have made tools* to export the data through the Nike+ API (which is primarily made available to Nike partners). Using these tools, I was able to keep my training plan up to date.

Image of locked folder

I wish this was how my run data was locked… so secure. Source

More recently, I have discovered other apps, such as SyncMyTracks, which are designed specifically to sync data across multiple fitness platforms – but these usually come at a cost. They’re also vulnerable because they’re not partnered with platform owners and changes in their code or interface could easily shut them out.

Endomondo’s training plan served me well for a couple of years, but I didn’t really like the unpredictable changes it would make to my program. For example, tell me I have an 8 km run the next day, but on the day change it to 18 km. I also began to feel like I had gotten the gist of the training it was trying to get me to do. I figured I could design and follow my own program and cancelled my subscription to Endomondo and retained a free account. What I didn’t know, was that I would also lose access to much of my previous run data and this is what infuriated me the most.

Endomondo would allow me to view distance analytics over the history of my runs, but any other information, such as pacing, speed, elevation, heart rate, and even number of workouts, required a premium subscription. I can kind of understand their stance from a commercial perspective as it must be very costly to calculate the average pace over distance data I provided them (!), and I therefore must pay USD30 a year to see it… The data is there! It’s been calculated! So it really pisses me off that there is no real additional cost to them to show me my data.

And to top it off. What if I think screw Endomondo, I’m going to take my data elsewhere? Is there an inbuilt export tool I can use to take the data that I provided back out? Of course not. I have to rely on another tool created by a third party that could again, stop working at any moment.

Furthermore, what happens if I switch out my Nike watch for a Garmin, TomTom, Timex or Polar? These have their own platforms too so am I just going to have to cross my fingers and hope that these third party tools exist for them all? I’m not sure what the answer is but I’m hoping to mitigate it by putting all my data into a single platform: RunningAhead. This is absolutely free for tracking all kinds of workouts – not just running. No tricks or gimmicks and analytics are provided to you in detail comparable to all the other platforms. You can import a whole range of training files and store as much data as you want. If you want to backup or export your entire training history, you can. The only downside is the design is a bit dated but that’s of little concern.

Image of a RunningAhead screenshot

Form follows function, just the way I like it.

I’ve already uploaded all my workouts from Runkeeper, Endomondo and Nike+ into RunningAhead. I’ve also tried to streamline future uploads as I continue to use my Nike watch so that I don’t have to manually upload a run each time. If you’re interested in how I am trying to do this see my follow-up post. I’m also planning to share a bit more about the current tools I’m using for training and managing my running data.

 

* Due to changes in the Nike+ API, many of these tools no longer work. See upcoming post for the rage this has induced.