Posterous theme by Cory Watilo

Visualising #foursquare api data, #R and Google Visualisations.

Okay so perhaps I got a little overexcited about the moving visualisation demo. Let's work on something more social.

The Foursquare API let's you pull back your user data. So we're going to take that data and generate a map of checkins from it.

1. Get thy data.

Easy enough from the Foursquare API explorer you can copy/paste the full url with authorisation key.

Use curl to pull the data down:

curl https://api.foursquare.com/v2/users/self/checkins?oauth_token=[authtoken]\&v=[yyyymmdd] > data.json

2. Getting the data frames ready in R.

The Google Map method (gvisMap()) requires the location (either lat:lon or postcode) in an array and an another for the labels (or tips) when the pin location is clicked. The snippet below loads the Google Visualisation API for R and the we load our saved JSON data into R as a data.frame. Lastly we create two vectors, Postcodes and Tip. For this example I'll be using Lat/Lon locations.

library(googleVis)
checkins = fromJSON('/work/rails/foursquare/data.json')
Postcode <- c()
Tip <- c()

3. Iterating the locations

Now we need to cycle through the checkins and place the data in the respective vectors. The locations are colon separated so the paste function is used to concat them together. 

for(n in 1:length(checkins$response$checkins$items)) { 
    locationname = checkins$response$checkins$items[[n]]$venue$name
    location = paste(checkins$response$checkins$items[[n]]$venue$location$lat,    checkins$response$checkins$items[[n]]$venue$location$lng, sep=":")
    Postcode <- c(Postcode, location);
    Tip <- c(Tip, locationname)
}

4. Generating the map

Create a data.frame and add our two vectors

df <- data.frame(Postcode, Tip)

Next use the googleVis library to pull everything together and generate our map.

M2 <- gvisMap(df, "Postcode", "Tip", options=list(showTip=TRUE, mapType="normal"))

Lastly plot the map on screen

plot(M2)

 

 

R and GoogleVis library - instant Hans Rosling! #datavis

How we gawped in wonder at Han Rosling's TED talk. Now you can create your own! Yes you can, with R! In four lines! Don't believe me? 

library(googleVis)
data(Fruits)
M = gvisMotionChart(data=Fruits, idvar="Fruit", timevar="Date", chartid="Fruit")
plot(M)

Done! Click here to see it working.

It generates the html code for you, I've saved one on my Dropbox so you can see it working below. Press the play button, tis cool.  The GoogleVis library covers the majority of the Google Visualistion API so all the map stuff is there as well. Powerful stuff.

 

Human Interaction #win - Recommendation Sites #fail

Millions of Dollars/Pounds/Yen/Euros have been thrown in to recommendation sites in one way or another. In Northern Ireland we have our own lookaly.com which is rather good, elsewhere there's Yelp, TripAdvisor and a plethora of others.

One thing I've been picking up on though is our lack of wanting to look at these sites.  Chances are we may have the respective app on our phone but the fact still remains we yearn for human interaction. Want proof? 

Ryangadamstweet

The natural instinct of many is not to go searching but just to ask another human being. The most important phrases a marketer could pick up on within social media is who's asking who. Even down to a job posting there's a good chance still that the boss of the firm will pick up the phone and ask a seasoned networker, "do you know anyone who can....".  

It's fair to say that the fatigue of another website to look at is setting in. I don't personally browse, I may consume information whether that be audio, video or a book. When it comes to something real, tangible then I ask another person. Now that may be a person I actually know well, a loosely coupled connection (Twitter/Facebook) or just throw the comment out and see where it goes. 

So perhaps it's fair to say that the neural network of Twitter provides part of the answer. Ryan asks the question and within three steps of his network can find someone actually in Edinburgh.

(Ryan:friend (Jase:friend (Someone:location Edinburgh):question "Restaurants in your location"))

Is there much real point asking Ryan's network who's centrality may not be Edinburgh based?   

There is method to this madness, one of Ryan's network may recommend a place but may have only ate there once. Where as a local will have potentially eaten at a specific restaurant tens of times and know the staff, menu well.

The power of recommendation is not necessarily in review sites, it's just a few steps away from your network of centrality.

API's or "Don't write off MySpace it still has our data!" #bigdata #hadoop

A question to myself the other day, what's in an email address. It's what defines us, a central point in time and space. Our identity, our login and our method of communication.
So what finger prints are we leaving behind..... if you're into social media, loads.

From my email address I managed to decduce, well not even deduce it was staring me in the face.

{"startIndex":"1","itemsPerPage":"10","totalResults":"1","resultCount":"1","searchId":"90f06c0d-8d67-41ff-81db-cfb5ec96e38f","entry":[{"id":"myspace.com.person.185657082","displayName":"Jase Bell - Photographer in Northern Ireland'","profileUrl":"http:\/\/www.myspace.com\/jasonbellphotography","thumbnailUrl":"http:\/\/a1.ec-images.myspacecdn.com\/profile01\/126\/a3002af7288442058c3d5d300a9f01ae\/s.jpg","msUserType":"RegularUser","gender":"Male","age":"40","location":"Limavady, Co. Londonderry","updated":"6\/30\/2011 7:02:00 PM","isOfficial":"0"}]}

My sex, my age, where I am, my title and even a lovely photo

Media_httpa1ecimagesm_fifgi

"So what!" I hear you cry. Well I'll tell you, loosely coupled data. With one email address think about the follow API's together: Facebook, Foursqure, MySpace, Flickr and I can make up a pretty convincing marketing picture. Add Hadoop to the mix and I can collate/mine/store and sift through tons of data in a short space of time and pretty cheaply.

It's not like this is even coming, it's all here and it's all for the taking.

How to p*ss customers off easy, the Glossybox story #customer #custserv #loyalty

Glossybox

I'm a big fan of subscription services from makeup (no I don't), to shoes, condoms, socks and even tamponia (nope not them either). Pay your money each month and receive your goods on a specified date, or very near it.  For example, you pay on the 1st of the month then choose your items by the 6th and they arrive with the customer by the 10th. Should be like clockwork if the supply chain is right and your stock monitoring is good.

Customers can plan their lives around your deliveries and safe in the knowledge that the next package arrives on a certain date on their doorstep and the whole cycle goes round again.  Everyone's happy.

UNTIL!!!

Until the supply chain goes bad and you really piss your customers off. 

Glossybox is such a service and it seems to have become foul to a very simple supply chain issue, the Easter holiday. So when your scheduled delivery is on the 10th you know you are about to unleash all manner of hell by telling your customers they won't get delivery until the end of April (25th) well there's going to be words said, subscriptions cancelled and a rebellion on Facebook.  A few days here or there and most would have turned a blind eye, this was two weeks.

It happened.  And these are my three observations....

1. Your supply chain is not to blame, you are
The Royal Mail deliver things, the Royal Mail have holidays too and like Christmas you know there'll be a cut off point. Royal Mail are not to blame you are ultimately responsible for posting early to keep a smile on your customer's face.  

2. Don't change the flow of your customer's life
Customers don't need a feast or famine approach with your stock. The regularity of your subscription means they are fitting your product in to their lives. If you rock the boat, which Glossybox did to the tune of two weeks, then all manner of issues occur from your customer running out of stock to then having too much when the next delivery arrives. As a service the last thing you want to do is give your customer an excuse to run out to a competitor. 

[Thanks to @rudedoodle for pointing out that Glossybox is a selection of random products so a customer is never really going to "run out" of anything that's sent. I'll leave point 2 in though by way as an example :)]

3. This could have easily been avoided.
Okay Easter ran into a unfair time for Glossybox with Good Friday being so close into the month and then no postal delivery or collection until the following Tuesday. I still think with some planning, data review and customer communication they could have pulled a small customer win. 

A few late nights from staff would have ride the storm as well. And if employee loyalty was high they wouldn't have minded at all to keep customers happy.

If I had £1000 I could..... #investni #startups #employment #unemployment

Coins

If there's one sentence I hear most of from people wanting to start something it's that. I'm not talking about the tech startup scene or investment vehicles to exit a company with a 3.5x multiplier. I'm talking about something a lot simpler, someone just wanting to make a decent living from week to week.

The reality is that if you want to set up as a hairdresser, window cleaner or open a small popup shop then there are going to be startup overheads.
So the sentence, "If I had £1000 I could......" is now the biggest stumbling block between lifting people off the unemployment ladder or keeping them there. I have an idea..... Sammy Wilson if you're listening I want a million quid.

£1000 to 1000 individuals. They pay it back too over the course of 12-18 months. So the cost to the tax payer over 18 months would effectively be zero. Everyone's happy.

With £1000 someone could get setup, print their flyers and get selling. Even if it was the minimum wage of £6.08 we're talking the following figures.

Investment of £1,000,000 to fund 1000 people in the community.

All 1000 will be expected to earn the minimum wage of £6.08 per hour and work 36 hours a week.
36 x 6.08 x 48 working weeks = £10,506.24 a year x 1000 = £10,506,240

It makes good PR but with the personal allowance for 2012/13 at £8105 the income tax generated wouldn't be huge. But it takes 1000 off the unemployment register and that's a good thing, promotes well being and shows that people given the right help want to do stuff.

Where would the million quid come from? Well there's going to be £5m sloshing about from the Tesco Tax so I don't mind borrowing it from there and putting it back in 12 months time.

This is what the local enterprise agencies should be promoting in my opinion and I'm not just talking Northern Ireland, this should be UK wide.

People do want to work you just have to give folk the encouragement to do so.

Instagram - take the money and run.

Instagram

You would though wouldn't you?
 
I bet photographer Chase Jarvis is kicking himself this morning ;)
 
So what does all this prove? Well there's money in that there data, that's for sure. This isn't about new users as I would wager the majority of Instagram users are already on Facebook. So what's Facebook have really bought is the social graph of pictures....
 
It's about users, relationships, media, comments, likes, tags, locations and geographies.
 
The cost, yeah it's way over priced or is it? FB are not buying the application, let's be honest anyone can do that, they are buying photographic user interaction to the tune of 25 pics a second (as stated in Oct 2011). That's over 2 million uploads a day (it will be a lot more now), for data and insight that's cheap. The Zuckerberg camp obviously know what they want to do with that data.
 
This is a power play in data and a disaster for investments, there's another bubble coming me thinks.

Thoughts on Pinterest but we're only scratching the surface.

Pinterest_logo
Let's get one thing out of the way, I like Pinterest and the idea of social sharing, if it's social as you're usually sat a computer not being social and pinning stuff. 

So that's been done startups, we can move on now, done, finito it'll transform retail, well it won't but it's a great hyperbowl to chuck the tech press and get them all exited. So here's where I want it to go....

Consumer wants are based on the psychological instinct. Like Jesse J's outfit you'll scramble to to Google to try and find it or something remotely like it (well I won't as I don't have that sorta fringe). It's time to look at the medium again, watching stuff moving stuff.

Time to rethink the set top box interactions, it was the reason that the Java programming language was originally developed, inter connected consumer devices especially the telebox. So imagine that you're watching Mad Men and that lovely dress comes on, a quick ping of the red button will bring you the online purchasing options (there's a fashion API I know of ripe for the picking)  

Your satellite subscription is linked to your payment card or bank account so that's the payment of the product sorted out. The majority of startups are obsessed with the web as the platform and the constant mentioning of putting stuff in the cloud. The reality is that potential customers are all over the place and watching television is still a time chewing pasttime, we just need to make the shopping connection a little better.

Time to play with the Java TV API me thinks :)

 

Nothing like an app called "Girls Around Me" to cause a stir....

For ten long years, possibly longer, I knew this day was coming. Since the idea of floating data and API's was a dream in the bowl of my hipster hat, I knew the day would happen.

And boy did it happen.... with the "Girls Around Me" app.

Xl_girls_around_me_iphone_app_

Okay I agree the copy used on the website doesn't help matters at all but there's nothing like a storm in a very small teacup to get the tech press on their keyboards bashing away until the sentences come flying out. The issue here my friends is not the app itself. The girl aspect, while not the be all and end all of apps but causes the most prudish of journalist to come out all guns blazing. It's far more ingrained than that.

If the app were "Dog Walkers Around Me", or "Coffee Lovers' Around Me" then I'm working on the assumption that no one in the tech press would have batted an eyelid about the content nor the main issue with all of this. The main issue is the use of data for the taking....

As soon as you link your Foursquare account and Facebook account together you become a targeted dream. We now know all your likes, friends and connections and where you are. And you gave it to us for free, the most treasured jewels in your closet, the secret stuff you just handed on a plate. And now with added API loveliness you just gave it to everyone else too.

With the likes of Grindr and Blendr they are very closed networks, signup and sign in but only be seen by other users on the closed system. Startups hate going this route as it takes up time to build audience. For me it's the best solution, you know your user base and you control the currency, namely the data, that can be used be third parties.
Many retailers asked me with regards to uVoucher whether it connects to Facebook, I've constantly declined. Stating that the data the retailer can retain is of far more importance to them than what social networks claim to offer. To offer customer insight is one thing, to actually do something with it is something else. Most people don't in my experience. Hiving off a list of email addresses to blanket sell to is not that targeted to me. Don't let me stop you having a social media presence but your data is your data, not Facebook's.

Yeah "Girls Around Me" with pivot into something else, quietly relaunch and hope there's not as much fuss about the main aim of the app, finding a physical connection with another human being. I'm sure there are better ways of doing it but there you are.

Ultimately - Data is my currency and I guard it.