{"id":168,"date":"2010-02-22T17:51:47","date_gmt":"2010-02-22T17:51:47","guid":{"rendered":"http:\/\/blog.soton.ac.uk\/webteam\/?p=168"},"modified":"2010-02-22T17:51:47","modified_gmt":"2010-02-22T17:51:47","slug":"tracking-twitter-for-dev8d","status":"publish","type":"post","link":"https:\/\/blog.soton.ac.uk\/webteam\/2010\/02\/22\/tracking-twitter-for-dev8d\/","title":{"rendered":"Tracking twitter for dev8d"},"content":{"rendered":"

In the run up to Dev8D<\/a>, there’s been a lot of twitter activity<\/a>, which will hopefully continue throughout and after the event. I’m hoping that something useful can come out of it, so I’ve started a running a couple of scripts based around this.<\/p>\n

Capturing twitter posts<\/h3>\n

Firstly, I’m simply capturing all tweets which mention ‘dev8d’ using twitter’s search API<\/a>.<\/p>\n

I’ve written a small python script to do this, available here:
\narchive-twitter-search<\/a><\/p>\n

It’s designed to be a quick solution to archiving twitter posts related to events (or anything with a keyword), with zero configuration\/setup (you do<\/strong> still need to specify a search term though…).<\/p>\n

Every 10 minutes, any new tweets mentioning dev8d are stored in a SQLite database. They should be easy enough to query or export to another format in this way.<\/p>\n

Capturing the twitter network<\/h3>\n

The second (and potentially more interesting) thing I’m logging is the change in the network of dev8d attendees on twitter.<\/p>\n

I’m capturing all users with a twitter account who’ve registered on the Dev8D wiki<\/a>, and any user who posted\/received a tweet mentioning dev8d.<\/p>\n

I’m then periodically (as often as twitter’s rate limit<\/a> allows) getting the list of friends and followers for each user, and logging when any changes to these lists occur.<\/p>\n

By joining users and lists of friends\/followers together, it should be possible to build up a picture of the connections between developers attending dev8d, before, during and after the event.<\/p>\n

I’m hoping that over time (well, over dev8d at least), I’ll be able to see how the network of attendees changes, expands and grows together.<\/p>\n

The data will all be freely available (upon request for now – I’m running the scripts on a desktop PC), but I’m planning to add the data to data.dev8d.org<\/a> after the event.<\/p>\n","protected":false},"excerpt":{"rendered":"

In the run up to Dev8D, there’s been a lot of twitter activity, which will hopefully continue throughout and after the event. I’m hoping that something useful can come out of it, so I’ve started a running a couple of scripts based around this. Capturing twitter posts Firstly, I’m simply capturing all tweets which mention […]<\/p>\n","protected":false},"author":6,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ngg_post_thumbnail":0,"footnotes":""},"categories":[93,227,256],"tags":[],"class_list":["post-168","post","type-post","status-publish","format-standard","hentry","category-python","category-sql","category-twitter"],"_links":{"self":[{"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/posts\/168","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/comments?post=168"}],"version-history":[{"count":11,"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/posts\/168\/revisions"}],"predecessor-version":[{"id":179,"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/posts\/168\/revisions\/179"}],"wp:attachment":[{"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/media?parent=168"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/categories?post=168"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/tags?post=168"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}