Twitter Kills RSS: How to Roll Your Own Feed With Scraperwiki

| Comments

As announced this week, Twitter are continuing their war on developers by killing off RSS feeds.

Add this to the fact that, once the old API is killed off around the middle of next year, all endpoints will require authentication, it’s going to be a bit harder to do simple stuff with Twitter (such as display the latest tweets from your Twitter feed).

You could, of course, use Twitter’s own widgets, but what if you (quite reasonably) want control over the look and feel of your own website? You’re either screwed, or you have to sign up for a developer account, create an application and use OAuth authentication just to display a couple of tweets, which is possibly overkill.

However, there is a third way, by using Scraperwiki to scrape the tweets from your profile page you can create an RSS feed which will also act as a drop in replacement for any feeds you already use.

It’s pretty simple, just go to my scraper on Scraperwiki, click copy, and change the username to whatever username you want a feed for. Save the scraper and then run it.

Next, copy this URL, replacing YOUR_SCRAPER_NAME with the name of your scraper (this will be in the URL when you save the scraper):

And there you have it! The URL you have will then display an RSS feed of your latest tweets. An added advantage of this approach is that the scraper runs every day and saves the tweets in a database, so you’ve also got a daily archive of your tweets.

One disadvantage is, however, as the scraper only runs once a day (unless you upgrade your Scraperwiki account so you can run scrapers every hour), it may not be particularly up to date, but it’s better than nothing!