Tuesday, April 01, 2008

pipes

There are a lot of people blogging about SoFoBoMo. So many in fact, that I didn't think I'd be able to keep track using Google reader, my normal blog browser of choice. So I headed over to Yahoo Pipes to build something to merge them all together. JL had told me about pipes. I was surprised to find how easy it was to build up a script using a visual flow chart style of programming. Each block performs some sort of function and you drag and drop them into a chart. Add in data sources, like RSS feeds, then drag connectors between the blocks to describe the flow of information. Throw in some filters, in this case to block things that are not SoFoBoMo related and then hit publish and you are done. There seemed to be quite a bit of complex functionality that could be created using this tool, to do more complex web aggregation and mashup sort of activities. Once published, it is a one step process to integrate it into a web site (e.g., the box to the left of this post) or add as one merged RSS feed to a reader. Quite a cool technology. You can find the SoFoBoMo pipe here. When it runs, the 'List' view is probably most useful and the various buttons along the top provide options to integrate it into a variety of other viewers. If you want your SoFoMoBo related blog added to the feed, I just need the RSS link. Feel free to add it in the comments here and I'll merge it into the pipe. I seeded the list, based on this post by Colin Jago, so if you were on his list, you are already in. Update A couple of comments. I'm going to go through and delete comments from those asking to be added, once I've added the URL to the pipe. This is just so I can keep track. If your comment is gone, it just means I've got you in. Secondly, Rafa asked about the filtering mechanism. The pipe only includes posts that say SoFoBoMo somewhere, in the title, in the body of the post or in the categories or labels. It is fairly loose in what it will let through - all caps, mixed case, camel case, all lower case, pushed up against other words (SoFoBoMoGOGOGO etc) and SoPoBoMo's are also passable. Tagging the posts with SoFoBoMo should be enough to keep your posts in the feed. Please let me know if that doesn't appear to be working. It can take a few hours for new posts to appear, due to the delays in feedburner and Yahoo Pipes refreshing the lists. Finally, only posts that have a filled out title appear to end up getting a link created in the pipe. The post will still appear but will be truncated and it isn't simple to find a link back. So please, include a title on your posts.

15 comments:

Dion said...

Thanks for adding me to the pipe. I notice you added my feedburner (http://feeds.feedburner.com/Dvphoto?format=xml) feed to the pipe and I was thinking that it is probably better if we can change that to http://photography.darkervision.com/blog/tag/sofobomo/feed/

That way I won't be polluting your pipe with any non SoFoBoMo posts that I might make.

Gary said...
This comment has been removed by a blog administrator.
Gordon said...

Hi Dion,

the pipe actually filters out any non-sofobomo entries already so it shouldn't be a problem.

If you see things in there that you think shouldn't be, let me know.

mcoker said...

Nice. I just saw found out what SoFoBoMo is, it sounds like an awesome project :) Until now, I kinda filtered out that word and just enjoyed the pretty pictures. Cool idea!

Paul said...
This comment has been removed by a blog administrator.
Paul said...
This comment has been removed by a blog administrator.
A Jesse said...

Gordon, thanks for setting up this resource. Pretty slick. Since I am way out of the loop on maximizing the wonders of the web, I really appreciate your generous contribution of your skills and energy.

Julia said...
This comment has been removed by a blog administrator.
Liza said...
This comment has been removed by a blog administrator.
Lew said...
This comment has been removed by a blog administrator.
Rafa said...
This comment has been removed by a blog administrator.
LeeAnn Heringer said...

I'm working on the SoFoBoMo thang over at http://laheringer.livejournal.com/.

Amy Sakurai said...

I don't know if this works... the RSS link for my LJ SoFoBoMo entries... http://lovelyangel.livejournal.com/data/rss?tag=sofobomo

(Preview shows link getting cut off... obviously tag=sofobomo)

Thanks for setting this up, Gordon!

Glen said...

Hello Gordon:

I've begun the SoFoBoMo project and would like my feed added to your pipe. The feed URL is
http://gataddzone.net/gzphotographs/index.php?x=rss and my relevant entries (just one so far) are categorized "sofobomo".

Thanks, I appreciate it.

Ahn und Pfirsich said...

Hi Gordon,

I know I am somewhat late to the party (also title of my first blog post for SoFoBoMo), but my fuzzy month starts 1st of May. Maybe you could add me (http://ahnbelievable.blogspot.com/) to the pipe. My entries are tagged "SoFoBoMo".

Thanks a lot!

Christian Ahn