Building syndication buses with FeedAPI & OpenCalais

22
Sign In
Submitted by humble on Fri, 2009-09-25 10:36
  • FeedAPI
  • OpenCalais
  • RDF
  • RSS
  • syndication
  • Performance & Scalability
  • Site Building
  • Videos
  • Intermediate
Logistics
Day: 
Sunday
Time: 
11:00 am
Room: 
Room U3

I will go through the steps in building and maintaining a comprehensive syndication bus in Drupal 6 using FeedAPI, Open Calais, & Twitter drawing from my experience with http://integral.virishi.net.

I will cover many of the ‘gotchas’ of building such a system and discuss issues around performance, scalability and how I’m preparing for Drupal 7, PubSubHubbub and RSSCloud.

This will be geared at an intermediate level and will assume familiarity with Drupal installation and configuration (incl. contrib modules – esp. Views).

seadug.blip.tv uploaded by Dale McGladdery

More sessions with video.

Comments

More resources for OpenCalais

Submitted by jwalling on Wed, 2009-11-04 17:20.

Official site http://www.opencalais.com/

Twitter http://twitter.com/opencalais

Wikipedia http://en.wikipedia.org/wiki/Calais_(Reuters_Product)

Drupal module http://drupal.org/project/opencalais

OpenPublish (uses OpenCalais)
http://drupal.org/project/openpublish
http://www.phase2technology.com/project/openpublish
http://openpublishapp.com/ -> http://www.opensourceopenminds.com/openpublish

Lullabot
Introduction to Calais
http://www.lullabot.com/articles/introduction-calais
Drupal Voices 20: Tom Tague & Tiffany Shackelford on Open Calais
http://www.lullabot.com/drupal-voices/drupal-voices-20-tom-tague-tiffany…

I'm in!

Submitted by mikeytown2 on Thu, 2009-10-01 00:08.

Sounds good, I’ll prepare some slides and talk about what I did in order to make the module scale. Long story short, don’t give up, and don’t be afraid placing custom debug code into core.

That's sounds great, Mike

Submitted by humble on Tue, 2009-09-29 07:39.

My use of OpenCalais is pretty modest compared to yours but I’ve still run into some bottlenecks that I traced to OC. After last night’s VanDUG presentation on Drupal 7 I’d like to also talk about how Drupal 7’s new Queue(API) will help with scalability of these kinds of projects. Let’s co-present…

Open Calais

Submitted by mikeytown2 on Mon, 2009-09-28 22:15.

I’ve done some work in terms of making Open Calais bulk operations scale to the 500K+ node level. We could compare notes, or even co present, if your interested. For one of my sites I’m 1/2 done; ETA is Mid October and have tagged 8,800,000+ terms so far.
http://drupal.org/project/issues/search/opencalais?participant=mikeytown2