Enterprise Syndication - Here We Go!
June 3rd, 2008
Well, I’ve finally started working hard on the enterprise syndication product. Things are moving right along!
Since this application is based on lots of semantic web technologies, I first need some way to store my RDF and query it. There are a few open source and commercial applications out there to do this. But, having a terminal case of Not Invented Here Syndrome, I decided to roll my own. I had some old code from an earlier (abandoned) project that I used as a starting point. But I totally re-implemented the storage engine to support MySQL and created a first stab at a decent SPARQL query engine.
I also quickly coded up a little RSS crawler to go out and crawl about 40 RSS feeds. Right now it does this on demand, but I’ll soon change to poll every X minutes. I’m using Danny Ayers’ and Henry Story’s AtomOWL schema to represent the RSS data in the triple store. Not sure I’ll stick with that, but it works for the time being.
With the triple store, a crawler and a query engine in place, I can finally start to do some of the higher level work like notification, user interfaces, workflow, etc. The next two weeks should see major progress made. Hopefully I’ll have something to show to people at LinkedDataPlanet and get some feedback.
Just for fun, here’s a screenshot of the SPARQL Shell that I’ve written to run test queries it. Probably not part of the product, but a must-have for development. Here I’m just querying my triple store for articles from CruchGear. Neato!
Until next time, stay classy inter-tubes.
June 4th, 2008 at 3:52 am
Hi
I don’t know if you are aware of Virtuoso [1] and/or ODS [2]. ODS in particular enables you to achieve what you descibe in this post. ODS and Virtuoso are Open Souce projects.
Virtuoso is a hish-performance Quad Store for RDF, it’s the engine behind DBpedia [3]. ODS is a collaboration suite and virtulaization middleware for the Linked Data Web built using Virtuoso.
ODS uses SIOC, SKOS, FOAF. AtomOWL, Annotea, and other relevant ontologies at it’s core. There are a number of livee lnstances [4] you can try out.
Links:
1. http://virtuoso.openlinksw.com/wiki/main/
2. http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/Ods
3. http://dbpedia.org/About
4. http://community.linkeddata.org/ods (just sign-up, fill in you profile, and then view the “Explore Data” tab)
Hopefully, I’ll see you at Linked Data Planet
June 4th, 2008 at 9:33 am
Hi Kingsley
Thanks for the links. I was aware of Virtuoso, but not ODS. I’ve created an account and started playing around in it. Looks interesting!
Look forward to meeting you LDP!
Brian