{"id":154,"date":"2010-02-02T14:35:16","date_gmt":"2010-02-02T14:35:16","guid":{"rendered":"http:\/\/blog.soton.ac.uk\/webteam\/?p=154"},"modified":"2010-02-02T14:35:16","modified_gmt":"2010-02-02T14:35:16","slug":"replacing-mysql-with-a-triple-store","status":"publish","type":"post","link":"https:\/\/blog.soton.ac.uk\/webteam\/2010\/02\/02\/replacing-mysql-with-a-triple-store\/","title":{"rendered":"Replacing MySQL with a triple-store"},"content":{"rendered":"

Some academics have urged me to consider using an triple-store as a back-end for some of our websites, as oppose to our normal MySQL approach. I’m not convinced, but it’s an interesting challenge. I started by looking into what common “patterns” we use SQL which we would need to replicate in RDF. Or change how we approach problems in the first place.<\/p>\n

Our usual MySQL “patterns”<\/h3>\n
    \n
  1. Create a record from <object>
    \nWe create record, which is in effect a serialisation of an object. Most often it represents a human, an account, an event, an organisation or an article (text + metadata). We use the database to generate a unique key for the item, in the current context. Generally an integer. In MySQL we use AUTO_INCREMENT for this, but every SQL DB has a varient.<\/li>\n
  2. Delete record with <ID><\/li>\n
  3. Update record with <ID> to match <object><\/li>\n
  4. Retrieve record with <ID><\/li>\n
  5. Find\/retrieve records matching <criteria><\/li>\n<\/ol>\n

    Update can reasonably be abstracted to “delete then create” so lets ignore it.<\/p>\n

    “Find” and “retrieve” require some new techniques, but are not a big concern.<\/p>\n

    My current understanding is that when adding a set of triples you can say that they are all part of a “graph” with URI <x>, and later you can remove or replace all URIs from graph <x>.<\/p>\n

    The one thing entirely missing is the ability to generate new integers in a sequence.<\/p>\n

    I’ve been given two suggested solutions by the experts…<\/p>\n

    UUID<\/h3>\n

    Suggestion one, to use UUID (universal unique IDs) or hashes. But the problem is, I want to use these in URLs and URIs and I want to use http:\/\/webscience.org\/person\/6.html not http:\/\/webscience.org\/person\/e530d212-0ff1-11df-8660-003048bd79d6.html<\/p>\n

    Flock a file<\/h3>\n

    A second suggestion, was to flock a local file containing the next value. (lock file, read file, update file, unlock file). This would work, but I want the current position in each sequence to be stored with my other data, and accessed\/modified using the same rights as can read\/write the triple store. That’s what I’m used to with MySQL.<\/p>\n

    My Idea 1: Sequence Service<\/h3>\n

    My first idea, was to create a stand alone service which could run on the same server as the triple store, and you could query it, via HTTP or command line, for a new integer in an sequence. Sequences could be identified via a URI.<\/p>\n

    http:\/\/dbserver:12345\/next_in_sequence?seq=http:\/\/webscience.org\/people_sequence<\/pre>\n
    Which would return “23” then “24” etc. The locking code could be handled in the sequence server, and the assumption would be that only trusted parties could connect (like SPARQL). This service could work by:<\/p>\n
      \n
    • Locking (all requests processed sequentially)<\/li>\n
    • Querying the triple store for <http:\/\/webscience.org\/people_sequence> <currentValue> ?value<\/li>\n
    • Replacing the triple with ?value+1<\/li>\n
    • Unlocking<\/li>\n
    • Returning ?value+1<\/li>\n<\/ul>\n
      While this is a bit icky, it does mean that my data remains stored in one place, including the state of each sequence.<\/p>\n
      What this doesn’t do is provide one access point. All SQL implementations provide a solution for this, and I suspect that, long term, so will triple stores. But I can’t see the purists liking it going through the same access interface as it’s clearly a hack.<\/p>\n
      Non technical concerns with RDF back-ends<\/h3>\n
      On a non-technical note, I’m also concerned that an RDF+PHP solution is not very maintainable. You can’t easily hire someone with these skills yet.<\/p>\n","protected":false},"excerpt":{"rendered":"
      Some academics have urged me to consider using an triple-store as a back-end for some of our websites, as oppose to our normal MySQL approach. I’m not convinced, but it’s an interesting challenge. I started by looking into what common “patterns” we use SQL which we would need to replicate in RDF. Or change how […]<\/p>\n","protected":false},"author":5,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ngg_post_thumbnail":0,"footnotes":""},"categories":[198,86,136,227],"tags":[],"class_list":["post-154","post","type-post","status-publish","format-standard","hentry","category-best-practice","category-database","category-rdf","category-sql"],"_links":{"self":[{"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/posts\/154","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/comments?post=154"}],"version-history":[{"count":2,"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/posts\/154\/revisions"}],"predecessor-version":[{"id":156,"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/posts\/154\/revisions\/156"}],"wp:attachment":[{"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/media?parent=154"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/categories?post=154"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/tags?post=154"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}