Category: Linked data

  • Adding MARC fruit to the cornucopia

    Netting more MARC fruit discussed the use of the rdfs:subPropertyOf property to allow MARC21 data to interoperate with triples based on similar properties in element sets from other metadata schemas. We can show the procedure in action using the Target audience property described in Getting to higher MARC branches.

    A quick examination of the namespaces for Dublin Core terms, the FRBR entity-relationship model, ISBD, and RDA reveals properties for intended or target audience in each. The FRSAD (FR for Subject Authority Data) namespace also has a property labelled “has audience”, but it refers to the class Nomen which contains labels and identifiers for subject topics; it is about subject headings and classifications, not the resource itself, so has a completely different context and is not suitable for interoperating with MARC21’s Target audience data.

    The relevant triples for each property are:

    Dublin Core terms:

    @prefix dct: <http://purl.org/dc/terms/>.
    @prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>.
    dct:audience rdfs:comment "A class of entity for whom the resource is intended or useful." .
    dct:audience rdfs:label "audience" .
    dct:audience rdfs:range dct:AgentClass .

    FRBR:

    @prefix frbrer: <http://iflastandards.info/ns/fr/frbr/frbrer/>.
    @prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#&gt.
    @prefix skos: <http://www.w3.org/2004/02/skos/core#>.
    frbrer:P3006 skos:definition "Relates a work to the class of user for which the work is intended, as defined by age group, educational level, or other categorization." .
    frbrer:P3006 rdfs:label "has intended audience" .
    frbrer:P3006 rdfs:domain frbrer:C1001 .

    ISBD:

    @prefix isbd: <http://iflastandards.info/ns/isbd/elements/>.
    @prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#&gt.
    @prefix skos: <http://www.w3.org/2004/02/skos/core#&gt.
    isbd:P1091 skos:definition "Relates a resource to a note providing non-evaluative information as to the potential or recommended use of the resource and/or the intended audience." .
    isbd:P1091 rdfs:label "has note on use or audience" .
    isbd:P1091 rdfs:domain isbd:Resource .

    RDA:

    @prefix rda: <http://rdvocab.info/Elements/>.
    @prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#&gt.
    @prefix skos: <http://www.w3.org/2004/02/skos/core#&gt.
    @prefix unc: <http://.../>.
    rda:intendedAudienceWork skos:definition "The class of user for which the content of a resource is intended, or for whom the content is considered suitable, as defined by age group (e.g., children, young adults, adults, etc.), educational level (e.g., primary, secondary, etc.), type of disability, or other categorization." .
    rda:intendedAudienceWork rdfs:label "Intended audience (Work)" .
    rda:intendedAudienceWork rdfs:domain rdafrbr:Work .
    rda:intendedAudienceWork rdfs:subPropertyOf unc:intendedAudience .

    Unconstrained RDA:

    @prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#&gt.
    @prefix skos: <http://www.w3.org/2004/02/skos/core#&gt.
    @prefix unc: <http://.../>.
    unc:intendedAudience skos:definition "The class of user for which the content of a resource is intended, or for whom the content is considered suitable, as defined by age group (e.g., children, young adults, adults, etc.), educational level (e.g., primary, secondary, etc.), type of disability, or other categorization." .
    unc:intendedAudience rdfs:label "Intended audience" .

    And for our high-level MARC21 property:

    @prefix m21plus: <http://marc21rdf.info/elements/.../>.
    @prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#&gt.
    @prefix skos: <http://www.w3.org/2004/02/skos/core#&gt.
    m21plus:M00Aud skos:definition "The intellectual level of the target audience for which the material is intended." .
    m21plus:M00Aud rdfs:label "Target audience" .

    The MARC21 property has a narrower definition than any of the others. Taking into account the domain and range constraints leaves only the unconstrained RDA property as a candidate super-property:

    m21plus:M00Aud rdfs:subPropertyOf unc:intendedAudience .

    This allows triples from MARC21 records to have entailments which use the same unconstrained property as triples from RDA records; the FRBR-constrained RDA property is already a sub-property of the unconstrained property.

    RDF graphs of MARC21 and RDA data triples and entailments.
    RDF graphs of MARC21 and RDA data triples and entailments.

    Of course, the original MARC21 triple is itself an entailment from a level 0 triple.

    We can use the same procedure to align and map the other properties we found for target or intended audience. The resulting RDF ontology is:

    @prefix dct: <http://purl.org/dc/terms/>.
    @prefix frbrer: <http://iflastandards.info/ns/fr/frbr/frbrer/>.
    @prefix isbd: <http://iflastandards.info/ns/isbd/elements/>.
    @prefix m21plus: <http://marc21rdf.info/elements/.../>.
    @prefix rda: <http://rdvocab.info/Elements/>.
    @prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>.
    @prefix unc: <http://.../>.
    dct:audience rdfs:subPropertyOf unc:intendedAudience .
    frbrer:P3006 rdfs:subPropertyOf unc:intendedAudience .
    m21plus:M00Aud rdfs:subPropertyOf unc:intendedAudience .
    rda:intendedAudienceWork rdfs:subPropertyOf unc:intendedAudience .
    unc:intendedAudience rdfs:subPropertyOf unc:P1091 .
    isbd:P1091 rdfs:subPropertyOf unc:P1091 .

    Note that the ISBD property is broader in definition that the unconstrained RDA property, but is itself constrained by its domain. So we need an unconstrained version of the ISBD property, which has the broadest semantic of all the related properties.

    RDF graph of Target/intended audience ontology
    RDF graph of Target/intended audience ontology

    This ontology allows all the data about the intended audience of a resource to be available as a single, common attribute; our MARC fruit is added to the basket automatically, once it has been plucked as a level 0 triple.

  • Netting more MARC fruit

    Getting to higher MARC branches showed how the RDFS subPropertyOf property can be used to entail, or infer, RDF data triples with a broader semantic or meaning than the original, to “dumb-up” or aggregate data based on level 0 properties. Only the property or predicate part of the triple is different; the subject URI and object URI or literal remain unchanged.

    The Target audience example represents one of several categories we have identified for the level 0 properties for the fixed-length data fields in MARC. This one is characterized as two or more properties with the same definition using the same Vocabulary Encoding Scheme (VES).

    A more complex category is characterized as two or more properties with the same definition using the same VES where the underlying attribute allows  more than one value and the order of values is significant. An example is the 008 attribute Relief of maps:

    RDF graph of MARC21 Relief of maps ontology (partial)
    RDF graph of MARC21 Relief of maps ontology (partial)

    “sP” in the graph stands for rdfs:subPropertyOf. The graph does not show the level 0 properties for Relief (2), (3), and (4).

    This ontology separates the semantics of the order of the data from the type of data while preserving the data values. It offers any application a property for the most important relief type specified on the item being described (m21plus:M00Rel1 “Relief (1)”), a property for the second most important relief type (m21plus:M00Rel2 “Relief (2)”), etc., a property for the relief type regardless of importance (m21plus:M008MP18-21 “Relief of Maps”), etc., and a property for the relief type regardless of importance or category of material (m21plus:M00Rel “Relief”).

    Target audience and Relief are, of course, at the level of attribute or relationship found in many other schemas. The rdfs:subPropertyOf property can be used to establish mappings as semantic relationships between similar properties in multiple namespaces, as described in our paper A reconsideration of mapping in a semantic world.

    While properties may be similar in different namespaces, care has to be taken to avoid semantic incoherency and the inadvertent addition of false information into entailed triples. This has been  easy with the level 0 properties because the basic definitions are identical, and none of the properties is bound by a domain or range. The situation changes when properties from other namespaces are considered. Definitions may be the same in meaning, or broader or narrower. For example, the definition of m21plus:M00Aud, “The intellectual level of the target audience for which the material is intended”, is clearly narrower than the definition of the corresponding RDA property, “The class of user for which the content of a resource is intended, or for whom the content is considered suitable, as defined by age group (e.g., children, young adults, adults, etc.), educational level (e.g., primary, secondary, etc.), type of disability, or other categorization”. If the RDA property is declared a sub-property of the MARC21 property, resulting entailments will give values which are out of scope, for example type of disability, even if the constraint of the MARC21 VES for target audience is ignored. Conversely, declaring the MARC21 property as a sub-property of the RDA property does not lead to such problems, as RDA can accommodate the VES URIs within its scope and range.

    However, it turns out we are on risky ground if we do this, because the RDA property has the FRBR class Work as its domain. This means that in any entailed triple, the URI of the MARC21 resource which is the subject of the original triple is inferred to be a work (a member of the class Work). But unless the MARC21 data has been pre-FRBRized, other triples with the same subject URI will entail triples stating the same resource is also a manifestation, etc., which breaks the FRBR model. Even though the RDA namespace is currently using its own “weak” version of the FRBR classes, there is no guarantee that it won’t link to the FRBR namespace in the future. The situation is therefore best avoided, and what is required is a version of the RDA property that does not have a domain. Fortunately, this was anticipated by the DCMI/RDA Task Group (now the DCMI Bibliographic Metadata Task Group), and “unconstrained” versions of all the RDA properties were added when the namespace was created, as described in our paper RDA vocabularies: process, outcome, use.

    As a general procedure, then, a MARC21 high-level property can be mapped out to another namespace by using sub-property relationships, when the target property completely encompasses the MARC21 property and has no domain or range, or is completely encompassed by the MARC21 property and has no range (to avoid the VES issue). The entailed triples produced by the mappings allow maximum interoperability of MARC21 data with that from other schemas without transforming the data values.

  • Getting to higher MARC branches

    In the previous blog I discussed Low-hanging MARC fruit in the MARC21 fixed-length data fields 006, 007, and 008. These fields also contain useful data that hangs slightly higher up, but can be reached with a short ladder. The ladder rungs are constructed using the RDF Schema subPropertyOf property. This is an ontological property which takes the RDF class Property as its domain and range; in other words, it links instances of two properties:

    P1 rdfs:subPropertyOf P2 – where P1 and P2 are specific properties.

    The subPropertyOf property contains the inference rule or entailment that:

    If P1 rdfs:subPropertyOf P2, and X P1 Y, then X P2 Y

    That is, if property P1 is a sub-property of property P2, then a machine can entail a triple using property P2 with the same subject and object as any triple using property P1.

    There is a lot of semantic overlap in the MARC21 fields. For example, field 006 positions 01-17 relate to positions 18-34 in one of the field 008 configurations; they use the same values. 006 is used in cases when an item has multiple characteristics that cannot be coded in field 008. There is no semantic difference between the 006 and 008 data – a multi-component item may be catalogued as a whole using 008 for the main component and 006 for other components, or each component may be catalogued separately with its own 008 field.

    We can aggregate this data by declaring sub-property relationships between corresponding 006 and 008 “level 0” properties and a new common super-property:

    E.g. Create a new property M00Aud with label “Target audience”, and declare M006a05 (“Target audience of Language material”), M006t05 (“Target audience of Manuscript language material”) and M008BK22 (“Target audience of Books”) as sub-properties:

    @prefix m2100x: <http://marc21rdf.info/elements/00X/>.
    @prefix m21plus: <http://marc21rdf.info/elements/.../>.
    m21plus:M00Aud rdfs:label "Target audience" .
    m2100x:M006a05 rdfs:subPropertyOf m21plus:M00Aud .
    m2100x:M006t05 rdfs:subPropertyOf m21plus:M00Aud .
    m2100x:M008BK22 rdfs:subPropertyOf m21plus:M00Aud .

    A machine can use this RDF graph to entail new triples from existing data:

    ex:1 m2100x:M006a05 m21terms:commonaud#j .
    => ex:1 m21plus:M00Aud m21terms:commonaud#j .
    ex:2 m2100x:M006t05 m21terms:commonaud#e .
    => ex:2 m21plus:M00Aud m21terms:commonaud#e .
    ex:3 m2100x:M008BK22 m21terms:commonaud#g .
    => ex:3 m21plus:M00Aud m21terms:commonaud#g .

    RDF graphs of data triples and entailments (dotted lines)
    RDF graphs of data triples and entailments (dotted lines)

    Here, three different resources (ex:1, ex:2, ex:3) have target audience data stored in three different MARC21 fixed-length fields. The entailed triples store the data using a common property that encompasses the semantic of the level 0 properties by discarding their differences, which are the material categories. Each entailed triple states “This resource has target audience …”, dropping the distinction of material category which is unnecessary for this metadata attribute.

    Using the entailed triples, we only need to process the higher-level property to create, for example, a “Target audience” index for a set of MARC21 records, rather than having to gather the data from the level 0 properties every time.

    We can go further. The same value vocabulary for Target audience is used for other categories of material:

    • M006c05 (“Target audience of Notated music”)
    • M006d05 (“Target audience of Manuscript notated music”)
    • M006g05 (“Target audience of Projected medium”)
    • M006i05 (“Target audience of Nonmusical sound recording”)
    • M006j05 (“Target audience of Musical sound recording”)
    • M006k05 (“Target audience of Two-dimensional nonprojectable graphic”)
    • M006m05 (“Target audience of Computer file or Electronic resource”)
    • M006o05 (“Target audience of Kit”)
    • M006r05 (“Target audience of Three-dimensional artifact or naturally occurring object”)
    • M008CF22 (“Target audience of Computer Files”)
    • M008MU22 (“Target audience of Music”)
    • M008VM22 (“Target audience of Visual Materials”)

    So we can declare sub-property relationships between each of these level 0 properties and the higher-level “Target audience” property, and generate the entailed triples.

    Note that we could create an intermediary rung on our ladder, say M00BKAud “Target audience (Language material)”, to aggregate data at the material category level, and then declare a sub-property relationship with M00Aud to aggregate to the category-free level. There is no specific use-case for this at the moment. If the need arises, this can be done without affecting the existing sub-property relationships and entailments, because the subPropertyOf property is transitive: P1 rdfs:subPropertyOf P2 and P2 rdfs:subPropertyOf P3 entails P1 rdfs:subPropertyOf P3.

    Our ladder “dumbs-up” the level 0 data; each sub-property entailment uses a higher-level property that is broader in semantic than the last. The ladders merge at each stage and are just one rung in length, so what we get is more like a climbing net to get to the higher-hanging fruit.

    RDF graph of MARC21 Target audience ontology
    RDF graph of MARC21 Target audience ontology

    Applications can now deal with just one attribute property for Target audience and avoid the messiness at level 0. And there is just one property to align and map to corresponding properties from other bibliographic metadata schemas …

  • Low-hanging MARC fruit

    It’s been six months since Diane Hillmann, Jon Phipps, and I published a “level 0” set of RDF elements (all properties) and value vocabularies based on the MARC21 format. That was largely a mechanical process, as we created a separate property for every combination of tag, two indicators, and subfield for most (but not yet all) tags in MARC Bibliographic. I hear this was well-received at the MARC Formats Interest Group session at ALA Midwinter in Dallas in January, with questions like “When are you going to do the same for MARC Holdings or MARC Authority?” Well, we’re thinking about it …

    Meanwhile, I’ve been looking to see what low-hanging fruit can be plucked from the MARC tree of knowledge. The obvious place to start was the fixed-length data fields tagged as 006, 007, and 008. These have the least complicated mix of syntax and semantic, with no indicators or repeatable subfields to worry about. And there are value vocabularies associated with the coded content, so linked data triples with object URIs are a possibility.

    The main complication is the dependency of the codes on the category of material, recorded in the MARC21 record Leader. This introduces a decision node in the process of recasting legacy metadata as RDF triples; it determines which code sets, and therefore value vocabularies, are being used. For all level 0 elements, the property URI is constructed mechanically from the MARC21 coding, so the decision only affects the choice of value vocabulary to be used as the object of the data triple.

    The results are encouraging. Here’s a simple example from the record for “Legacy” by Roderick Buchanan, taken from the main catalogue of the National Library of Scotland. It has just a single 008 tag:

    @prefix m2100x: <http://marc21rdf.info/elements/00X/>.
    @prefix m21terms: <http://marc21rdf.info/terms/>.
    ex:1
    m2100x:M00806 m21terms:alltyp#s ;
    m2100x:M00807-10 "2011" ;
    m2100x:M00815-17 <http://id.loc.gov/vocabulary/countries/enk> ;
    m2100x:M008BK29 "0" ;
    m2100x:M008BK30 "0" ;
    m2100x:M008BK31 "0" ;
    m2100x:M008BK33 m21terms:booklit#0
    m2100x:M00835-37 <http://id.loc.gov/vocabulary/languages/eng> .

    Extending the object URIs to their labels gives the RDF graph:

    A more complicated example is the CD version of Abbey Road by The Beatles, with one 006, two 007, and one 008 tags in a record from OCLC WorldCat:

    @prefix m2100x: <http://marc21rdf.info/elements/00X/>.
    @prefix m21terms: <http://marc21rdf.info/terms/>.
    ex:5
    m2100x:M00600 m21terms:formofmaterial#m ;
    m2100x:M006m09 m21terms:computertyp#u ;
    m2100x:M00700 m21terms:cat#s ;
    m2100x:M00700 m21terms:cat#c ;
    m2100x:M007c01 m21terms:electrosmd#o ;
    m2100x:M007c03 m21terms:electrocol#c ;
    m2100x:M007c04 m21terms:electrodim#g ;
    m2100x:M007c05 m21terms:electrodsnd#a ;
    m2100x:M007s01 m21terms:soundrecordingsmd#d ;
    m2100x:M007s03 m21terms:soundrecordingspd#f ;
    m2100x:M007s04 m21terms:soundrecordingcpc#s ;
    m2100x:M007s05 m21terms:soundrecordinggro#n ;
    m2100x:M007s06 m21terms:soundrecordingdim#g ;
    m2100x:M007s07 m21terms:soundrecordingwid#n ;
    m2100x:M007s08 m21terms:soundrecordingtap#n ;
    m2100x:M007s09 m21terms:soundrecordingkin#m ;
    m2100x:M007s10 m21terms:soundrecordingmat#m ;
    m2100x:M007s11 m21terms:soundrecordingcut#n ;
    m2100x:M007s12 m21terms:soundrecordingspc#e ;
    m2100x:M007s13 m21terms:soundrecordingcap#e ;
    m2100x:M00806 m21terms:alltyp#r ;
    m2100x:M00807-10 "2009" ;
    m2100x:M00811-14 "1969" ;
    m2100x:M00815-17 <http://id.loc.gov/vocabulary/countries/cau> ;
    m2100x:M008MU18-19 m21terms:musicfoc#rc ;
    m2100x:M008MU20 m21terms:musicfom#n ;
    m2100x:M008MU21 m21terms:musicpar#n ;
    m2100x:M008MU33 m21terms:musictra#n ;
    m2100x:M00835-37 <http://id.loc.gov/vocabulary/languages/eng> .

    This yields the (partial) extended RDF graph:

    The MARC Bibliographic manual says “Coded data elements are potentially useful for retrieval and data management purposes“. Any graph connecting to these examples can use them for retrieval, provided the resources URIs ex:1 and ex:5 are linked to the location of one or more copies. For open online resources this might be sufficient, because the resource is a “link” away. For physical resources, more information is required to get access (retrieve), including basic human identification attributes such as title, author, and edition. That additional data is usually present in the MARC21 variable data fields, and I’ll discuss it in a future blog post, but it doesn’t have to come from there. So what we need are stable URIs for the resources ex:1 and ex:5, and some triples containing location information for copies. OCLC has a lot of that data in one place. Next most helpful are standard identifiers such as ISBN and ISSN, because they will help to link to graphs from the publishing, bookselling, and reading communities. Then some title, author, and edition information would be nice …

    It would be very useful if national, regional, or international cataloguing agencies could get it together to put this on their agendas, soon.

    Finally, notice the “0” values in ex:1 and the “not applicable” value in ex:5. The MARC21 fixed-length data fields support theOpen World Assumption, unlike the MARC/AACR record as a whole, which definitely uses the Closed World Assumption, for example by not recording a first-edition statement.

  • What DCMI Should Be Doing

    One continuing theme of the recently concluded DC-2010 is that of the perpetual search for consensus on what the hell DCMI should be doing. I know this continual search for identity is a common phenomenon with this sort of organization, as it is for the human adolescent hovering around the age of 15 years. Like with the teenager, it should be seen as a healthy thing, and as most of us older than 15 know, it pretty much goes on for the remainder of life.

    For me the conference was preceded by a half day DCMI Advisory Board meeting, where one topic was the revision of the DCMI mission statement as well as the perennial topic of the conferences and how the conference series can be optimally funded and continued, and what exactly is its value for the organization. As usual, there was not much consensus, either at the beginning or the end of the discussion, though it must be said that the conference itself probably shifted some opinions about the value proposition. Generally the AB meeting has been scheduled after the conference, with the idea that this shift in perspective is a good thing for sparking discussion, but for logistical reasons the meeting was held prior to the conference this year.

    As it turned out, this change in placement of the AB meeting was unfortunate, given that Mike Bergman’s keynote on Friday morning contributed some important outside opinion to that basic question of mission. (Mike’s post about the keynote is here.) The fact that Mike arrived in time to sample a good chunk of the conference and to talk to a variety of participants gave his opinion the credibility that only exposure to the culture of the organization and the personalities that affect that culture can bring to a keynote. It was clear to me, in talking to him during the conference, that his view of DCMI was not the insider view of a contentious, financially strapped and sometimes dysfunctional organization, but instead one that included recognition of the experience, knowledge and potential there as well. In a nutshell, Mike Bergman was telling us that DCMI’s role in the emerging linked data world was critical, and should be focused primarily on expanding the presence of useful semantics available to the the web world, closing the ‘semantic gap’ he sees limiting the growth of linked open data.

    Later in the day, my task was to lead a discussion of the work of the DCMI/RDA Task Group, of which I’m co-chair with Gordon Dunsire. Gordon and I had both prepared slides for that meeting—mine covering the history and work of the task group, what we’d learned, and what remained, and Gordon’s covering the related important work he’d been doing in parallel with IFLA. I’ve been frustrated for some time with the lack of attention and traction we’ve received for this important work, both from DCMI and the Joint Steering Committee for the Development of RDA (JSC). We have found ourselves at the stage where DCMI is waiting for JSC to make some statement about the work done (in the form of approval), and the JSC is waiting for DCMI to endorse the Task Group’s assertions made about the work done and its usefulness for the Semantic Web—or at least this is the way it seems from the point of view of the co-chairs. It’s as if both groups are standing opposite one another in a middle school gym, the ‘boys’ and the ‘girls’ waiting for someone to move towards the middle. Nobody seems to want to make that first move, and though in the case of the TG, each conversation with representatives of both parties seems to be positive, resolution of the concrete issues moves at a frustratingly glacial pace.

    But as I spoke about this work to various people, continuing to think about the ongoing conversation about what the role of DCMI should be, particularly in the context of Mike’s keynote, it struck me that the DCMI/RDA Task Group was in some sense a model for what DCMI could do to fulfill the role Mike saw for us in the world. In essence, the TG came into being because Don Chatham at ALA Publishing took the initiative to bring DCMI and the JSC together, where the DCMI message was “How can we help?” The rest is history, but we seem not to have learned from that how powerful that simple question is, and where it could lead. DC-2010 brought a number of new communities to the conference, representing a variety of groups interested in moving into the wider web world of information, but lacking in-house knowledge and skills necessary to make progress. Helping them move forward requires much more than attracting them to the conference and talking to them in the hall or after tutorials. We need to offer more concrete help, like we did for the JSC, and move the knowledge and experience that the DCMI Community has assembled into the broader world of information.

  • Live (ish) from DC-2010

    This morning’s highlight was Stu Weibel’s opening keynote address to the assembled conference attendees (yesterday included primarily workshop sessions and tutorials). Stu was asked to talk about DC’s past and future, and he gave many of us food for thought.

    The first thing he did was typical Stu—he took a photo of the assembled group. I hope those will show up on his blog sometime soon (if so I’ll link to them). Will they look that much different from those he took 15 years ago, when Dublin Core began, or those taken at various points along the way? As is also typical, he asked how many people were returning participants in DC, and how many were brand new to the DC conference. Surprising to some of us, roughly one third of the group were new participants, a nicely healthy proportion of new people.

    Stu asked some interesting questions, and gave DCMI some letter grades for performance in a number of areas. His first question, “Why didn’t we just stop after the 15 elements” suggests the possibility that nothing done since then (the mid-nineties) was worth the effort. He points out that a number of the assumptions made at that time have since been repudiated by experience—the Web is more than just a collection of document-like-objects that can be described in much the same way that we’ve traditionally described library materials. He got a laugh when he reminded us (including the three of us who were actually there in Mar. 1995 when DC was born) that we thought we could solve the syntax problem fairly easily—but of course our notion of syntax in those days was HTML.
    Stu gave some personal assessments of the 15 years of DCMI in the form of grades:

    For providing an international basis for the effort (A)
    For including a diverse group of participants (B+)
    For becoming a sustained and solvent organization (D)
    Moving work from consensus to completion (C)
    Establishing objectives and completing them (C-)
    Documentation of decisions (B+) (I have to say I think he was somewhat over generous on this one, for reasons I’ll explain later)

    Stu also pointed out the places DCMI got stuck along the way, among those were ‘tarpits’ (his word) of our own making—for example, data models (for which he gave DCMI an ‘F’). Those that were not our fault or not entirely of our making were things like the aforementioned syntax confusion (C+), which he believes stemmed from trying to do too much and getting overwhelmed (probably the rapid evolution of syntaxes had an effect, too). The ‘tarpits’ created by others included LOM (learning object metadata, promulgated primarily by IEEE), and INDECS (a now dead effort that was touted some years ago as a business model based approach).

    Some other points Stu made which are hard to argue include the notion that cooperation with organizations with different business models is difficult, but such cooperation is critically important, for reasons around convergence of effort, identification of similar models and related technologies—all amplifying the network effect of what DCMI has done. Increasingly, cooperation is seen as an expensive value, particularly in terms of time and travel, and certainly DCMI has seen those issues having a big effect on conference planning and ability to build on past efforts. Stu also gave DCMI an ‘A’ for its standardization efforts, including the work to make DC a recognized standard via IETF, NISO, and ISO. He pointed out that these efforts were essential to allow DC to be adopted by government agencies and others that have requirements for such an endorsement.

    On the Singapore Framework, Stu is dubious, in particular thinking of the four levels of interoperability [link] that include the Description Set Profile (DSC) and the Dublin Core Abstract Model (DCAM). He pointed out that lots of metadata is still used primarily at the lowest, human level, and is not yet useful to machines at the moment. This issue is particularly relevant given that the DCAM is currently under review, with opinions flying around (in the halls, on twitter, etc.) in ways they didn’t even when that document was new, and pretty much nobody understood it. Understanding is still an issue, to a great extent because specification and user documentation are not the same thing (something that the DCMI technical folks don’t seem to understand). Stu contends that the DCAM has failed, and felt that its authors still don’t agree about its motivations or implications. It will be interesting to see whether that assessment is widely held throughout the conference.

    On linked data, Stu was clearly somewhat ambivalent, calling it “An aspirational target of great promise and unproven benefit”. Stu was around and in the fray when the RDF standard was still in diapers, and recalled for the audience how easy we all thought it would be then to bring its promise to fruition. At least a decade later, we’re still trying to do that.

    In Stu’s opinion, the Web is the data model, and we shouldn’t deviate from it. He pointed out that with the issues of flexibility vs. constraints we are drawn in by the Siren Call of Flexibility but would be better off with more constraints.
    On the positive side, Stu points out that the linked data bulge has brought us a strong commitment to identifiers, some useful conventions about vocabularies and syntax, some tools to build ontologies and models, and some expectations of utility due to broad adoption – network benefits, in other words. But we still need to worry about data quality, usefulness, and bridging the boundaries between the existing semantic communities.

    Stu is skeptical of linked data as the new grail, but still thinks we’re on an exciting threshold—we need metadata more than ever, but we’re drowning in it. He quoted Tom Baker: “Data that cannot speak for itself will be more vulnerable to becoming irrelevant”.
    Stu’s last points covered DCMI as an ongoing experiment in social engineering. He cited Malcolm Gladwell’s article in the Oct. 4 New Yorker where Gladwell asserts that social media are largely broadly disseminated, networked, weak tie activities, with low barriers, low commitment, low persistence. Gladwell contends that systemic change requires strong ties, hierarchical social structures, leadership organization, and f2f work. Stu believes that DCMI is a strong tie phenomenon, and its impact is amplified by this fact.

  • Tectonic shifts

    One of the things that always happens for me after ALA is a compiling of notes and some reflection on what I saw and learned while in the whirlwind of meetings and activities. This year is no different. There were few real surprises—after all, like most of you I keep in pretty good touch with what others are talking about and thinking about all through the year. But in those areas where I play the closest attention, I’ve seen some important shifts in thinking, and it’s at the meetings at ALA that I see those shifts playing out. Another thing I like to do after conferences is to look and see what other people are saying about the meetings. Sometimes this helps me catch up with meetings I couldn’t attend, sometimes it gives me different perspectives on ones I did. One such post was Eric Hellman’s post about the linked data meetings at Annual on his blog, ‘Go to Hellman.’

    “I’ve been at the American Library Association’s Annual Meeting this weekend. Given the common purpose of libraries and Linked Data, you would think that Linked Data would be a hot topic of discussion. The weather here has been much hotter than Linked Data, which I would describe as “globally warming”. I’ve attended two sessions covering Linked Data, each attended by between 50 and 100 delegates. These followed a day long, sold-out preconference. John Phipps, one of the leaders in the effort to make library metadata compatible with the semantic web, remarked to me that these meeting would not have been possible even a year ago. Still, this attendance reflects only a tiny fraction of metadata workers at the conference; Linked Data has quite a ways to come. It’s only a few months ago that the W3C formed a Library Linked Data Incubator Group.”

    In the same conversation where Jon made his point about the the increase in interest in linked data over the previous year, I tried to convince Eric that the work we’d done on the RDA Vocabularies was a step in the ‘warmer’ direction, but I clearly didn’t make my point, to him, at least.** I think, though, that the ‘tiny’-but-growing fraction of metadata workers (both at the conference and not), are starting to get the point. It’s not an easy point to get, if you’ve been traditionally trained as a cataloger or not exposed to much of this work. I hope that the formation of the Library Linked Data Incubator Group will be very useful towards this end—ironically one of the arguments against a part of our work on the RDA Vocabularies, primarily from the more conservative members of the library world, is that as librarians, we’re not in a position to know what the Semantic Web wants and needs. If nothing else, the LLDIG will make those needs known, and we hope, do that as clearly as possible.

    Eric went on to talk about the follow up to the preconference:

    “On Friday morning, there was an “un-conference” organized by Corey Harper from NYU and Karen Coyle, a well-known consultant. I participated in a subgroup looking at use cases for library Linked Data. It took a while for us to get around to use cases though, as participants described that usage was occurring, but they weren’t sure what for. Reports from OCLC (VIAF) and Library of Congress (id.loc.gov) both indicated significant usage but little feedback.”

    I was at the ‘unconference’ as well and participated in different breakout sessions than Eric did, but found them very useful to my own thinking (summaries are posted). Plans are in place to do additional follow up to those conversations at the Dublin Core Conference this fall, and then at Midwinter in San Diego. In particular I participated in a session led by CC:DA chair John Myers about increasing the understanding of the library community generally in regards to the ideas and technologies of linked data. As someone who frequently speaks at conferences and workshops, I believe this is a particularly important issue as the abstract ideas become understood and the implementation questions become more compelling. As a result of that discussion, I’ve been thinking seriously about developing a new workshop that I would attempt to take ‘on the road’ to groups and institutions. Given that my previous experience with doing this kind of thing in collaboration with institutions has been mixed (my discouraging experience with my Metadata Standards and Applications workshops comes to mind), it seems to me that it’s time to try doing it on my own, and, ensuring as well that I’m getting adequate compensation for the time spent providing it.

    I’m hoping that I’ll be able to rely on interested members of the community for feedback as I think through the process of developing this kind of workshop. Watch this space for more …

    ** More about the building of the vocabularies can be found in our article in the January issue of DLib Magazine.

  • Non-sequiturs

    Corey Harper seems to have started a collection of statements taken out of context, some of which I’ll share here:

    “If it’s not fish it has to be linked data” –Jennifer Bowen

    “I’m too far underground to know where I am” –Jon Phipps

  • The curmudgeon’s table

    Today I participated in a Linked Data Unconference at ALA 2010 in Washington DC, which was remarkably successful. Organized by Corey Harper from NYU and ably moderated by Karen Coyle, about 50 of us held two sets of three hour-long, highly engaging breakout discussions with reports back to the larger group. I participated in a discussion of some of the practical difficulties encountered trying to implement Application Profiles in a far from perfect Linked Data environment (I strongly recommended creating a local mirror of inadequately expressed in RDFS/OWL, but otherwise useful, data models) and a discussion of scholarly Linked Data use cases and data reuse (we looked hard at VIVO and VIAF and discussed metering data usage). It was fun! I was surprised.

    Afterwards a few of us had a fine lunch together, discussing the nuts and bolts of RDA and the future of cataloging, a lively and fascinating discussion in the best possible sense of ‘lively’ and ‘fascinating’. It strikes me in retrospect that we formed a kind of curmudgeon’s table — Diane Hillmann, Corey Harper, Eric Hellman, Ed Summers, Karen Coyle, and me. All of us sharing strong opinions, agreeing and disagreeing whole-heartedly and with considerable good humor and affection. A table of warm and engaged people, knowing that it’s too late to save the world, maybe too late to save cataloging, but it would still be really interesting to try. It was great fun. I wasn’t the least bit surprised.

  • The RDA Vocabularies, Continued

    One of my favorite aphorisms is “Time flies, whether you’re having fun or not.” I’m not sure where I heard it, but for sure I’m not creative enough to make it up on my own. The truth of it has been reinforced by the realization that here it is the end of January, post-Boston Midwinter, and I’ve done so little blogging for the past six months that it’s a stretch to call myself a blogger. Time to reclaim the turf. So this post is an attempt to summarize what I’ve been doing all that time, some of which has come to a sort of fruition, but some still ripening.

    Last fall I participated as a speaker in a NISO Webinar “Bibliographic Control Alphabet Soup.” I decided for my topic to talk about some of the issues around building the RDA vocabularies from spreadsheets and ERDs (Entity Relationship Diagrams), which is what I had to work with on that task. (You can see the ERDs on the RDAOnline website). Part of my reason for trying to tackle those issues in the webinar is that the vocabularies had become a major focus of my working life for quite a while (does the word ‘obsessive’ sound too dramatic?) At the time, we (Jon Phipps, Karen Coyle, Gordon Dunsire and I) were also trying to write an article about what we’d done with the RDA elements and vocabularies, and that article came out last week in DLib Magazine. Starting the article last fall prompted me to create some diagrams in an attempt to try and convey the structure of these vocabularies, and to provide examples for folks to look at while they puzzle through the ideas. I used a subset of the diagrams in the webinar as well, but most of them are used to better purpose in the article. I’m not at all sure that the several hundred folks listening in to the webinar got much of what I was trying to convey—it’s pretty new stuff for most people, and I was trying to fit too much into my limit of 20 minutes (not nearly enough time). I hope that for those who might have been overwhelmed or confused by the webinar, the article will help to make the work we’ve done a bit clearer.

    The writers of the article had a number of purposes in mind, not least to document the decisions and rationale for the strategies taken by the DCMI/RDA Task Group charged with the work of building the vocabularies. Given that the library community generally has little experience with RDF and RDF vocabularies, it seemed particularly important to attempt to provide explanations that we hoped would be accessible to most librarians, and I hope we’ll have sufficient feedback to determine how close we came to that goal. Given that we expected the article to come out just after Midwinter, we did most of our presentations in Boston on the implications of the vocabularies rather than the mechanics. I talked about these at the Technical Services ‘Big Heads’ meeting (slides) and Jon, Karen and I included some of these expectations in our introduction to application profiles at CC:DA on Monday (slides).

    Just before Midwinter we started a dialogue with the JSC about next steps, and I hope that some of the issues that have come up will be open to public discussion, just as the vocabulary building was done in public. We’re all in a fairly intense learning space at the moment (at least it seems so to me), and keeping the process open and visible for all seems in support of that learning. We’re also continuing to update the vocabularies as errors are brought to our attention, and to complete portions where we need to add information. One such point in the property/subproperty hierarchies in the element sets—at the time the work was done there was a limitation in the Registry software that prevented us from including the proper hierarchies in both the general and FRBR-bounded portions of the vocabularies. That limitation is now removed, and the missing relationships will be added.

    Interestingly, we’re getting lots of help in finding errors from our friends in Germany, who are doing nifty things with the vocabularies. They’ve been particularly helpful with things like inadvertent spaces introduced in URIs and other things difficult for a human proofreader to find. Because we don’t have good ways (yet) to visualize the relationships, their help has been invaluable. We urge anyone else who spots an error or who has a question to use our feedback button in the Registry to communicate with us about their concern.