Tag: rda vocabularies

  • The Conundrum of Research Funding

    I think I mentioned somewhere that one of my current projects is a part of the NISO Bibliographic Roadmap effort to develop vocabulary best practices in the areas of use/reuse, documentation and preservation. The project itself builds on a full-day vocabulary workshop brought together at the DCMI conference in 2011.

    I share co-chair duties on the Use/Reuse subgroup with Daniel Lovins of NYU, but as we’ve all moved along on this project, the overlaps between the three subgroups tasked with writing the best practices documentation (the other groups are tasked specifically with documentation and preservation) becomes more and more apparent. We’ve determined that our final recommendations will be made together in one document, rather than spend our time trying to untie the Gordian Knot that is vocabulary issues in toto.

    At some point I fielded a question from one of the group members about the difference between vocabulary maintenance and vocabulary preservation. It was a great question, and one that I hadn’t really thought much about. To some extent each topic has a basic assumption: for a vocabulary being actively maintained, preservation isn’t much of an issue. But when, for whatever reason, the vocabulary ceases being actively maintained, preservation becomes the issue. One question the Roadmap project is trying to address is how to tell the difference, given the dearth of data generally provided about the who, how and when of ownership and management of vocabularies, much less what policies and practices are being followed. There’s a whole range of issues around preservation: how it should be done and by whom, and what kind of context to wrap around the supine resource.

    In some respects, the problem of vocabulary preservation is not easily separated from issues around the loss of funding for projects building vocabularies as well as vocabulary development or management tools, almost all of which were initially developed by funded projects. This suggests we have a preservation problem built on a sustainability problem. The report draft as it stands cites several projects which were initially funded in whole or part to address issues around vocabulary provision, in particular research or practice communities, but have not received funding to build out or maintain their tools or their resources. This is a significant issue, given that without the ability to maintain the infrastructure supporting the structural or conceptual vocabularies required to describe resources being aggregated or distributed, there is no such thing as proper distribution or maintenance of any data resources. Consider how many projects are now being funded to consider the problems of ‘big data’, particularly scientific research data, all of whose solutions depend to some extent on metadata vocabularies.

    This concern is not that different than what we hear constantly about the physical infrastructure supporting our transportation systems, crumbling in ways not dissimilar to our data distribution systems (although without the scary safety implications). Many of us on the academic side of these questions take it for granted that funding comes and goes, and consider not the longer-term implications of these ebbs and flows and how funding agency priorities (generally focused on innovation rather than maintenance) affect the vocabulary environment. But it remains clear that a big reason we talk about vocabulary preservation is because there are long-term implications of depending on funded projects to build and maintain the infrastructure around vocabularies as well as the vocabularies themselves.

    I speak from experience on this issue. The Open Metadata Registry (OMR) was built on funding from the US National Science Foundation (NSF), and when its funding ended in 2007 should have died the death of most such project based tools. That it didn’t is due almost entirely to the fact that it was built by two very stubborn people who were pretty hooked by the usefulness of vocabularies. For several years we searched in vain for additional funding, but at that time funding was scarce, and what little there was went to much sexier undertakings. For much of that time the OMR survived on a ‘too cheap to fail’ strategy, where early grant funding had paid ahead for long-term costs of server space and basic technical upkeep.

    As far as I know, the OMR is one of the only free general-purpose vocabulary development and maintenance tools that has survived past its initial funding. At this point a large percentage of the library worlds’ vocabularies are maintained using the OMR, and although it is built to enable all of them to migrate at any time to another repository or tool, there is not currently much of anything available for them to migrate to. This suggests that sustainable funding is a far more critical issue than we’ve yet considered.

    At present the OMR developers are setting up a proposal for funding a sustainability plan for the OMR, to spend the next 2-3 years bringing it up-to-date as a viable, community-driven Free Open Source Software project with long-term institutional support for its infrastructure, so it can be maintained after our retirement. If the plan works, the OMR will remain a place where vocabularies will be safe, secure, and maintainable, with room for maps and application profiles using those vocabularies. Other commercial and research-based options are still there, but not necessarily friendly to limited budgets or organizations with limited technical support.

    During the later days of the National Science Digital Library (NSDL)–under whose aegis the OMR was developed–the NSF began to include requirements for sustainability into their grant process. I don’t know how many other granting agencies mandate those kinds of requirements, but judged by huge amounts of the abandoned detritus of decades of research funding, certainly more should.

  • If We Were Asked

    If we were asked (as we sometimes are) what we’d like to see develop as a result of the BibFrame effort, the emphasis in our answer would have both technical and social aspects.

    First, given the technologies developing in several different places and considering what we can do now to bring Linked Open Data into our somewhat closed world, some concrete suggestions: We have the ability to share metadata expressed not just in a single common ‘vocabulary’, but to share it using many different vocabularies, expressed and distributed using RDF, OWL/RDFS, RDFa, Microdata, and other tools; we have methods of specifying the use of these ‘semantic’ building blocks (DC Application Profiles and emerging provenance specifications from W3C and DCMI) that allow machines to use, process and distribute data in ways that do not require a central enabling node; and finally, we have technologies and strategies in place to map between existing and prospective metadata schemas that flatten the fences between communities quite thoroughly.

    This is the post-MARC world of library-related metadata, where the format native to our metadata is no longer its most important characteristic; there’s no lossy crosswalking requirement to transform data to serve different needs; and there are fewer (eventually no) barriers to sharing. The tremendous value that MARC represents–the semantics built over many decades in response to an enormous corpus of use cases (all of which are fully documented on the MARBI site)–continues to be vitally important as we move into a different arena. But the mid-20th century requirements that dictated the MARC syntax, and the constricting consensus model that has been required to maintain it, no longer apply to the current and future requirements of the global library community.

    The usual caveats apply here–some of these technologies aren’t entirely ready for prime time, but in the world we live in, ‘finished’ is more likely to be used for something defunct rather than a goal for standards and tool development. The areas we’re personally most familiar with (no surprises here) are the complementary domains of vocabulary management and mapping. The first of those is up and running (although the ‘continuous improvement’ engine is going full bore) as the Open Metadata Registry; the second, mapping, is an important interest of ours and has generated papers, articles, and presentations (see below for a selection), not to mention the usual plethora of posts to blogs (including this one) and discussion lists. We believe that the OMR and mapping capabilities under development work together to enable legacy data to shift into the open linked data world efficiently, effectively, and with a minimum of loss, in the process enriching the useful data options available for everyone.*

    Often overlooked in the glitter of technology is the possibility of pulling together the communities that were torn asunder as a result of past technical limitations (and other reasons). In our common past, the library community built their data sharing conventions on a platform based on the consensus use of AACR2 and MARC. Some library communities–law and music the most prominent–were willing to compromise in order to work within the larger library community rather than strike out on their own. Others, like the art library and museum community and the archivists, did make the break, and have developed data standards that meet their needs better than the library consensus was able to do. But those specialized standards have resulted in yet more silos, in addition to the huge MARC one.

    If the intent is to ‘replace MARC’ (as it is at some level), it’s about re-placing MARC and its built-in limitations from the center of our world back into the crowd, where it becomes one-among-many. Also a value in that shift is the ability to expand the data sharing environment MARC enabled a half century ago to a broader community of interest that includes museums, publishers, and archives. Meeting the goal of dissolving those silos and making our data easily understandable and reusable in a host of ways will help initiate that ‘Web of Data’ we’ve been anticipating for many years. As Eric Miller explained so well in his Anaheim BibFrame update: by moving towards a linked data world we actually look well beyond the Library/Archives/Museum worlds by definition–it’s a very big world out there. But by collaborating with the LAM community as a whole to get there, we reap a great many benefits, not the least of which are perspectives that are much broader in some significant ways than ours. Limiting our view merely to a ‘MARC Linked Data Model’ might be an important beginning step, but it falls short of where our vision needs to extend.

    And the fact is that MARC will not be going away for a long time, if ever. There will be a lot of variation in how the transition is done by libraries, depending on institutional support, short term and long term needs, and existing partnerships. The process of moving MARC into the linked data world has already started. RDA and its RDF vocabularies was a start, as is the development of a complete RDF version of MARC, located at http://marc21rdf.info. Several years worth of pre-conferences, presentations and discussions, at ALA and beyond, have prepared the soil for these changes. But we need a plan, and some concrete steps to take–steps that include the groups who have been working in the trenches without a great deal of support, but making progress regardless. The BibFrame effort needs to be more than a playground for the technologists, because in most instances, the technology is not what’s holding us back–it’s the institutional inertia and the difficulties of finding ways forward that don’t pit us against one another. The plan we need balances the technical and social, the quick-win with the long-term momentum, and the need for speed with the public discussion that takes time and builds buy-in.

    What we have in our sights is an opportunity to reverse the long term trend towards balkanized metadata communities and to make the future one for which there are fewer fences between, and more data exchanged among these three communities with obviously similar challenges and interests. We think the time has come to use the vastly changed technology environment to do that.

    *It would be too easy for a response to this post to be in the form of “Oh, you’re just tooting your own horn here,” and indeed we are in some measure doing that. But we do this work because we believe it’s important. We don’t believe it’s important merely because it’s what we do. We believe in the value of the work we’ve done and will do, and we see a great deal of relevance for it as part of the BibFrame discussions.

    Selection of papers, and presentations:

    Jon Phipps’ presentation on mapping at ALA Anaheim
    A Reconsideration of Mapping in a Semantic World / Gordon Dunsire, Diane Ileana Hillmann, Jon Phipps, Karen Coyle
    Gordon Dunsire’s presentation at the recent London meeting “RDA, 5 years on”

    Post written by Diane Hillmann and Jon Phipps.