W3C Vocabulary Services

In order to promote the widespread interoperability of data, the W3C is beginning to offer a set of services to help people select, create, and maintain IRI vocabularies useful for creating reusable data. These vocabulary management services will build on existing W3C activities to create a sustainable community of people creating, maintaining, and using vocabularies for data sharing.

Introduction

Effective data sharing requires people or systems to know how elements in a dataset are supposed to be understood. For example, a csv file can only be used by people who know what the column headings mean. When software is written to collect and analyze data, its developers need to understand these structural elements. When data is coming from many different sources, the data producers have to agree on structural elements (column names) or else the data consumers have to analyze and then write code for each different style.

One technique for addressing this problem is to use web addresses (URLs, URIs, or more recently IRIs) as identifiers for elements of the structure (eg column headings). This establishes a single authoritative source of information about the identifier's meaning — the web page — while still allowing everyone who can create a website to create as many new identifiers as desired. It also allows people to easily and unambiguously refer to the identifiers, for example when recommending them to a colleague or asking a question about the meaning.

While this use of IRIs has been adopted in some technical communities, there are several barriers to wider adoption:

• Cost of collaboration. Creating a vocabulary of identifiers that will be suitable for a range of applications usually requires input from a range of people. Finding and organizing the people with expertise in the domain of the vocabulary is one challenge; finding people with expertise in creating vocabularies is another. The result is often vocabularies developed by one or two people and suited only for narrow audiences.

• Maintaining a website. In practice, creating and maintaining a website for your identifiers can be difficult. Many organizations structure their website around marketing requirements, not this kind of technical work, and the people who need to create new vocabularies of IRIs have little immediate motivation for creating a public-facing site for their work.

• Lack of market information. There is no definitive listing of vocabularies, so it can be hard to determine whether a vocabulary for a particular purpose might exist. Even when one or more candidate vocabularies are found, it can be hard to find out how suitable they are: who else is using them, what are the relative strengths and weaknesses of the design, what software exists to support them, etc.

With the growing world-wide demand for data interoperability, these barriers are becoming increasingly problematic. Fortunately, W3C is well-positioned to address these problems. The vocabulary services outlined below build on existing W3C services and strengths. These services will make it much easier for people to obtain high quality vocabularies and help create new ones; this in turn will promote data sharing, reuse, and interoperability.

In general, these services are inexpensive to provide and can be offered for free to the public. W3C may, however, decide to charge for certain services and/or limit their use to W3C members.

Vocabulary Groups

Summary: We will promote the use of W3C Community Groups for gathering people interested in developing and maintaining individual vocabularies, and we will form a Vocabulary Review Group to help guide others in creating better vocabularies.

W3C has several different kinds of groups, including Community Groups (which can be created by anyone with just four other interested people), and Working Groups (which are created after a review process by the W3C Advisory Committee). For creating or maintaining a vocabulary, Community Groups are likely to be the preferred option, because of their lower financial and procedural overhead.

One drawback to Community Groups (in contrast to Working Groups) is that without W3C staff to help guide them, their progress depends on their leadership figuring out, on their own, how to make a new standard vocabulary. To reduce this burden and draw in people to use Community Groups, we will create a guide to developing vocabularies at W3C.

In order to further help people, particularly on the technical aspects of the process, we will form a cross-domain group of experts prepared to examine vocabularies and give suggestions, a Vocabulary Review Group. We plan to create this group by re-targeting the WebSchemas (public-vocabs@w3.org) group. That group was created as a public forum for discussing and reviewing new vocabularies and vocabulary extensions, but it was initially motivated by just the schema.org vocabulary and since then has largely focused on that one (large) vocabulary.

With help from the chairs and schema.org, we intend to rename the group and clarify the mission. The new Vocabulary Review Group will be charged with helping people produce high-quality vocabularies by examining ones that are submitted and offering advice. Depending on interest within the VRG, these reviews might by performed by the entire VRG (eg during a teleconference), by a subgroup, or by individuals who volunteer. The advice may be public, and become part of the information people consider in deciding whether to adopt a vocabulary. The VRG will not, however, be a decision-making body, and such advice will be attributed to particular individuals (perhaps with other individuals concurring or dissenting), not the VRG as a whole.

Vocabulary Hosting

Summary: We will promote and clarify the existing policy of giving www.w3.org/ns space to any W3C group, including community groups. The goal is to allow vocabularies useful for open data interchange to be hosted by W3C and maintained by the people who care about them.

The longstanding W3C policy has been to give out namespaces (web space for vocabularies) upon request by any W3C group, including Community Groups and Business Groups. In practice, few groups have taken advantage of this policy. It is not widely known, and the process for updating the namespace document (the vocabulary website) is not specified. With this in mind, we intend to publicize this service and automate the namespace document publication process.

Specifically: the chairs of W3C groups, including Community Groups, will have access to a web form which allows them to reserve and update namespace documents, should they choose to have their vocabulary hosted by W3C and managed according to its policies. The form will require the chair to confirm having several facts, including:

1. Your group has agreed to publish this new version, as per your stated decision policy
2. You and your group are acting on behalf of W3C as stewards for this vocabulary, helping maintain it on behalf of existing and potential users around the world.
3. You believe this change will do no harm to W3C or to existing or potential users of this vocabulary. (This includes: you have not removed any terms once people have started using them.)
4. If this change is non-trivial, you have asked for review from public-vocabs@w3.org and your group has been responsive to all comments.
5. The group has made reasonable efforts to include labels and documentation in multiple languages and is prepared to add multilingual labels and documentation offered by users of the vocabulary.

When the system publishes the documents, it will add prominent notice of the status (not being endorsed by W3C) along with instructions for how to give feedback. At some point this interface may be expanded to provide software tools which support group development of vocabularies.

This service provides both an easy-to-maintain vocabulary website and an institutional commitment to maintain that site as long as people are willing to participate in W3C groups to do the work. This second feature — a strong persistence policy — is essential to some potential vocabulary users, and we will continue exploring ways to make it even stronger. Options include establishing institutional backup relationships (what happens to w3.org if W3C shuts down?) and allowing vocabularies to be hosted on other domains so they can be transferred if there is community consensus that the work is better done away from W3C.

Vocabulary Directory

Summary: We will collect, maintain, and distribute information about all available vocabularies, with the aim of helping people identify and decide among alternatives. This will be an open data application, freely interoperating with related information services.

Even though at present vocabularies are generally available free of charge, we may consider vocabulary adoption as a market, with "consumers" trying to identify "products" and choose among them. From this perspective, consumers in the current vocabulary market have very little information about available products and their features. This is hardly surprising: there is little or no "advertising", there no simple business case for "retailers" to attract and guide consumers, and there is little available "product information" as might be printed on a package.

The current market has had some "retailers" who have since gone away (schema.net), some promising newcomers (LOV), and some successful efforts in subdomains with available funding (BioPortal). We plan to improve the flow of information in this market in two complementary ways:

1. Vocabulary Directory Website. We will provide a "retail" website where people can maintain and search listings of vocabularies (wherever they are hosted), along with useful metadata ("product information"). Metadata may include simple endorsements ("like", "+1", star ratings) and more detailed information like reviews, the list of open/closed issues, and the list of public users/implementations.

2. Vocabulary Market Database. The directory will be an open data application, making its internal data available for others and consuming data feeds from others. People who have existing metadata will be able to easily provide it to the directory, and people will be able to create new interfaces for exploring and exploiting the data.

This will be a development project involving both developing software and developing metadata vocabularies. W3C staff effort will be partially supported by external funding, and we will work with volunteers/partners. The software will be open source and the vocabularies will, of course, make use of the vocabulary management services described above, using a Community Group and review by the VRG. Because this is likely to be work of interest to many members of the VRG, we expect a particularly detailed consultation process.

Using an open data architecture for these services is important not just as a validation and demonstration of the underlying technologies, but because it keeps down the barriers to entry for everyone, everywhere, trying to share data. Where a traditional closed directory acts as a bottleneck, potentially stifling new approaches and dissuading people from participating because of uncertainties in how that directory might be run, an open directory welcomes everyone to participate — listing new vocabularies, adding information about vocabularies, and creating apps to help people find and work with vocabularies. This openness and innovation is a hallmark of shared data and will be a key benefit of this service.

Copyright© 2013 W3C ^® (MIT , ERCIM , Keio), All Rights Reserved.

Date: 2013-04-26 15:15:18 $