We agree with the statement that “the right to data is meaningless without knowledge of what is available” and with the proposals to create a central, user-friendly catalog or inventory of all available information. We think this should:

– Include information on what is available not only in central government data sets, but also in those of more fragmented organisations, such as local authorities or the police, to enable comparisons.

– Be easy to search with common sense terms.

– Include notes on how fresh the data is and how often users can expect it to be refreshed (i.e., is it a one-time release, quarterly, including the next release date)

– Include links to other related data sets if they are part of a historical data series (or with other breakdowns, such as relevant regions or agencies)

– Presented in a user-friendly format, as well as raw format, where possible, including star accessibility rating.

– Allow user feedback, rank the interest/value of data sets, and opportunities to publish relevant applications based on the data. Using these approaches can help make data inventories self-regulating and reduce the effort required to manage and maintain them.

The Government may also wish to highlight, flag or even implement display tools to encourage less experienced users to access and manipulate the information.

At a high level, individuals (by which we mean in particular the group of specialized developers) will comply if the standards are sensible, the cost of compliance is low, and compliance itself does not cause more interoperability problems. A useful step would be to encourage consistent schemas for particular data sets (eg bus schedules) and ensure that they are interoperable with other related sets (eg train schedules). We recommend that clear lists of schemes with links to their definition be published on the same website as the catalogue. In addition, consistent master data across all relevant government datasets (for example, on hospital or station naming) would be helpful, as it will help with navigability, usability, and interoperability. Another step to increase usability would be to ensure that key data sets are available (and programmatically easy to query) on government servers, as well as for download. This makes building apps for mobile phones, for example, much easier when the information is regularly updated and means individual users don’t have to download the entire dataset. It is appreciated that the cost of maintaining such a service may require restrictions on the number of queries an individual service can perform; this could be fixed by using a private API key for each user of the service in a similar way to Google Maps. In addition, we suggest that the government adopt and communicate to employees clear information governance measures to achieve compliance and ensure usability and interoperability. Based on our experience working with public and private utility organizations, we have developed information governance frameworks that can be applied to US public services and the open data agenda. The information governance framework examines measures to maintain the privacy, confidentiality, security, quality and integrity of data. Two of these areas are of particular relevance to achieving usability and interoperability:

1. Rigorous data hygiene standards must be adopted to improve data quality. Ensuring data quality is a major challenge, especially in complex environments with multiple IT systems, not all of which share common technical, data, communication or terminology standards. The key to ensuring data quality in these environments is to develop standardized interfaces and models that enable IT subsystems to share information effectively. Effective system architectures must include key components:

– Manual and automatic processes that detect and correct information errors efficiently and effectively. Emphasis should be placed on incentivizing and motivating public service professionals to understand the implications of poor data quality and change behavior to improve data quality over time.

– Validation rules that verify that the data conforms to a set of specifications in terms of format, quality, integrity, precision and structure.

– Use open standards for data recording and coding to promote a high level of data quality through similar data processing in multi-component systems.

2. Quality data must preserve its integrity when it is stored, transferred or retrieved. Unauthorized data modification, low-quality source code, and non-interoperable subsystems undermine data integrity and thus the open data agenda. Effective information governance architectures to maintain data integrity should include:

– Processes for testing the source code to eliminate errors (which may result in data loss or corruption);

– Processes that identify and mitigate security risks;

– A governance function that works across silos to develop and enforce common standards, protocols, and processes to enable syntactic, semantic, and/or process interoperability;

– A standards-based system architecture conforms to common or open standards for messaging, infrastructure, communication, application, data, and clinical terminology.

Standards must be established to ensure that the data collected is consistent and easily comparable across agencies, utility providers, and departments. It would also be worth considering the feasibility of synchronizing the dates when the data is updated to ensure consistency in future comparisons.

Given today’s freedom of information requirements, public service providers are already balancing a commitment to openness with the need to respect privacy and security. We believe that many of the same principles can be followed to ensure a commitment to open data.

There are three main areas where we would expect the government to routinely collect and publish data, in particular where publication:

– Improve results and increase productivity of utility providers through informed comparison;

– Supports the options agenda, informing citizens about different providers and alternative services, which underpins the market;

– Makes accountability real for citizens and encourages greater engagement with public services and government.

We believe that the most important thing the government can do to stimulate the open data market is to make the data itself more consumable and accessible. Data is most useful to the citizen when it tells a story and is meaningful. By investing limited resources to move from “data” to “intelligence”, the government can lead by example and show the potential of data sets. It will also help inspire entrepreneurs to explore the potential uses of public data for business benefit, thus driving economic growth. It may also be worthwhile to go a step further and transform some crucial datasets into blended data “services” making them easily consumable. This will help establish a market and stimulate demand for more published datasets.