Open data everywhere! Review of open data maturity in Europe, UK and Scotland.
Last week the European Data Portal published a report on the state of Open Data Maturity across 28 countries.

October 18, 2016

The European Data Portal published a report on the state of Open Data Maturity in the EU28+ countries (EU+Liechtenstein, Norway and Switzerland). We dove into this fascinating 71-page document to unearth key information to provide you with a snapshot of what’s going on in Europe, the UK and Scotland.

The measurement of the maturity of open data in various countries and overall was built on two key indicators: open data readiness and portal maturity. This covered the level of development of national activities promoting open data as well as the level of development of national portals, including more systematic impact assessments and evaluation studies of open data benefits.

Table 1 - Open Data Maturity Indicators

Before we go into detail about the findings it is important to state that the study uses the following definition for open data:

“Open data refers to the information collected, produced or paid for by public bodies which can be freely used, modified and shared by anyone for any purpose.”
— http://opendefinition.org/

Open Data Maturity in Europe

The report revealed that in 2016 there was an overall increase in open data maturity compared to 2015, and by 2016 a majority of the EU28+ countries have successfully developed a basic approach to address open data.

Figure 1 - Score of Open Data Maturity per country in 2015 and 2016

In 2015, only five countries - Finland, Austria, the United Kingdom, Greece and the Netherlands - reached enough points to be ready for open data. In 2016, this group increased to ten countries, with Ireland, Slovakia, Bulgaria, Romania and Norway reaching new open data readiness levels.

Figure 2 - Overall distribution of countries per level of open data readiness

Open Data Policy

When taking a closer look at open data readiness, it becomes clear that most countries show an increase in maturity regarding the presence of an open data policy. In 2016, 81% of the investigated countries have a dedicated open data policy, which is a large increase compared to 69% last year.

EU28OpenDataReadinessin2015and2016

EU28averageofImpactofOpenDatapoliciesin2015and2016

Figure 3 - EU28+ average of open data readiness in 2015 and 2016 Figure 4 - EU28+ average of impact of open data policies in 2015 and 2016

The report found that there are 3 different forms of policy that relate to open data. For 19 out of 31 countries investigated, the open data policy is the same as the public sector information policy. The other 12 countries have separate policies for open data. In these cases, open data is defined as data that is entirely free of charge, is made available in a machine-readable format and is under an open licence.

A third type of policy that relates to open data is one that supports the re-use of open data. In 84% of the countries such policies are incorporated, ensuring that national governments not only support the publication of open data but also actively encourage re-use where the potential value and benefits of open data are augmented.

With more national open data policies defined or currently revised there is a growing number of regions and cities actively publishing data either directly via the national portal or via ad hoc regional or city portals. Due to this, new challenges arise for governments in terms of keeping track of these initiatives, providing guidance and proactively gathering their data on national portals.

Use and Impact of Open Data

Both the use and impact of open data have increased in comparison to 2015; many countries launched activities to promote their open data policies and portals and developed additional means to monitor users.

On average, per month, 53% of the countries had more than 0.05% of inhabitants visiting their national portals. This illustrates growing awareness around open data; the increase can be partially explained by the fact that in 2016 more countries have open data portals.

Another interesting feature is the proportion of foreign visitors to any given country’s portal. National open data is of interest to other countries, particularly neighbours. For visitors make up 1.5% to 30% of all visitors with an the average of 16%, underlining how data publishers cannot presume who will be most interested in their data

There is also a clear increase when it comes to understanding the political, social and economic impact of open data, although scores differ largely between countries.

United Kingdom - A Brief Overview

Open Data Maturity groups countries into four categories: beginners, followers, fast trackers and trendsetters.

Table 2 - Number of beginners, followers, fast trackers and trendsetters in 2015 and 2016

UK is considered among the trendsetters when it comes to open data maturity.

The national UK data portal is http://data.gov.uk/, with 35,000+ datasets, and there are numerous separate local data portals. An Open Data Policy was published on the 28th of June 2012. Priority domains still need to be identified and a national five-year strategy is currently under development.

Licensing norms are defined with the (UK) Open Data Policy encouraging the use of Open Government Licence.

The UK data portal scored high on usability by allowing its users to:

Search datasets
Download datasets
Provide feedback
Access API

However, contribution to the portal remains complicated with various bureaucratic barriers.

There are 162,486 (0.25% of inhabitants) unique visitors on average per month to the portal, of which 19.4% are foreign visitors. 67% of the traffic is generated by humans. Most datasets are available in CSV format with 50-60% of the datasets being machine readable.

For more info head over to the European Data Portal’s UK Overview.

Scotland - A Brief Overview

Scotland published an Open Data Strategy in February 2015. The strategy was developed by a short-term open data working group with representation from across the public sector. In August 2015 an Open Data Resource pack was released with the intention to help public authorities throughout Scotland develop and implement their own plans for open data.

The Open Data Strategy adopted the G8 Open Data Principles and aimed to create a Scotland where non-personal and non-commercially sensitive data are recognised as valuable resources made available openly for use by all.

According to the strategy, by 2017 all public authorities in Scotland should be publishing their data in a format of 3-star or above. 3-star data is data which is made available online, with an open license in an open and machine-readable format, i.e. CSV, JSON.

Scotland has made strides in open data legislation recently too. In 2016, the Scottish Information Commissioner made open data a new data class in the model publication scheme.

Furthermore, options exist for the public sector in Scotland to publish both statistical open data and to INSPIRE compliant spatial data on two state-of-the-art publication platforms: https://statistics.gov.scot and https://www.spatialdata.gov.scot.

The remaining open data can be published on local, regional or organisation-specific portals such as the Edinburgh Data Portal, Glasgow Open Data Portal, Scottish Parliament Open Data or the Crichton Institute Regional Observatory. Organisations are also publishing data onto the data.gov.uk site.

There are also various local authorities and public sector organisations with open data strategies and publication plans such as Renfrewshire Council, Perth and Kinross Council and the National Library of Scotland.

There is a lot of activity in Scotland around raising awareness. Hackathons are common such as Code the City - Aberdeen, Future Libraries by Product Forge and EdinburghApp. Those interested can also join meetups organised around the topic of open data, where stakeholders listen to inspiring talks and exchange knowledge and experiences with their peers and communities such as the Open Government Scotland group.

There are a number of organisations spreading awareness around open data by providing access to data or by facilitating knowledge exchange and training: ODI Aberdeen, DataLab and Urban Big Data Centre.

Awareness raising often means focusing on developing the right skill set to work with open data. To bridge the knowledge gap and contribute to the maturity of Scotland’s open data level, Urban Tide recently launched a range of new open data training sessions including an Open Data Crash Course, 1- and 2-day workshops and 1-day hands-on sessions where delegates use their own data to learn how to open, cleanse, validate, visualise and publish with our guidance and support.

Open Data Maturity in Europe

Open Data Policy

Use and Impact of Open Data

United Kingdom - A Brief Overview

Scotland - A Brief Overview

Start your journey