Overarching analysis of the 2019 EC-OECD STIP Survey data

Prepared by Andrés Barreneche, OECD and Michael Keenan, OECD
Last update: 27 October, 2020

Introduction

This online report describes the data collected in the 2019 edition of the EC-OECD Science, Technology and Innovation Policy (STIP) survey. The STIP Survey systematically collects in a harmonised way qualitative data on national science, technology and innovation (STI) policies. It addresses all areas of STI policy, including initiatives spread across different ministries and national agencies, with competence over domains as broad as research, innovation, education, industry, environment, labour, finance/budget, among others.

The 2019 edition of the survey was administered between July-October 2019. The survey included 57 questions covering all main aspects of the (national) innovation system, structured around six “core” policy areas: (i) Governance, (ii) Public research system, (iii) Innovation in firms and innovative entrepreneurship, (iv) Science-industry knowledge transfer and sharing, (v) Human resources for research and innovation, and (vi) Research and innovation for society. It also includes an edition-specific “module” on Emerging trends in STI policy that covers selected key issues of concern to the EC's and OECD's policy agendas and work programmes.

Most questions in the survey ask respondents to provide information on relevant STI “policy initiatives”. Drawing partly on an EC definition, an STI policy initiative can be defined as a public action that (i) aims to achieve one or several public policy goals in the policy area of science, technology and innovation, (ii) is expected to modify or frame the behaviours of actors and stakeholders, being national, domestic or foreign, who are part of or influential on, the national innovation system, and (iii) is implemented with a minimum time horizon or on a continuous basis (i.e. not as a one-off “event”). More information on the data model used to structure STIP Compass is available in a reference document (PDF) and in machine readable format.

The survey is answered by government officials, with coordination carried out by national delegates of the OECD’s Committee for Scientific and Technological Policy (CSTP) and the EC’s European Research Area Committee (ERAC). The 2019 edition of the STIP Survey gathered information on 5,470 policy initiatives from 50 countries and 6 entities, i.e. 5 administrative authorities in Belgium (submitting separate responses), and the European Union (EU). Figure 1 shows the territorial coverage of the survey.

Figure 1. Coverage of the 2019 edition of the EC-OECD STIP Survey
Territorial coverage of the 2019 EC-OECD STIP survey

The 2019 EC-OECD STIP survey has seen STIP Compass data quality improve markedly. In the 2017 edition of the survey, 50% of initiatives were only partially completed. In the 2019 edition of the survey, the share of incomplete initiatives decreased to 39%. More critically, the country median share of policy initiatives including an estimated yearly budget expenditure has increased from about 50% in the 2017 edition of the survey to 73% in the 2019 edition.

It is important to note that the data consists of self-reported descriptions provided by survey respondents. To harmonise the database, the EC and OECD not only provide detailed guidance for answering the survey but also curate the information that has been reported. However, data quality varies by country. In particular, some countries have provided more complete and detailed information compared to others. Country-specific scorecards provide different quality benchmarks of the current level of reporting in the database for each country. They include charts describing the country’s number of initiatives and the types of missing information that compare against the median country participating in the database. They are useful points of reference to identify gaps in the information that has been reported. The scorecards and complementary information on the data collection process are available in the STIP Survey resource centre. Care should also be exercised when interpreting the data as initiatives vary in scope and scale, imposing limitations to how aggregations of initiatives can be interpreted.

This report is based on a curated version of the 2019 STIP survey data (available for download here). The analysis is broken down by sections, corresponding to each of the survey's policy areas and edition-specific module. They can be accessed using the links below. Each of these sections includes a summary of key messages and descriptions of the policy initiative data across its main dimensions: the themes and target groups addressed and their use of policy instruments. Moreover, the sections covering the six core policy areas of the survey include data and analysis of the main national policy debates.

Sections

  1. Governance
  2. Public research system
  3. Innovation in firms and innovative entrepreneurship
  4. Science-industry knowledge transfer and sharing
  5. Human resources for research and innovation
  6. Research and innovation for society
  7. Emerging trends in STI policy