Erik Arnold

Co-founder and Chairman of the Technopolis Group

Offices: Technopolis Group
Email: erik.arnold@technopolis-group.com

Erik Arnold is co-founder and Chairman of the Technopolis Group, Adjunct Professor in Research Policy at the Royal Institute of Technology (KTH) Stockholm and an Honorary Professor at the University of Manchester. He has worked in research and innovation policy and evaluation since 1980, covering work in a wide range of disciplines handling research and innovation policy. His work spans 36 countries as well as the European Commission and a range of international organisations including the OECD, World Bank, Nordic Council of Ministers, ESF, Science Europe and COST. He is expert in the design, management and implementation of large- as well as smaller-scale evaluations of research and innovation organisations, programmes and policies. He has particular expertise in integrating peer review and social-scientific evaluation methods.

Erik Arnold teaches evaluation at masters’ level at the Universities of Manchester and Twente as well as various short courses in evaluation. He is a member of the editorial board of the journal Research Evaluation. He is British and was born in 1954. He holds a BA(Hons) degree in English Literature (1976), an MSc in History and Philosophy of Science (1978) and a Doctorate in Science Policy (1983). He is fluently bilingual (English and Norwegian). He also works in Swedish, Danish, German and French. He was formerly a Research Fellow at SPRU, Sussex University (1980-85); a project manager at Booz.Allen and Hamilton (1986-91); and was attached as an expert to the IT and Telecommunications Task Force of the European Commission (1984-5). Previous and current Technopolis projects include

Australia

  • Preparation of performance indicators for National ICT Australia (NICTA)
  • Study of absorptive capacity in Australian firms and international policy measures for increasing absorptive capacity, Department of Industry, Tourism and Resources (in partnership with ANU)
  • Strategic advice on innovation policy for the Department of Industry, Innovation and Science

Austria

  • Evaluation of national R&D programmes in Transport (jointly with Seibersdorf)
  • Evaluation of EU Objective 5b programmes in Austria (jointly with Seibersdorf)
  • Consultant to the Salzburg RITTS project (SCENIC), focusing on the adequacy of the infrastructure of technology centres which aim to support innovation in SMEs
  • Evaluation of the impact of the EU Fourth Framework Programme in Austria
  • Member of the core panel evaluating the Kplus programme of university-industry ‘competence centres’ for joint research, for BMVIT and the Austrian Research Promotion Agency (FFGEvaluation of the Austrian Science Fund (FWF) and Austrian Industrial Research Promotion Fund (FFF), for the BMVIT Federal Ministry of Transport, Innovation and Technology
  • Support to the BMVIT ministry in a reform process to merge four innovation and R&D funding agencies, and to plan how to manage the new agency
  • International study of the disposition of ‘strategic intelligence’ capacity for innovation policy in industry ministries and innovation agencies and its relation to governance
  • Evaluation of the Austrian support system for participation in the Framework Programme and other European cooperations and national study of the impact of these programmes (including FP7) in Austria
  • Real-time monitoring and evaluation of the COMET competence centres programme, for FFG

Belgium

  • Member of a team evaluating the benefits of the IMEC research centre for the Flemish economy and higher education infrastructure ministry (2002)
  • Member of a team evaluating IMEC as a whole for the Flemish economy and higher education infrastructure ministry (2006)

Bulgaria

  • Member of a team advising the government of Bulgaria on the design of a performance-based research funding system, under the European Commission DG-RTI Policy Support Facility

Canada

  • Survey of international practices in Science Communications and the public understanding of science, for the Council of Science & Technology Advisors

Chile

  • Evaluation and international comparison of the work of the National Innovation Council for Competitiveness
  • Supporting the development of a national system of innovation evaluation, indicators and evaluation methods
  • Methodological support and rapporteur to the external panel evaluation of the National Innovation Council for Competitiveness, 2010
  • Evaluation of Fundación Chile, 2019

China

  • Evaluation of Chinese participation in the 5th and 6th Framework Programmes for the European Commission
  • Study of R&D evaluation systems in China and UK in cooperation with the National Centre for Science and Technology Evaluation, Ministry of Science and Technology, Beijing
  • Methodological advisor to the National Centre for Science and Technology Evaluation, Ministry of Science and Technology, Beijing, in connection with the evaluation of the National Science Foundation of China
  • Panel member and rapporteur of the International Expert Panel evaluating the National Science Foundation of China
  • Teacher on professional development courses about R&D evaluation for the National Centre for Science and Technology Evaluation

Colombia

  • OECD innovation system review, 2013

Czech Republic

  • Project leader of a €1.3m national audit of priority setting, research quality, research funding, programme management, evaluation, researcher careers, internationalisation and the handling of intellectual property for the Ministry of Education, Youth and Sport
  • Project leader of a €1.3m project to revise the national system of research assessment and institutional funding for research-performing organisations

Denmark

  • Support to the Danish Agency for Trade and Industry (EFS) in redesigning the evaluation process for members of the ‘GTS’ network of applied Research Institutes, core-funded by the Danish state
  • Literature survey “Some new ideas about research for development,” background paper to the Hernes Commission investigating DANIDA, for the Danish Ministry of Foreign Affairs
  • Evaluation of the Øresund Contract programme of network R&D projects, funded by the Danish Ministry of Science, Technology and Innovation (VTU) and the Swedish Agency for Innovation Systems (VINNOVA) (jointly with Faugert & Co)
  • Evaluation of the GTS institute system
  • Evaluation of the impacts of the Sixth Framework Programme in Denmark
  • Study of the use of research-based evidence in policymaking for the Danish Council for Research and Innovation Policy (DFiR)

Estonia

  • Feasibility study to test the need to set up university-industry ‘competence centres’ for joint research, and implementation support in the introduction of such centres
  • Mid-term evaluation of the competence centres programme
  • Expert rapporteur in a peer panel reviewing Estonian research and innovation policy, organised under the European Commission DG-RTI Policy Support Facility, 2018/9

Finland

  • Evaluation of the Finnish national research programme in paper and pulp technologies for the Finnish Technology Centre (TEKES)
  • Benchmarking R&D programme management at TEKES
  • Evaluation of 11 Energy programmes for TEKES, as a basis for future planning
  • Consultant to the EFFORTS RITTS project, aiming to review and modernise key parts of the innovation support system within region of East Finland
  • Analysis of SME support policies in a range of countries, as an input to future TEKES strategy
  • Final evaluation of the TEKES ETX and TLX R&D electronics and communications R&D programmes
  • Evaluation of the Academy of Finland Telectronics research programme
  • Advice to the Academy of Finland on the evaluation of basic research
  • Evaluation of TEKES’ internationalisation strategy, in co-operation with Advansis Oy
  • Evaluation of the Wood Materials Science programme, in co-operation with Advansis OMember of the team evaluating Tekes, 2011-2
  • Evaluation of the Academy of Finland, 2012-13
  • Support to the VTT Technology Studies Group in designing and performing an impact study of VTT
  • Partner with VTT Technology Studies in a project on improved use of knowledge capital and allocation of R&D expenditure for the Ministry of Education and Culture
  • Support to the University of Vaasa in developing research strategy
  • Member of the OECD national innovation system review, 2016/7
  • Study of Finnish participation in Horizon 2020
  • Evaluation of Business Finland, 2021
  • Evaluation of the Academy of Finland, 2021/2

France

  • Evaluation of PREDIT, the national transport research programmes
  • Evaluation of ANVAR’s support to innovation
  • Rapporteur for a CREST policy mix review of France, 2006/7
  • Member of the OECD innovation systems review team, 2013

Germany

  • Contribution to the BMFT’s MetaEvaluation study of evaluation practice in Germany
  • Consultant to the Berlin RITTS project, aiming to review and modernise key parts of the innovation support system within the City
  • Member of a panel advising the Wissenschaftsrat on interdisciplinary research programme evaluation
  • Evaluation of the Sonderforschungsbereiche TransRegio programme for the DFG
  • Evaluation of the impacts of COST in Germany
  • OECD innovation system review of Germany, 2021

Greece

  • Benchmarking research and innovation programme design and management against international practice, for GSRT
  • Evaluation of the Hellenic Foundation for Research and Innovation for the European Investment Bank, 2021

Hungary

  • Development of a project monitoring process for NORT (NKTH): the National Office for Research and Technology

Iceland

  • Assisting work groups involved in restructuring of Iceland’s R&D funding systems, for RANNIS

Indonesia

  • Training evaluators and providing start-up support to a major Research and Technology Organisation – BPPT – in establishing an evaluation function for science, technology and related programmes
  • Evaluation of the RUK programme of joint R&D between research institutes and industry

Ireland

  • · Mid-term evaluation of the Irish national Advanced Manufacturing Technology programme for EOLAS, the Irish science and technology agency. Follow-on assignments have reviewed a regional manufacturing technology initiative in Ireland (SERtec) and the role of EOLAS’s Manufacturing Consultancy Services in delivering support to industry
  • Evaluation of Materials Ireland, the Irish national programme in advanced materials, for EOLAS
  • Strategic advice to the Science, Technology and Innovation Council during its review of science and technology funding mechanisms in Ireland and assistance in drafting the report of the Council
  • Evaluation of Teltec Ireland, the Irish national telecommunications R&D programme, which aims to use University capabilities to support the development of an Irish-based telecommunications industry
  • Evaluation of the Forbairt Technology Transfer and Partnership Programme
  • Evaluation of the Basic Research Grants Programme
  • Developing a strategy with Shannon Development, to reorient the company’s activities towards new ways to support small-company development in the post Structural Funds era
  • International comparative study of mechanisms used to attract foreign and emigré national researchers
  • Study of Irish research capabilities in ICT and biotechnology to provide a baseline for future evaluations of increased government spending in these areas in 2000-2006
  • Research and report-writing support to the Walsh Commission investigating research and innovation policy and governance in Ireland, 2002
  • Evaluation of the Enterprise Ireland RTDI for Collaboration programmes, for Forfás
  • Assessment of the absorptive capacity of Irish SMEs, for Forfás
  • Survey of industrial engagement with Science Foundation Ireland for Forfás, in support of a panel evaluation of SFI
  • Evaluation of the Retooling programme for Teagasc, the Irish Agriculture and Food Development Authority
  • Study of researcher careers for the Research Careers Task Force of the Advisory Council on Science and Technology
  • Evaluation of Irish participation in the Sixth Framework Programme
  • Member of a panel evaluating programmatic aspects of the national Centres for Science, Engineering and Technology (CSETs) for Science Foundation Ireland
  • International comparisons of research centre funding and governance models and development of a process for managing the national portfolio of centres for Forfás
  • Evaluation of Science Foundation Ireland’s CSET competence centres programme
  • Evaluation of Enterprise Ireland’s support measures to promote company internationalisation
  • Evaluation of Enterprise Ireland’s support measures to promote company productivity
  • Evaluation of Science Foundation Ireland’s Principal Investigator grant scheme

Japan

  • Lecture to Ministry of Education, Science and Technology (MEXT) on R&D evaluation methods and practices

Korea

  • Member of the OECD National Innovation Systems review team for Korea, 2021-22

Kuwait

  • Evaluation of the Kuwait Institute for Scientific Research (KISR) (1999)
  • Paper-based update to the evaluation of KISR for a panel established by the Amir of Kuwait in 2006, to review the Kuwaiti innovation system
  • Evaluation of KFAS, the Kuwait Foundation for the Advancement of Science (2007)
  • Evaluation and strategy development of KISR (with ADL) (2009)
  • Support to KFAS in updating and implementing a new strategy (2011)
  • Evaluation of the Dasman Diabetes Institute (2014)
  • Review of KFAS Strategy (2015)
  • Providing workshop-based support for the development of the KFAS strategy 2017-21 (2016)
  • Evaluation of the Kuwait Scientific Centre (2016)
  • OECD innovation systems review, 2018/19

Latvia

  • Managing a ‘policy mix peer review’ of Latvia, on behalf of CREST
  • Doing a national innovation system review and running a comprehensive national research assessment exercise for the Ministry of Education and Science (2014)
  • Rapporteur to an expert group advising on research assessment and restructuring the research and innovation funding system via the European Commission’s Policy Support Facility
  • Review of policy achievements in science, research and innovation under the 2013-7 Operational Plan
  • Support to an expert group advising on developing human capital through the higher education system via the European Commission’s Policy Support Facility
  • Running the national research assessment exercise, 2020-2021

Lithuania

  • Organising and implementing the first round assessment of proposals to establish ‘valleys’ of research-based innovation in Lithuania, using European Structural Funds.
  • Advising the Research and Higher Education Monitoring and Analysis Centre (MOSTA) on the development of a model for monitoring and analysing the research and higher education system
  • Advising and supporting the Research and Higher Education Monitoring and Analysis Centre (MOSTA) in the development and implementation of a model for research assessment across Lithuanian research-performing organisations
  • Preliminary assessment of the national system for funding universities and institutes and recommendations for reform, for MOSTA

Luxemburg

  • Evaluation of the EAU programme of water research for the National research Fund (FNR)
  • Evaluation of FNR’s NANO, SECOM and INTER programmes
  • Evaluation of the LISER social science research institute as part of a wider evaluation of all three CRP institutes

Morocco

  • Evaluation of existing technology transfer instruments and creation of an action plan for improving the national technology transfer system, for the Ministry of Commerce and Industry and the World Bank

Netherlands

  • Comparative study and development of monitoring and evaluation criteria for the new ‘Technological Top Institutes’ funded by the Ministry of Economic Affairs (EZ) from 1998
  • Consultant to the Utrecht RITTS project, aiming to review and modernise key parts of the innovation support system within the region
  • International comparative study of R&D evaluation policies and methods, focusing on quantitative and relative effectiveness approaches, for the Ministry of Economic Affairs (EZ)
  • International comparative study of governance mechanisms for R&D and innovation agencies
  • Member of the team evaluating the Leading Technology Institutes (TTIs)
  • International comparative study of priority-setting at the level of national innovation policy for the Ministry of Economic Affairs (EZ)

New Zealand

  • Evaluation of the Marsden Fund for basic research (jointly with WEB Research)
  • Preparation of a discussion paper for MoRST on devolution of responsibility in R&D funding systems

Norway

  • International review of ‘user-oriented’ industrial R&D programmes, providing a comparative dimension to Norwegian research evaluating national experience with this type of programme. The review was conducted for NFR, the Research Council of Norway
  • Evaluation of the NT Programme, which provides innovation support to firms in the North of Norway, in collaboration with the STEP Group, Oslo
  • Consultant to the West Norway RITTS project, aiming to review and modernise key parts of the innovation support system within the region
  • Benchmarking Norwegian technology support policies aimed at SMEs against foreign practice
  • Benchmarking programme management at the Research Council of Norway (NFR)
  • Evaluation of SND, the Norwegian fund for industrial and regional development
  • Evaluation of the Research Council of Norway, and subsequent support to RCN in implementing recommendations of the evaluation
  • International comparative study of the governance of research funding organisations in Sweden, Finland, Canada and the Netherlands
  • Evaluation of the effects of the Fifth Framework Programme in Norway, in partnership with NIFU and STEP
  • Study of international competence centres programmes, for RCN
  • Evaluation of the Springboard UK programme, for Innovation Norway
  • Evaluation of the Value Creation 2010 programme, for the Research Council of Norway
  • Advice to the Research Council of Norway on new programmes (VRI) and future strategy
  • Rapporteur for the OECD National Innovation Systems review of Norway, 2007
  • Rapporteur and member of a panel evaluating the Simula research institute
  • Evaluation of the Norwegian Centre for International Cooperation in Higher Education, with NIFUSTEP
  • Providing international comparisons of priority setting and the use of management by objectives in research policy for the Fagerberg Commission
  • Supporting a ‘benchlearning’ exercise on innovation policy for the Tekna trade association in Norway as part of the national reflection on research and innovation policy (kunnskapsdugnaden)
  • Leading the second evaluation of the Research Council of Norway
  • Member of a team assessing negotiation options for Norway regarding its future financial contribution to, and participation in, the EU Framework Programme of Research and Technological Development
  • Study of Norwegian measures to support participation in European programmes, for the Ministry of Research, Education and Culture
  • Panel member for the evaluation of the FORFI programme of research on research and innovation
  • Secretary to the international panel evaluation of the social science research institutes
  • Secretary to the international panel evaluation of the humanities in Norway
  • Member of an expert group appointed by the Ministries of Education and Research and of Finance to review the administrative costs of the Research Council of Norway and the way it promotes scientific quality in research
  • Evaluation of the Norwegian R&D fiscal incentive, Skattefunn, in cooperation with Sammfunnsøkomisk Analyse for the Ministry of Finance
  • Study of opportunities to increase Norwegian participation in the EU Framework Programmes, based on experience in FP7 and Horizon 2020
  • Evaluation of the effects of the PES and STIM schemes for stimulating Norwegian participation in the Framework Programme
  • Study of ways to increase Norwegian ERC participation, for RCN
  • Study on ways to make Norwegian R&I policy more transformative, for RCN
  • Study of the impacts of Norwegian participation in the EU Framework Programme for MER
  • Evaluation of the adoption of intervention logic in programme planning at RCN, 2021
  • New methods for assessing the impact of RCN funding, 2020-21
  • Support to Digital Life Norway in developing ways to increase research-based innovation in the convergence between the life sciences and digitalisation, 2020-2019
  • Rapporteur to the field evaluation of natural sciences, 2022/3 for RCN

Portugal

  • Consultant to the LISTART RITTS project, aiming to review and modernise key parts of the innovation support system within the Lisbon and Targus Valley region

South Africa

  • Rapporteur for the OECD National Innovation Systems review of South Africa, 2006
  • Advice and support to the Department of Science and Technology Ministerial Review Committee on the Science, Technology and Innovation Landscape, 2011

Spain

  • Survey of methodologies and advice on impact assessment to the FEDIT federation of technology institutes
  • Evaluation of the first ten years of operation of the Catalan ICREA foundation, which funds internationally excellent researchers to move to research performing institutions in Catalonia
  • Evaluation of the ICREA Academia programme
  • Evaluation of the Recercaixa research funding programme of the LaCaixa bank group

Sweden

  • Evaluation of the Swedish national programme of pre-competitive collaborative R&D in Information Technology (IT4), for the programme sponsors: the Swedish Ministries of Defence and Industry, and Swedish Telecom. Later, he also completed a retrospective study of the programme
  • Evaluation of the research and technology diffusion activities of the Association of Swedish Engineering Industries, and development of proposals for improvements
  • Information Technology research advice to the Swedish Defence Ministry (FMV)
  • Evaluation of the Swedish national programmes in Advanced Manufacturing Technology for NUTEK, The Swedish National Board for Industrial and Technical Development
  • Evaluation and strategy development for the Swedish national programme promoting IT use in service industries (ITYP) for NUTEK
  • Evaluation and strategy development for the Swedish national Road Transport Informatics programme for NUTEK
  • Evaluation of the Swedish national research programme in IT for the construction industry (IT-BYGG)
  • Evaluation of the Local and Regional Public Transport Programme for KFB, the Swedish Transport and Communications Research Board
  • Analysis and implementation of regional policies for technological development for Northern Sweden, in connection with the EU’s RITTS Programme (Regional Innovation and Technology Transfer Strategies)
  • Evaluation of the Labour Market Board (AMS) TUFFA programme to develop and procure computer-based aids to help disabled people participate in the labour force
  • Evaluation of the Environmental Research Programme of KFB, the Swedish Transport and Communications Research Board
  • Developing a strategy for the Swedish Road Vehicles Research Programme, for the programme’s steering committee, under contract to NUTEK
  • Peer reviewer for the KFB ‘TOSCA II’ traffic forecasting and management project
  • Benchmarking R&D programme management performance for NUTEK
  • Evaluating the Biofuels programme for KFB, the Swedish Transport and Communications Research Board
  • Support to projects developing programme management and quality-assurance processes at NUTEK
  • Assessing the role of the City of Stockholm in the KTH Science Park, Teknikhöjden, and proposing future strategy for the City
  • Support to programme planning in the new Energy Agency (Energimyndigheten)
  • Support to NUTEK in developing and executing a pilot Technology Foresight exercise, as a forerunner to a planned national Technology Foresight programme
  • Evaluation of the Traffic Research Institute (TFK), on behalf of two major customers: KFB and the Swedish National Roads Administration (Vägverket)
  • Evaluation and strategy study for the Stockholm Technology Bridge Foundation (Teknikbrostiftelsen i Stockholm), which aims to improve technology transfer between the higher education sector and industry in the region
  • Programme planning support to KFB in preparing a new R&D programme on Intelligent Transport Systems (ITS)
  • Evaluation of the IT-Verkstad IT in production engineering programme for NUTEK
  • Strategy development for the Knowledge Centres network in Västernorrland, supporting 11 centres in developing and offering development services to SMEs, especially in the field of innovation
  • Evaluation of the Railway Research Group at KTH for its funders: KFB, SJ, Banverket and Adtranz
  • Evaluation of Miljöteknikdelegationen – the Environment Technology Delegation – in support of its forward planning and strategy for commercialisation of environmentally-friendly technologies
  • Evaluation of waste water management projects in the Baltic states for SIDA
  • Support to KFB in developing its telematics research strategy through an international survey of current research issues
  • Support to four Swedish Research Institutes in developing a more integrated business model with the aim of improving customer service, creating a more powerful brand and obtaining operational synergies through the United Competence alliance
  • Support to Karolinska Institutet concerning its science parks strategy
  • Evaluation of NUTEK’s VAMP programme of joint R&D in structural materials carried out in networks by Research Institutes, Universities and industry
  • Evaluation of NUTEK/VINNOVAS’s MTO (People, Technology and Organisation) programme, in collaboration with FBA
  • Design of an R&D programme evaluation handbook for MISTRA (the Foundation for Strategic Environmental Research), in collaboration with Faugert & Co
  • Methodological support to VINNOVA concerning a study of the long term industrial impacts of Swedish R&D policy
  • Evaluation of the Fibre Science Communications Network – a ‘researcher school’ in paper and printing technology, funded jointly by the KK Foundation and industry
  • Evaluation of the T2F (tryckteknisk forskning) programme – a distributed ‘researcher school’ in printing technology funded jointly by the KK Foundation and industry
  • Member of a team evaluating the impacts of four environmental research programmes, funded by MISTRA (the Foundation for Strategic Environmental Research)
  • Support to KTH in defining its future external relations, especially its relations with research institutes
  • Evaluation of the Swedish Science Council’s Research Attaché programme, to promote public understanding of research and the take-up of research results, in collaboration with Faugert & Co
  • Evaluation of the SME support programmes funded by VINNOVA at Swedish research institutes, with the aim of promoting growth (with Eurofutures)
  • Evaluations of the KK Foundation’s T2F and FSCN programmes in paper and printing technologies
  • Evaluation of VINNOVA’s Complex Technical Systems R&D programme
  • Evaluation of the KK Foundation’s funding of ‘researcher schools’ in new universities and colleges, in co-operation with FBA
  • Evaluation of the Swedish state-funded energy research portfolio, for the ministry of industry
  • Evaluation of Banverket’s (the Swedish railway track infrastructure provider) research portfolio. In a follow-on project, we explored Banverket’s participation in international rail research programmes and suggested improvements
  • Advice to the Invest In Sweden Agency on reorienting its activities towards innovation
  • Impact study of the VINNOVA and Swedish Energy Agency competence centres
  • Benchmarking state investments in technological R&D, for VINNOVA, in co-operation with Inno
  • Evaluation of the Öresund Contract programme of network R&D projects, funded by the Swedish Agency for Innovation Systems (VINNOVA) and the Danish Ministry of Science, Technology and Innovation (VTU) (jointly with Faugert & Co)
  • Evaluation of a series of ‘profiles’ – academic/industry research centres – at new regional universities in Sweden, for the KK Foundation, followed by a meta-evaluation of the centres
  • Evaluation of the Swedish Foresight programme, Teknisk Framsyn, for its sponsors
  • Evaluative study of the use of core funding for Swedish applied research institutes and the role of the institutes in the National Innovation System for VINNOVA
  • Preparation of briefing materials for the Royal Swedish Academy of Engineering’s project: the University of the Future
  • Evaluation of graduate schools at Chalmers and the University of Linköping for the KK Foundation
  • Final evaluation of the KK Foundation’s Forests Initiative, comprising three regionally based R&D programmes
  • Evaluation of the BIC sustainable construction programme for the FORMAS research council
  • Evaluation and programme planning training, VINNOVA
  • Development of performance indicators for the IRECO research institutes
  • Evaluation of the Volvo Research and Education Foundation’s Future Urban Transport Programme
  • Evaluation of national automotive R&D programmes for the Programme Board for Automotive Research
  • International survey of automotive R&D funding for the Programme Board for Automotive Research
  • Study of the relationship between research funding in the 1980s and the Swedish success in GSM mobile telephony, for VINNOVA
  • Study of the impact of EU Framework Programmes 3-7 in Sweden, for VINNOVA, FAS, FORMAS and the Swedish Science Council, in fulfilment of a task given to these agencies by the government
  • Impact Study of the Programme Board for Automotive Research for VINNOVA
  • Chaired a peer review panel allocating MSEK 303 to transport research at Swedish universities, summer 2009
  • Synthesis of research community views on future centres pf excellence, for the Volvo Research and Education Foundation’s Future Urban Transport Programme
  • Evaluation of the adoption of a school-based structure by the Royal Institute of Technology (KTH) and comparison with international experience of similar reforms
  • Evaluation of the long-term impacts of successful research and Innovation centres in Sweden
  • Chairing an assessment panel selecting new research centres in the field of financial market research for VINNOVA
  • Study of the links between education and research in technical universities, for the Royal Swedish Academy of Engineering (VA)
  • Study of the long-term industrial impacts of the Swedish Competence Centres for VINNOVA and the Swedish Energy Agency
  • Study of the impacts of the Strategic Research Foundation, 2005-2014
  • Panel member for assessing proposals to VINNOVA in the SIO (Strategic Innovation Areas) and the ‘strengthening strategic cooperation with the surrounding society’ programme, aiming to improve the universities’ performance of the ‘third mission’
  • Support to the new Board of RISE – the holding company for the Swedish institutes for applied industrial research – in consolidating the structure of the sector in Sweden
  • Study of the Impacts of the Strategic Research Foundation, funded by the Foundation in connection with its twentieth anniversary
  • Member of a Swedish Research Council panel evaluating Sweden’s investment in Strategic Research Areas
  • Member of the team doing a long-term assessment of the impacts of Vinnova funding of university-industry cooperation in research
  • Member of the evaluation panel for the Strategic Research Areas programme (for the Swedish Research Council)
  • Member of the OECD team for a new innovation policy review, 2015/6
  • Proposal assessor for the Competence Centres programme, 2016
  • Study of research and innovation councils internationally together with the University of Lund, for VINNOVA
  • Evaluation of the eight competence centres funded by the Swedish Energy Agency
  • Study of ways to evaluate large-scale innovation policies to promote systemic transformations, for the Swedish Agency for Growth Analysis, 2018
  • Study of the causes of major changes in Swedish research and innovation policy for VINNOVA
  • Study of future cooperation opportunities for the IVL Swedish Environmental Research Institute, 2018
  • Survey of ten research funders’ processes for assuring the scientific quality of their decisions, for Formas, 2018
  • Evaluations of the Strategic Innovation Programmes for Vinnova, Formas and the Swedish Energy Agency 2019, 2020
  • Panel Chairman, Built Environment, in Lund University’s research assessment exercise RQ2
  • Evaluation of CIRCLE, Lund University, 2021
  • Evaluation of seven National Research Programmes for Formas, 2022
  • Support to Vinnova, Formas and the Swedish Energy Agency in developing SIP 2.0 – a funding instrument for transformative change

Switzerland

  • Evaluation of the SNSF ‘use-inspired basic research’ programme
  • Impact evaluation of the SNSF programmes: 59 ‘Uses and risks of the release of genetically modified plants’, 60 ‘Gender equality’ and 61 ‘Sustainable use of water’
  • Study of the organisation of SNSF’s National Research Programmes, 2021

Thailand

  • Evaluation and redesign of innovation funding mechanisms for the Kingdom of Thailand, with SPRU and CENTRIM (Brighton University)
  • Diagnostic study of evaluation needs and implementation of a training programme for the National Science and Technology Development Agency, in the context of reforms to national institutional and governance structures for R&D in Thailand

UK

  • Production of handbooks for policymakers and participants in R&D collaborations and technology education/diffusion programmes for the UK National Economic Development Office and the OECD
  • Mid-term evaluation of the UK ‘LINK’ programme in High-Speed Machinery Design, involving the joint funding of university/industry research collaborations by the Science and Engineering Research Council and the Department of Trade and Industry
  • Evaluation and policy review of the UK Economic and Social Research Council’s Face Processing Initiative – an interdisciplinary programme of research in psychology, computing and mathematics to advance theory about how people recognise each other
  • Strategic advice to the UK Department of Transport on methods for assessing and prioritising among research proposals
  • Initial evaluation of the Committee on Public Understanding of Science (COPUS), a collaboration involving the Royal Society, the Royal Institution and the British Association for the Advancement of Science
  • Feasibility study for expanding the dissemination and communications functions of the Science Policy Research Unit, Sussex University
  • Review of the technical infrastructure which supports small and medium-sized companies (SMEs), for the Department of Trade and Industry (with Pera International)
  • Developing an R&D programme management model for the Construction Directorate of the Department of the Environment
  • Evaluating the International Technology Promoters scheme for the Department of Trade and Industry
  • Evaluation of new R&D support arrangements in the National Health Service, for the North Thames Region, which performs more than half the R&D in the Service
  • Consultant to SITTI-NET, a RITTS project in London
  • Evaluation of the UK civil space effort, for the Department of Trade and Industry
  • International comparative study of people-based knowledge transfer mechanisms, in support of a panel review of the TCS (Teaching Company Scheme) programme, for the Department of Trade and Industry
  • Evaluation of the Department for International Development’s Engineering and Knowledge Research programme
  • Review of methods used in the first six evaluations of the state of science in various fields in the UK, for the Engineering and Physical Sciences Research Council (EPSRC)
  • Evaluation of the ‘research passports’ initiative to simplify research administration in the UK National Health Service for the UK Clinical Research Cooperation (UKCRC)
  • Study on ways to teach interdisciplinarity at postgraduate level in the social sciences, for the ESRC
  • Evaluation of the ESRC/DFID joint research funding scheme for social science
  • Support to Invest in Northern Ireland in establishing a new competence centres R&D programme
  • Evaluation of the Advanced Institute of Management programme for the ESRC
  • Study of market failure and systems mechanisms in a range of business sectors for the UK Department of Business, Innovation and Skills
  • Study of options for increasing the role of metrics and indicators in future versions of the UK Research Excellence Framework (REF), for the Russell Group of universities
  • Evaluation of the ESRC’s Transformative Research scheme
  • Evaluation of the Royal Society research grants programme
  • Review of the REF (Research Excellence Framework) with a view to simplification and cost-reduction
  • Evaluation of the Royal Society’s industry fellowship programme
  • Evaluation of the Royal Society’s industrial exchanges programme
  • Evaluation of the Royal Society’s international exchanges programme
  • Visioning report for the future UKRI Research and Innovation Funding Service (RIFS)
  • International survey of performance-based research funding systems for UKRI
  • Study of scientific decision-making in the Wellcome Foundation and its international counterparts
  • Delivered an evaluation training course for the NERC evaluation group, 2020
  • Strategic review of the Data-Centric Engineering Programme at the Alan Turing Institute, 2020
  • Evaluation of the UK research response to the COVID pandemic for UKRI, 2021
  • Evaluation of the UK Net Zero Energy Innovation Programme for BEIS, 2022
  • Evaluation framework contract for the Lloyds Register Foundation, 2022-24

Venezuela

  • Evaluation and business plan for the Institute of Engineering, Caracas, Venezuela (with CENTRIM and SPRU)
  • Planning and methodological support to a network of technology research institutes established by COLCYT, spanning South America and the Caribbean (with CENTRIM and SPRU)

Vietnam

  • Evaluation of the FIRST research and innovation programme, for the World Bank

European Institutions

  • Study of new regulatory requirements in the field of satellite communications, for the Commission of the European Communities (jointly with Booz.Allen)
  • Evaluation of the Specific Projects Action Line of the European Commission’s SPRINT programme of technology transfer. Follow-on projects have been launched to deal with best-practice project management in transnational technology transfer programmes and to create computer-based tools for programme applicants
  • Subsequent work for SPRINT includes evaluating the Commission’s Science Parks programme
  • Writing a handbook on Best Practices in Science and Technology Programme Management for DG XIII of the European Commission
  • Member of the TSER Advanced Science and Technology Policy Planning Network
  • Evaluating the European Commission’s MINT Programme (Managing the Integration of New Technology) in the UK
  • Assessment of the administrative burdens associated with EU R&D programmes for the European Parliament, and benchmarking of the Commission’s performance against that of selected European research funders at national level
  • Real-time evaluation of DEAFIN, a soil remediation and regional development project in the RECITE II programme, involving Västernorrland (Sweden), Bremen and Milan
  • Studying the impact of regulation in the medical devices industry, for the European Commission (with VDI/VDE-IT)
  • The final evaluation of the INFO 2000 programme for DG Information Society. This programme was set up to encourage the development of a strong European multimedia industry. The aim of the evaluation is to ascertain the extent to which this has been achieved, and to act as a key input for the development of a successor programme.
  • Strategic analysis and design of a conference on the use of innovation indicators in evidence-based policy making, for DG Enterprise
  • ADEPT @ Innovation, project to define and prototype IT supports for the innovation policy community
  • Member of expert panel on benchmarking impacts of government R&D
  • Member of expert panel on R&D programme management practices (PMAC)
  • Member of the MAP network, developing practice in the funding of multi-actor, multi-measure R&D and innovation support programmes
  • Survey of opportunities and obstacles to the creation of a European Research Area in non-nuclear energy
  • Evaluation of the Eureka MEDEA+ programme
  • Member of a CREST panel on evaluation of fiscal incentives for R&D (2005)
  • Meta-evaluation of the Framework Programme, as an expert input to the Five Year Assessment of the Framework Programme, 1999-2003 (Ormala panel)
  • Literature review of good international R&D evaluation practice for the European Court of Auditors
  • Study of reforms in the public research base of EU members countries as part of the ERAWATCH service for the European Commission
  • Evaluation of Chinese participation in the 5th and 6th Framework Programmes
  • Ex-Post Impact Assessment – FP6 Sub-priority “Global Change and Eco-systems” for DG-Research
  • Interim evaluation of the Information and Communications Technology programme in the Seventh Framework programme
  • Meta-evaluation of the Framework Programme to support the panel evaluation the Sixth Framework Programme
  • Rapporteur and member of the Rietschel group to evaluate the Sixth Framework Programme
  • A study of the history of six categories of research institute, linked with a foresight exercise for each, for D-G Research
  • Rapporteur to the mid-term evaluation panel for the ICT Programme of the 7th Framework
  • Evaluation of the OMC-NETs of the 6th Framework Programme
  • Study of the Long Term Impacts of the Framework Programme, for DG-Research
  • Vice-chair of an Expert group on future EU policy regarding the internationalisation of R&D, for DG-Research and Innovation, 2012
  • Production of a handbook for impact assessment of EU Research and Innovation in climate change, Resource efficiency and Raw materials
  • Evaluating the Pertinence and Impact of Research Infrastructure Activity in FP7 – EPIRIA
  • Evaluation of the role of RTOs in the Seventh Framework Programme
  • Evaluation of the European Institute of Technology
  • Mutual Learning Exercise among member states, concerning the management and evaluation of public-private partnerships in R&D, for the DG-Research Policy Support Facility
  • Mutual Learning Exercise on performance-based research funding systems, for the DG-Research Policy Support Facility
  • Chair of an expert group evaluating the BONUS Article 185 programme of research on the marine and maritime environment in the Baltic Sea
  • Study of sociotechnical transitions in European lagging regions, for IPTS and DG-REGIO

EUROPEAN PARLIAMENT

  • Review of strategic options for the evaluation of R&D programmes of the European Community for the STOA of the European Parliament
  • Study of knowledge transfer between universities and research institutes on the one side and industry on the other for the Science and Technology Assessment Office (STOA) of the European Parliament. The aim of the study was to understand the role and relative importance of formal technology transfer
  • Short study and workshop on research management for STOA
  • Study of the options for creating a European-level research content, output and impact monitoring system for the STOA office of the European Parliament

COST

  • Research support and report writing for an evaluation of the COST domains Physics, Chemistry and Materials Science, chaired by Juan Rojo
  • Research support and report writing for an evaluation of the Transport and Urban Civil Engineering domains of COST, chaired by Tony Ridley
  • Research support and report writing for an evaluation of the Agriculture, Biology and Meteorology domains of COST, chaired by Mårten Carlsson
  • Impact evaluation of COST, 2009, for COST
  • SWOT analyses in support of negotiations among the European Commission, COST and ESF about the continuance of ESF’s role as ‘implementing agent’ for COST
  • COST impact and satisfaction study, 2014

Nordic Organisations

  • Extra-Nordic evaluator of the Nordic Industry Fund, on contract to the Nordic Council of Ministers
  • Study of the potential consequences of opening R&D programmes across borders in the Nordic area, for the Nordic Council of Ministers
  • ‘Nordic Excellence’ bibliometric study of opportunities for increased Nordic science funding for NordForsk
  • Evaluation of Nordic Energy Research
  • Process review of the first Nordic Top Level Research Initiative launched by the Nordic Council of Ministers, for the secretariat of the Nordic Council of Ministers
  • Preparation of three Policy Briefs for Nordforsk on Nordic Framework Programme participation and Nordic Added Value
  • Preparation of a policy paper on changes in the structure and governance of the Nordic research and innovation systems and their implications for cooperation at the Nordic level, 2009
  • Preparation of a policy paper on strengthening Nordic cooperation on science, technology and innovation, 2013-4
  • Team member for the evaluation of the Nordic Innovation agency, for the Nordic Council of Ministers

Other International Organisations

  • Development of ‘best practice’ models for IT diffusion policies, for the World Bank
  • Literature review and development of an evaluation framework to support the European Court of Auditors in auditing the management of evaluation in the European Commission, DG Research
  • Various conference contributions to the American, German and European evaluation associations
  • Study of internationalisation of competence centre programmes for the ERA-NET COMPERA
  • Study of the impacts of research and technology organisations for the European Association of Research and Technology Organisations (EARTO)
  • Study of the desirable balance between basic and applied R&D funding in the context of Horizon 2020 (EARTO)

ESF

  • Evaluation of funding instruments used by the European Science Foundation (ESF), for ESF
  • Surveying user needs and expectations as a component of an ESF foresight study of high-capacity telecommunications networks for academic research
  • Survey of ESF Member Organisations’ views of the Foundation
  • Science Europe
  • Survey of funding decision-making processes among member organisations, 2019

OECD

  • Survey and report on how to define company technological capabilities and how to use policy to improve these capabilities, for OECD, 1997
  • Contribution to OECD Conference on research evaluation, July 1997
  • Survey of evaluation techniques appropriate to basic science, for OECD, 1998
  • Rapporteur for the OECD National Innovation Systems review of South Africa, 2006
  • Rapporteur for the OECD National Innovation Systems review of Norway, 2007
  • Member of the OECD National Innovation Systems review team for Colombia, 2013
  • Member of the OECD National Innovation Systems review team for France, 2013
  • Member of the OECD National Innovation Systems review team for Sweden, 2016
  • Development of a paper about current practices in Impact Assessment for research and innovation policy for CSTP
  • Member of the OECD National Innovation Systems review team for Finland, 2017
  • Member of the OECD National Innovation Systems review team for Kuwait, 2018
  • Member of the OECD National Innovation Systems review team for Germany, 2021
  • Member of the OECD National Innovation Systems review team for Korea, 2021
  • Study of the theory and practice of evaluating Missions

TAFTIE, the European network of innovation agencies

  • Strategic support to the Board of TAFTIE, the European network of innovation agencies
  • Development of a statement on the role of member state innovation funders in the development of the European Research Area, for TAFTIE (2007)
  • Development of a new strategy for TAFTIE (2007)
  • Design and development of the ‘TAFTIE Academy’ for TAFTIE(2008)
  • Support to TAFTIE in debating and formulating a position on new instruments in the EU Framework Programme (2009)
  • Review of progress and implementation of the TAFTIE strategy (2010)
  • Developing a paper on the position of TAFTIE in the ERA and FP8 (2010)
  • Benchmarking the design and evaluation of innovation programmes (2013)
  • Delivering ‘Advanced Research and Innovation Evaluation’ annual training for the TAFTIE Academy, 2011 to date

Dr Arnold worked for Booz.Allen & Hamilton from 1986 to 1991. He was a project manager in the London office of Booz.Allen, working on technology management and management of high-technology industry, especially telecommunications. Major projects undertaken during this time include

  • For VW, he was a member of a team that identified opportunities to reduce cost and to improve the timeliness and effectiveness of R&D by introducing best-practice engineering management methods and techniques
  • Various assignments for vehicles components manufacturers, including St Gobain/Vegla, Lucas, GKN, Federal Mogul
  • In a study for a leading European glass manufacturer, covering both technology and other ‘indirect’ costs, he reviewed R&D and its supporting functions. Effectiveness and efficiency were improved by testing the technology requirements of the ‘customer’ departments within the group, showing how to align technology efforts with these needs and the longer-term, strategic needs of the company, and by downsizing and outsourcing in the technical support functions
  • Evaluation of the Alvey Intelligent Knowledge-Based Systems sub-programme, in connection with the programme evaluation conducted by SPRU, Sussex University, and PREST, Manchester University
  • Major market entry strategy studies for new competitors in the European telecommunications industry, planning to enter: the Swedish telephony and data communications market; the London telephony and data communications market; the UK long-distance telecommunications market; the pan-European market for Managed Data Network Services
  • Information systems strategies for: a major European retail bank; a large UK hotel and catering company; and a substantial industrial company planning to enter the windscreen-replacement market across several countries in Northern Europe, based on integrated international logistics and information systems

Erik Arnold was a Fellow of the Science Policy Research Unit, Sussex University from 1980-85. His main research topics were: skill implications and new training requirements of microelectronics-based technologies (for the Engineering Industry Training Board) and technology policy and programme evaluation (the Alvey Programme). He was attached to the European Commission’s Information Technology and Telecommunications Task Force (now D-G CNECT) in 1984/5.

Erik Arnold's report(s)