<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
  <front>
    <journal-meta>
      <journal-id journal-id-type="nlm-ta">Instituto Nacional de Investigación y  Tecnología  Agraria y  Alimentaria (INIA)</journal-id>
      <journal-id journal-id-type="publisher-id">e0112</journal-id>
      <journal-title>Instituto Nacional de Investigación y  Tecnología  Agraria y  Alimentaria (INIA)</journal-title><issn pub-type="ppub">2171-9292</issn><issn pub-type="epub">2171-9292</issn><publisher>
      	<publisher-name>Instituto Nacional de Investigación y  Tecnología  Agraria y  Alimentaria (INIA)</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">https://doi.org/10.5424/sjar/2020184-16883</article-id>
      <article-categories>
        <subj-group subj-group-type="heading">
          <subject>Research Article</subject>
        </subj-group>
        <subj-group><subject>agriculture  and agri-food research</subject><subject>national  institutes  for agriculture  and agri-food research</subject><subject>knowledge and innovation systems</subject><subject>R&amp;D resources</subject><subject>thematic analysis</subject></subj-group>
      </article-categories>
      <title-group>
        <article-title>Governance of knowledge and innovation in the Ibero-American   agri-food system</article-title><subtitle>Governance of knowledge and innovation in the Ibero-American   agri-food system</subtitle></title-group>
      <contrib-group><contrib contrib-type="author">
	<name name-style="western">
	<surname>Garcia-Alvarez-Coque </surname>
		<given-names>Jose-Maria </given-names>
	</name>
	<aff>Universitat Politècnica de València, Dept. of Economics and Social Sciences. Camino de Vera s/n, 46022 València, Spain</aff>
	</contrib><contrib contrib-type="author">
	<name name-style="western">
	<surname>Saini</surname>
		<given-names>Eugenia</given-names>
	</name>
	<aff>Secretaría Técnica de Fontagro. 1300 New York  Avenue NW. Stop W0908, Washington DC 20577, USA</aff>
	</contrib><contrib contrib-type="author">
	<name name-style="western">
	<surname>Esteban-Rodrigo</surname>
		<given-names>Esther</given-names>
	</name>
	<aff>Instituto Nacional de Investigación y Tecnología  Agraria y   Agroalimentaria (INIA)</aff>
	</contrib><contrib contrib-type="author">
	<name name-style="western">
	<surname>Mas-Verdu</surname>
		<given-names>Francisco</given-names>
	</name>
	<aff>Universitat Politècnica de València, Dept. of Economics and Social Sciences. Camino de Vera s/n, 46022 València, Spain</aff>
	</contrib></contrib-group>		
      <pub-date pub-type="ppub">
        <month> 10 </month>
        <year>2020</year>
      </pub-date>
      <pub-date pub-type="epub">
        <day>20</day>
        <month> 10 </month>
        <year>2020</year>
      </pub-date>
      <volume>18</volume>
      <issue>4</issue>
      <permissions>
        <copyright-statement>© 2020 Copyright © 2020 INIA.  This  is  an  open  access  article  distributed  under  the  terms  of the  Creative  Commons  Attribution  4.0 International (CC-by 4.0) License.</copyright-statement>
        <copyright-year>2020</copyright-year>
        <license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/2.5/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</p></license>
      </permissions>
      <related-article related-article-type="companion" vol="2" page="e235" id="RA1" ext-link-type="pmc">
			<article-title>Governance of knowledge and innovation in the Ibero-American   agri-food system</article-title>
      </related-article>
	  <abstract abstract-type="toc">
		<p>
			Aim of study:  Governance  and the  knowledge and innovation  system (KIS) are interrelated  concepts.  Knowledge management  best practices  are linked to KIS performance.  This article  explores  the governance  of the leading  research,  development,  and innovation  institutes in Ibero-American agriculture,  food, and agro-industry sector.  The paper reports mapping of the governance of 20 agricultural  research institutes. Area of study:  Latin  America and the Caribbean, Spain and Portugal. Material and methods:    In  total,  51  strategic  objectives  for  effective  governance  were  identified.  Self-evaluation  by  the  National Agricultural  Research  Institutes  (NARIs)  was  validated  at  a  workshop  backed  by  FONTAGRO,  a  cooperation  mechanism  amongst  Latin  American and the Caribbean countries, Portugal and Spain, and the Ibero-American Network of NARIs. Main results:  As  a  strength,  the  key  dimension  of  NARIs  appears  to  be  coordination and cooperation.  This result was acknowledged in the internal and external evaluations  and supports previous research on the relevance  of innovation networks in Latin  America. By contrast, as a challenge,  the key dimension appears to be  demand articulation, followed closely  by  capacity  building. Most of the institutes  are also well-positioned to develop deeper ties with social and environmental challenges. Research  highlights:  In  the  medium  and  long  term,  NARIs  should  make  efforts  to  improve  the  processes  of  organizational  evaluation  and learning,  demand  articulation,  and strategic  direction  of the institutions.  Improvement  in management  processes, in addition  to best practices for social responsibility and gender equality, appear to be short-term priorities.
		</p>
		</abstract>
    </article-meta>
  </front>
  <body><sec>
			<title>Introduction</title>
				<p>To achieve their aims, innovation policies must be capable of putting into practice responsible processes geared towards anticipation, participation, transparency, and efficiency (Edler &amp; Fagerberg, 2017). This article aims to analyze and evaluate these functions in the context of Ibero-American agricultural research and development (R&amp;D) systems. National agricultural and agri-food research institutes (NARIs) have played a crucial role in providing solutions to the economic, social, and climate-related challenges that face the Ibero-American agricultural, agri-food, and agribusiness sector. Two deeply interrelated concepts are fundamental to analyze and evaluate the functions of NARIs: ‘system’ and ‘governance’. Like other regions, Latin America and the Caribbean (LAC) has experienced a conceptual shift concerning the term ‘system’. Over the last 30 years, this shift has involved changes in approach about the role of the public sector in the processes of knowledge generation and transfer. Initially, the academic literature offered the framework of national agricultural research systems (NARS). This framework was often associated with a linear approach to research, development, and extension (for further detail, see a critical review by Spielman, 2005). This approach implicitly followed the leadership of public agricultural research centers, which became providers of knowledge that was largely external to users, particularly farmers. The perspective of the agricultural knowledge and information system (AKIS) emerged later. It is less linear than that of NARS because of its focus on knowledge flows amongst actors. This perspective (Chema &amp; Roseboom, 2003) managed to address the heterogeneity of users and their behaviors, as well as their approaches to learning and innovation. More recently, the innovation system approach was introduced. In this study, this approach is extended to the knowledge and innovation system (KIS).1  According to the OECD (1999: p.9), the KIS avoids following a linear approach by considering the set of interrelated agents, their interactions and the institutions that condition their behavior for the common objective of generating, disseminating and using knowledge and/or technology.</p><p>The KIS approach has received numerous criticisms. For instance, Delvenne &amp; Thoreau (2017) noted the risk of designing a KIS that is detached from local and social contexts, and that focuses excessively on economic growth. They questioned how the model has been applied in LAC. Datta (2018) proposed that the concept of KIS should evolve to cover not only formal knowledge production networks but also informal social networks such as local associations or communities. Carayannis et al.(2018) extended the analytical framework to the ‘quadruple helix’ and ‘quintuple helix’, where government, business, academia, and civil society participate together in a democratic innovation model. Here, the ‘innovation ecosystem’ is a key concept, exploring how innovation processes take place within a social and natural environment that should be conducive to the co-evolution of knowledge by a host of actors.</p><p>Francis &amp; Van Huis (2016) noted that the discourse surrounding agricultural innovation systems is evolving from a narrow view of knowledge generation and adoption processes to one that embraces an institutional context that encourages agricultural innovation. However, the concept of the innovation system may have a weakness in that there is a lack of inclusion of social objectives and the most vulnerable groups (Pound &amp; Conroy, 2017). Nevertheless, if well oriented, it could be useful in the context of the agricultural, agri-food, and agribusiness sector in LAC countries. The theoretical debate is influencing R&amp;D strategies in LAC, as reflected by the Bogota Manual from the year 2000 (Jaramillo et al., 2000). The manual highlights the specific nature of innovation processes in Latin American countries. As noted by Dutrénit &amp; Natera (2017: p. 13), ‘The formulation of science, technology and innovation policy in the region has gone from being government policy to defining elements of state policy, which extends beyond the realms of each government.’</p><p>Governance and the knowledge and KIS are interrelated concepts. Interest in knowledge management best practices is linked to KIS governance in the agricultural, agri-food, and agribusiness sector. The concept of governance has several meanings. For the purposes of the current research, the approach by the UNDP (2004) is particularly relevant. Under this approach, governance is defined as ‘the system of values, policies, and institutions by which a society manages its economic, political and social affairs through interactions within and amongst the state, civil society, and private sector’.</p><p>This idea may well encompass the concept of good governance adopted by the new public management (NPM) school, which includes the principles of participation, accountability, efficiency, and effectiveness. It also includes a form of governance that serves as a guide for various actors involved in complex innovation processes through the rules and incentives that encourage the creation, application, and dissemination of knowledge and technologies (Hartwich et al., 2007; Hillman et al., 2011). A traditional way of analyzing KIS governance is using the ‘hierarchy-market-network’ trichotomy, which focuses on the debate between hierarchical management, a vision of the market where companies are solely responsible for thedevelopment and ‘governance without government’ based on self-organized networks of actors (Steurer, 2007).</p>
			</sec><sec>
			<title>Material and methods</title>
				<p><bold>Theoretical framework</bold> </p><p>For the purposes of this study, the conceptual elements described in the introduction are complemented by the approach described by Lupova-Henry &amp; Dotti (2019). These scholars examined KIS governance under the three-pillar framework of ‘who’ is governing, ‘what’ are they governing, and ‘how’ are they governing, also considering the interrelations between these three dimensions (see Fig. 1). The approach in this study shares this broad view of governance. Regarding ‘who’ is governing, a range of actors may be involved in activating and coordinating projects and institutions. However, given the history and leadership of NARIs and other public centers of the KIS in LAC, the first few sections of this study focus on the public sector itself. This does not mean following a hierarchical or linear analysis of knowledge but rather focusing on how public centers are embedded in a more complete knowledge system.</p><p>The question of ‘what’ is being governed is related to a strategic direction of knowledge and innovation policies and a non-neutral approach to the agricultural, agri-food, and agribusiness sector KIS in relation to the role of the system in achieving the Sustainable Development Goals (SDG) and beyond. In this regard, Bortagaray (2016) underscores the need to make substantial progress in policies that explicitly link science, technology, and innovation to sustainable development and social inclusion. Here, governance of the KIS is thought to be a more fundamental concept than public innovation policies. As explained by Howlett (2009), ‘high-level government goals and implementation preferences are not random but rathertend to cluster over time into favored sets of ideas and instruments, or governance modes …..while the specific content of abstract policy goals will change from context to context’ (p. 76).</p><p>The vision of how NARIs relate to the rest of the KIS and the interactions amongst actors requires analysis of ‘how’ governance is approached. This analysis is based on six identified dimensions to assess NARI governance. Examples of set-ups for cooperation amongst the KIS are also introduced later. A future challenge is not who will lead the KIS but how stakeholders and institutions will relate to each other within the KIS.</p><p><bold>Systemic analysis of governance</bold></p><p>This study takes a systemic view that links NARIs to other providers and users of technology. This view is addressed by presenting an analysis of governance in which it is interpreted as a system of values that shape the actions of institutes and provide interactions with the society around them. In this analysis, the ‘who’ of governance refers to the institutes themselves, although the networks of actors they interact within both sub-national and international collaborative settings are also important. ‘What’ is being governed has to do with the strategic guidelines of the research centers, which will be discussed in a separate section. Finally, to establish ‘how’ to govern, several dimensions are identified. These include strategic objectives that should be pursued by R&amp;D-oriented organizations. </p><p>This analysis considers various contributions concerning the proposed functions and conditions that scholars consider fundamental for the effective governance of the organizations within the KIS (Bergek et al., 2008; Borras, 2009; Hillman et al., 2011; Kilelu et al., 2013; Borrás &amp; Edler, 2014; Havas &amp; Weber, 2017; Schot &amp; Steinmueller, 2018). For Ibero-America, the following dimensions or conditions are proposed as necessary for effective governance (i) directionality, or the existence of strategic direction and anticipation; (ii) demand articulation, which entails the rapid adaptation of the institutional framework and the organization’s actions for constantly evolving social needs or demands; (iii) cooperation and coordination with other KIS actors to account for the complexity of public and private interactions; (iv) evaluation and learning so that the institutes and their staff can take stock of their activities and can improve and adapt to any new needs; (v) capacities, providing resources, infrastructure, and qualified staff; and (vi) management, which grants the organization autonomy, transparency, and accountability, whilst streamlining processes.</p><p>Each of these dimensions can be divided into components or strategic objectives that may be desirable. A priori, 51 objectives are considered. These are detailed in the evaluation tables and are summarised in Table 1.</p><p>These objectives are evaluated under an integrative view of NARI participation in the KIS.</p>
			</sec><sec>
			<title>Methodological approach</title>
				<p>In collaboration with Ecuador’s National Institute for Agricultural and Fishing Research (Instituto Nacional de Investigaciones Agropecuarias or INIAP) and FONTAGRO, the National Institute for Agricultual and Food Research of Spain (Instituto Nacional de Investigación y Tecnología Agraria y Alimentaria or INIA-SP) organizedand chaired the 17th meeting of the Ibero-American NARI system in Guayaquil, from 1 to 3 October 2018. The main theme of the meeting was the governance of the institutes that make up the Ibero-American Network of NARIs. To map this governance, INIA-SP previosuly run a semi-structured survey so that each institute could further explain its governance characteristics at the meeting in Guayaquil. All 20 participating institutes were asked to submitt the results of the survey to INIA-SP’s team and to present them at the meeting.</p><p>The survey addressed the institutions’ challenges, mission and vision, organization and structure, humanresources, material and technical means, funding, R&amp;D output, and collaborations and partnerships. This infor-mation was presented, compared, and discussed during the meeting. Specific sections of the survey aimed to identify the institutions’ scope, strengths and challen-ges. A thematic anaysis on strengths and chalenges was carried out from institutes’ answers. The thematic categorization was made according to the 51 pre-defi-ned strategic objectives, following an increasingly used approach in social sciences that identifies the themes wi-thin pieces of text and oral presentations supplied by a sample of individuals or organizations (Braun &amp; Clarke, 2006; Guest et al., 2011). The pieces of information were submitted in form of texts prepared by each institute. The workshop was useful to clarify the meaning of insti-tutes’ contributions which were also enriched during the workshop’s discussions.</p><p><bold>Internal evaluation</bold></p><p>The strengths and challenges identified in the ins-titutes’ reports were matched with a list of 51 strategic objectives spanning the six governance dimensions, so for each objective the institute’s statements were subdi-vided into “strengths” and “challenges”. This procedure shows whether each institution cited the pre-defined stra-tegic objectives allowing to count them as strengths or challenges. The group of 20 institutions that provided information comprised 13 national institutes from LAC, four from Spain and Portugal, two international institutes of the CGIAR system (CYMMIT and CIAT), and IICA with a regional scope.Table 2 shows the participating research institutes. Table 2 also shows the number of objectives reported as strengths and challenges by each one. The self-assessmentreports on governance presented by each institute as part of the workshop provided a key data source. These reports were used to record how each institute referred to each specific objective (challenge or strength). The overall trends are of greater interest than the individual results for each country.</p><p><bold>External evaluation</bold></p><p>Based on the contributions by the representatives of the participating organizations, the team from Universitat Politècnica de València and FONTAGRO performed an external evaluation. Benchmarking was used to assess and prioritize the objectives in each dimension. Three criteria were used. The first criterion was the relevance of each strategic objective. The scores ranged from 1 (not relevant at all) to 9 (fully relevant). The second criterion was the development of the objectives in the Ibero-American area. The scores also ranged from 1 (not at all developed) to 9 (fully developed). The third criterion was the difficulty of implementing these objectives or dimensions. The scores ranged from 1 (not at all difficult) to 3 (very difficult).</p>
			</sec><sec>
			<title>Results</title>
				<p><bold>Characterizing the public R&amp;D system: history matters</bold></p><p> In recent decades, the predominant approach has been an R&amp;D system led by public research centers. To some extent, this is still the case. As various authors have reported (Diaz-Bonilla et al., 2014; Villalobos et al., 2017), Latin America has pioneered the development of the NARS, with institutes that are accountable to the agricultural ministries and that are aimed at improving agricultural development, among other objectives. Whilst the NARIs were being established, international centers in the CGIAR system were also being created. Examples include the International Centre for the Improvement of Maize and Wheat (Centro Internacional de Mejoramiento de Maíz y Trigo or CIMMYT), the International Center for Tropical Agriculture (Centro Internacional de Agricultura Tropical or CIAT) and the International Potato Center (Centro Internacional de la Papa or CIP). The complexity of the system grew in terms of the number and range of entities, funds, and networks for regional cooperation, such as FONTAGRO, IICA, CATIE (Tropical Agricultural Research and Higher Education Center), CARDI (Caribbean Agricultural Research and Development Institute), andthe Network of Ibero-American NARIs (Red de INIAs de Iberoamérica). Towards the end of the 20th century, the situation was one of state-centered governance. Since then, governance has evolved towards a more diversified and complex system. Not only does the private sector play a more active role, but  NGOs, and universities have also become important actors.</p><p><bold>Between the generation and application of technologies </bold></p><p>The actions of public centers, particularly NARIs, has blurred the line between the generation of technologies and their application. However, there has been a stronger orientation towards applied technologies. This applied orientation places most NARIs in what Ruttan (2001) refers to as ‘Rickover’s quadrant’.2  This relates to the development of technologies in areas where the commercial benefits of R&amp;D are neither immediate nor evident because of the difficulties for private initiatives to appropriate these benefits. The key role of NARIs does not hide the growing diversification of the research capacity of individual countries. Therefore, the question of who governs the system does not have an easy answer. According to the ASTI database, the total R&amp;D funding in the agricultural, agri-food, and agribusiness sector from government, universities, and non-profit foundations and associations indicates that NARIs accounted for between 20% (Mexico) and 82% (Panama) of resources allocated to agricultural R&amp;D in 2013. In any case, the NARIs in each country are sufficiently sized to highlight their contribution to the KIS.</p><p><bold>The role of government: public funding </bold></p><p>Does the government play a crucial role in R&amp;D funding? Most NARIs are financed primarily with government resources. However, in some cases, there is a large contribution from cooperation funds (e.g. Bolivia) or a diversified structure with public and private contributions (e.g. Uruguay and Chile). A limitation of our data is that R&amp;D spending by agribusiness is insufficiently accounted in the ASTI database and other available sources, so non-governmental resources mainly consider universities, private foundations and NGOs. Nevertheless, ASTI provides a first picture of the degree of the government’s involving in R&amp;D spending. Figure 2 isolates two clusters of countries. The first cluster includes the eight countries with the highestagricultural R&amp;D intensity in the region (&gt; 0.8%). In this cluster the research intensity increases at a rate of 0.19 points when the share of government funding increases by 10 points, with a significant linear relation between both variables (p=0.0037). In the four countries with the highest R&amp;D intensity (Argentina, Brazil, Chile and Uruguay at least 50% of agricultural R&amp;D resources come directly from government sources. The second cluster includes nine countries where the R&amp;D intensity is under 0.8% but the share of government resources is over 50%. In this cluster, a significant share of government funding appears not sufficient to achieve a higher R&amp;D intensity and the relation between research intensity and the share of government funding is not significant (p=0.1407). The cases of Honduras and Peru, not belonging to the defined clusters, are of countries with very low R&amp;D intensity (&lt;0.4) but also with a low share of government in the agricultural R&amp;D spending (&lt;35%). In short, these findings suggest that increasing government funding in the resource pool is necessary to reach higher rates of R&amp;D intensity, but it does not seem sufficient in some countries with low R&amp;D intensity. Possible reasons, to be further explored, are the insuf f iciency of total public R&amp;D spending and the lack of complementary resources where the KIS is not sufficiently diversified.</p><p><bold>Technological challenges and qualified people</bold></p><p>Another important aspect of the system is the provision and characteristics of qualified people to meet technological challenges. Stads et al. (2016) showed that there is atendency towards institutional diversification in agricultural research. By 2013, 45% of researchers were not in specialized government centers. The ASTI database shows notable dispersion in the characteristics of researchers in the LAC countries. A brief analysis of the database for these research staff indicators yields the following results:</p><p>• The rate of full-time equivalent (FTE) researchers is 63 per 100,000 farmers. The FTE per million inhabitants is an indicator of the prominence of agricultural R&amp;D in society. There are, on average, 35 researchers per million inhabitants. Again, there is a wide range. Guatemala and Ecuador have fewer than 10, whereas Costa Rica and Chile have more than 50, and Argentina and Uruguay have more than 100. </p><p>• The number of researchers with PhDs in LAC 30 years ago was low. The situation has improved substantially (Esquivel et al., 2017). However, ASTI data show that in 2013, only one in five researchers in the agricultural, agri-food, and agribusiness sector had PhDs. The rate of researchers with PhD was above 30% in only three countries (Chile, Mexico, and Brazil) and was below 10% in six countries. </p><p>• The rate of young researchers (aged&lt;31 years) is 8%. Colombia has the highest rate, with 24%. At the other extreme is the issue of generational renewal, which is reflected by the percentage of researchers aged over 60 years. This is a challenge in countries such as Peru, Brazil, Argentina, Chile, Mexico, and Uruguay.</p><p> • The average percentage of women researchers is 30%. However, in five countries, this percentage is less than 20%, and only three countries have more than 40%.Therefore, gender equality remains a challenge for the system. </p><p>• Based on the information from the NARIs for this study, the percentage of PhDs grew in five of the seven NARIs that provided data for the period between 2013 and 2018. There were substantial increases in Chile and Uruguay, with the Uruguayan NARI reporting that it has more than 50% PhDs.</p><p><bold>What is being governed? </bold></p><p>A considerable portion of the data from the institutes refers to their strategic directions: their vision, mission, and objectives. These data have been used to gather the concepts that appear explicitly in these strategic directions. The fact that an idea is not explicitly stated in an institute’s strategic direction does not mean that it has not been paid sufficient attention. It is also possible that a specific concept is considered to be closely related to others. All institutes form part of the science policy. Therefore, it is assumed that research and dissemination of knowledge is their raison d’être. The explicit reported strategic directions are presented in Table 3. The most prominent concepts are those of research, knowledge generation, innovation, and technologydevelopment and transfer. Many institutes have strategic directions related to promoting sustainability, citizens’ well-being, and development. The improvement of productivity and competitiveness was expressly mentioned by 11 institutes, nine of which showed an explicit interest in companies in the agricultural, agri-food, and agribusiness sector. The objectives relating to food security and sovereignty were shared by five institutes. Those relating to nutrition and consumption were likewise expressed by f ive. One of these also expressed a strategic interest in food security. Some directions might be in the minority either because they were considered to have been covered implicitly or because they were not historically considered priorities amongst the objectives of the NARIs. This group includes directions related to inclusiveness, multiculturalism, resilience, and SDG. A few institutes also cited internationalization and support for the public administration as key aspects. Finally, 10 of the 20 institutes expressed a desire to continue acting as a model within the NARS.</p><p><bold>Results of the internal evaluation </bold></p><p>For each of the six governance dimensions, the analysis was performed to calculate the number of institutes whichexpressed strengths or challenges in relation to each strategic objective (see Table 4). In each dimension, the arithmetic mean was calculated for the number of mentions of objectives in terms of strengths or challenges within each corresponding dimension. For example, a value of 3.4 in the directionality dimension means that an average of 3.4 institutes (out of a maximum of 20) mentioned a strategic objective in that dimension as a strength. As for strengths, the three dimensions with the highest average number of mentions were directionality, capacity building, and coordination and cooperation. The three dimensions with the lowest average number of mentions as strengths were demand articulation, evaluation and learning, and improvement in management, with the latter receiving the lowest number of mentions. The most rarely mentioned challenges (fewer than three mentions) were evaluation and learning and improvement in management. The four dimensions most frequently considered challenges were directionality, coordination and cooperation, capacity building, and demand articulation. The specific strategic objectives with the highest number of mentions as a strength or challenge are shown in Table 5. The strategic objectives can be placed into four groups. This grouping yields four types of recommendations:</p><p>−  First, there are objectives that some countries consider a strength but few or none consider a challenge. These objectives are to be ‘maintained’. Specifically, these objectives are ‘to achieve a country-wide presence and cooperate with regional actors’, ‘to be supported by a legal framework as the coordinator of the KIS in the agricultural, agri-food and agribusiness sector’ and ‘to formally participate in complex international partnerships’.</p><p> −  Second, there are objectives that few countries consider a strength but some see it as a challenge. These objectives are to be ‘driven forward’. In total, 16 objectives have these characteristics. </p><p>−  Third, there are objectives that few countries mention as either strengths or challenges. For these objectives, the recommendation would be for ‘reflection’. It is unclear whether these are actually unnecessary or whether the institutes are simply unaware that they are necessary. There are 21 such objectives. </p><p>−  Fourth and finally, there are objectives that some countries mention as a strength and others as a challenge. There are 11 of these objectives. Here, the recommendation would be to ‘cooperate’. This meansestablishing partnerships to join forces or exchange experiences. </p><p>Correlations between reported mentions to challenges for each pair of strategic dimensions were estimated for the sample of NARIs.3  The highest correlation coefficients were found between capacity building and evaluation and learning (0.942), and between capacity building and coordination and cooperation (0.854). Improvement in management shows the lowest correlations with the other dimensions, with a maximum correlation of 0.408 with coordination and cooperation. Management is therefore considered as hardly linked with the rest of strategic dimensions. Directionality shows a correlation coefficient of 0.742 with coordination and cooperation suggesting a possible association between both dimensions, in particular through networking with private and public actors.</p><p><bold>Results of the external evaluation </bold></p><p>The results of the external evaluation are examined using mapping (Fig. 3). This mapping shows the evaluations made by the work team. The dimensions in the upperright quadrant are highly important and highly developed. These are the key factors. Those located in the lower right quadrant are factors that should be maintained. Similarly, important opportunities or areas in the short, medium, and long term can also be identified. The strategic objectives or dimensions located in the upper part of the lower right quadrant are medium-term priorities. The strategic actions or dimensions located in the lower right quadrant are long-term priorities. Hence, the strategic importance of these factors is still at an early stage. Taking the average for each dimension by strategic objective shows that the key factors (relatively high importance and high stage of development) are capacity building and coordination and cooperation. Improvement in management is a short-term priority. Evaluation and learning and demand articulation are medium-term priorities. Finally, directionality is a long-term priority.</p><p>The dimensions can be classified into three groups according to the average difficulty of implementation: (i) low difficulty (directionality, coordination and cooperation, and demand articulation), (ii) medium difficulty (improvement in management) and (iii) high difficulty (evaluation and learning and capacity building). The coordination and cooperation dimension is cited as a key factor. However, its implementation doesnot seem to entail a high degree of difficulty. The capacity building continues to require special attention (PhDs and laboratories cannot be created on an ad hoc basis). In the short term, improvement in management is of medium difficulty and is at a low stage of development. The areas that should be planned for as medium- and long-term objectives are evaluation and learning, demand articulation, and directionality. Implementing suitable mechanisms to evaluate processes and results might prove more difficult. These mechanisms require a strong commitment from the institutions and communities involved.</p>
			</sec><sec>
			<title>Discussion</title>
				<p>A KIS comprises multiple public and private actors that interact with one another. A deal of published research on innovation systems in Latin America has emerged in recent years (Hartwich et al., 2007; Villalobos et al., 2017; Devaux et al., 2018). Most of this studies emphasize how linear and hierarchical transfer systems are progressively being abandoned. In general, this paper corroborates the NARIs’ position as an essential node in the KIS in most Ibero-American countries. The role of public investment as the driver of agricultural research in Latin America remains fundamental. As observed in the first part of the Results section, the the absence of public funding of R&amp;D resources is an important factor behind relatively low R&amp;D intensity, although a high share of government funding is not always sufficient for high R&amp;D intensity. Private investment in R&amp;D plays a key role. The literature provides detailed discussions of the complementarity or substitutability of public and private R&amp;D spending (David et al., 2000; Mas-Verdu et al., 2016) and the present study underlines that a significant share of public funding is not sufficient per se to increase R&amp;D intensity. Recent studies (Marino et al., 2016; Choi &amp; Le 2017) have also indicated the absence of the substitutive effects of private and public investment in R&amp;D. Our research suggests that the public sector and the NARI in particular can provide the right infrastructure to support research and innovation.</p><p>Nevertheless, there is a shortage of high-quality statistics on the role of companies in innovation activities that target the agricultural, agri-food, and agribusiness sector. Timely data on the volume of R&amp;D expenditure by the private business sector are lacking, and should continue the efforts initiated by previous databases (Norton, 2011; Stads et al., 2016). The analysis of the governance of NARIs identified 51 strategic actions or objectives for effective governance. The proposed method can provide a basis for further strategic analysis and monitoring of the institutes based on the six governance dimensions of coordination andcooperation, capacity building, improvement in management, evaluation and learning, demand articulation, and directionality.</p><p>As a strength, the key dimension of NARIs appears to be coordination and cooperation. This result was ac-knowledged in the internal and external evaluations and supports previous research on the relevance of innova-tion networks in Latin America (Geldes et al., 2017). In the agricultural and food sector, there are consolidated regional networks such as FONTAGRO, which articu-lates more than 167 public-private innovation platforms, MasAgro (Sustainable Modernization of the Traditional Agriculture, a participatory improvement of maize with the National Institute of Agricultural and Livestock Fo-rest Research, Mexico, and CIMMYT), or Network of Ibero-American NARIs.</p><p>By contrast, as a challenge, the key dimension appears to be demand articulation, followed closely by capacity building. Most institutes are enhancing the integration of public research within the KIS. However, this is achieved through close links with users and social demands, as well as a strong supply of highly qualified human resources.</p><p>Comparing the external and internal evaluations re-veals some discrepancies. For example, internally, many of the evaluated institutes do not perceive improvement in management to be a high priority, except of project ma-nagement. However, the external evaluation highlights it as a clear priority for short-term implementation. The administrations might still have to internalize certain ob-jectives such as transparency, gender equality, and social responsibility.</p><p>Many of the specific strategic objectives with high scores in the internal and external evaluations refer to the way the institutes are linked to the KIS, R&amp;D capa-bilities, and effective process management. The strate-gic objectives in Table 6 were considered high-priority challenges in the internal evaluation and highly impor-tant in the external evaluation. They are specific stra-tegic objectives from the dimensions of directionality, demand articulation, improvement in management, and capacity building.</p><p>Certain strategic objectives received a few mentions as strengths. This low number of mentions might not ne-cessarily imply that the institutions are weak in these areas; they might simply not have considered the objec-tive relevant enough to highlight in the report. This is true of those related to evaluation and learning. The-se objectives received a few mentions as strengths or challenges. Notably, there was also little or no mention of objectives such as ‘to promote spin-offs and techno-logy-based companies’, ‘to promote staff mobility in firms and the private sector’ or ‘to build suitably sized research teams’. While multi-actor participatory approa-ches are becoming more and more common in agricultu-ral research (Waddington &amp; White, 2014; Devaux et al.,2018), NARIs have not yet become fully operational as innovation platforms, considered as knowledge interme-diaries (Kilelu et al., 2013). Neither the improvement in management objectives related to social responsibility nor those related to gender equality were mentioned as strengths or challenges, though these aspects are increa-singly considered an asset for international research ins-titutions (McCluskey, 2019).</p><p>Table 7 reflects the key recommendations arisen from the results for the whole Ibero-american network of NA-RIs previously summarised. The two columns include the required strategic actions, derived from the internal evaluation, and the priorities, derived from the external evaluation. Some dimensions that are more frequently cited as strengths and challenges are posible areas of inter-institutional and international collaboration. Among these, coordination and cooperation, and capacity buil-ding are considered key priorities, and directionality as a long-term priority. Demand articulation is more fre-quently mentioned as a challenge, suggesting the need to move forward towards more applied knowledge transfer. The external evaluation considers this dimension as a medium-term priority. Evaluation and learning, and im-provement in management, are not frequently considered internally as major challenges or as strengths. However, the external evaluation confirms the short-term priority of improvement in management and the need to improve evaluation and learning with a medium-term perspective, so the institutes should not avoid to reflect on upgrading both dimensions in their goverance strategies.</p><p>Six fundamental policy implications can be drawn from this study:</p><p>1.	Capacity building keeps a key dimension for NARIs, oftenly linked to demand articulation and collabora-tion in innovation activities. It would be advisable to extend strategies to generate income to enhance and complement public support and provide firmer finan-cial sustainability. Actions may consist of public-pri-vate consortia to handle research programs as well as small-scale initiatives. Private contributions can be made to provide applied solutions to benefit agricultu-ral and rural communities.</p><p>2.	Governance models should encourage greater invol-vement by the private sector, businesses, foundations, universities, and agricultural and rural communities. The approach should not be one of rivalry but rather of synergy between public and private undertakings in order to update research directionality and to collabo-rate in innovation activities.</p><p>3.	Setting up effective administrative and financial ma-nagement systems, as well as systems for linking or managing research, is a clear short-term priority for NARIs. While improvement in management is not usually considered as a dimension linked with the rest of strategic dimensions, it is essential to identify areas where the administrative system can be simplified to remove obstacles that prevent linking the institutes with the rest of the system and engaging in internatio-nal cooperation.</p>4.	The implementation of suitable mechanisms to eva-luate processes and outcomes appears to be essential. A strong commitment is needed from the institutions and the communities that work with them. The IDB (Inter-American Development Bank), CGIAR, and national research institutions in Ibero-America should continue collaborating to strengthen the ASTI databa-se to provide statistics on the R&amp;D system for LAC, at least every two years.5.	It is important to reflect on the scope, vision, and mis-sion of the research institutes so that they can adapt to the challenges of this century. The NARIs strategic mission must be determined by a deeper asssessment of the roles of the state in the agricultural KIS (Borras &amp; Edler, 2020). As for the scope, the importance of directions related to inclusiveness, multiculturalism and resilience is highlighted by the growing litera-ture on agricultural innovation. The NARIs should consider more explicit guidelines on climate change, SDG, and inclusive development, with an ongoing focus on areas related to famine, nutrition, and fami-ly farming.6.	We recommend to prioritize areas of governance whe-re cooperation between institutes can have positive outcomes. In our inquire to NARIs, certain objectiveswere mentioned as a challenge by some institutes and as a strength by others. Examples include the objec-tives ‘to hire qualified and up-to-date human resour-ces with PhDs and MScs’, ‘to diversify funding with resources from external, public and private sources’, ‘to anticipate long-term technological trends and make them a strategic priority’ and ‘to achieve a systematic link between knowledge and practice’.Our method of analysis nonetheless has certain limi-tations. First, the method allows to count the institutes’ references to the strategic objectives but not the intensi-ty of contributors’ support to each objective. Second, a subgroup of specific objectives were mentioned as neither a strength nor a challenge. Governance practices whose importance was not highlighted or was considered to have already been achieved should not be overlooked. Exam-ples are the objectives referring to social responsibility and gender equality. Further research is needed to iden-tify the underlying social and cultural factors behind the apparent lack of consideration of such objectives. Third, as mentioned earlier, some institutes provided more de-tailed information than others. These differences led to a varying number of dimentions of certain objectives. A fourth caveat is that the external evaluation identi-fied some objectives that might be relevant for strategic planning, despite not being highlighted in the internal evaluation. Fifth, differences in strategic objectives ex-pressed by the NARIs can be further studied to define commonalities of challenges and priorities. Finally, a deeper consideration of all the drivers of R&amp;D intensity in the agri-food sector is needed to understand country differences in the effectiveness of public R&amp;D funding. In spite of these limitations, this study offers a starting point to discuss and eventually implement standardized ques-tionnaires within the framework of the strategic planning backed by FONTAGRO for 2025 and for the monitoring of the Ibero-American NARIs’ network.
			</sec><sec>
			<title>References</title>
				<p dir="ltr" >Bergek A, Jacobsson S, Carlsson B, Lindmark S, Rickne A, 2008. Analyzing the functional dynamics of technological innovation systems: a scheme of analysis. Research Policy 37 (3): 37-59. https://doi.org/10.1016/j.respol.2007.12.003Borras S, 2009. The widening and deepening of innovation policy: what conditions provide for effective governance? (No. 2009/2). Lund University, CIRCLE-Center for Innovation, Research, and Competences in the Learning Economy.Borrás S, Edler J (eds), 2014. The governance of socio-technical systems. Explaining change. Edward Elgar Publ, Cheltenham. https://doi.org/10.4337/9781784710194Borrás S, Edler J, 2020. The roles of the state in the governance of socio-technical systems' transformation. Research Policy 49 (5): 103971. https://doi.org/10.1016/j.respol.2020.103971Bortagaray I, 2016. Políticas de ciencia, tecnología, e innovación sustentable e inclusiva en América Latina. UNESCO, Oficina de Montevideo.Braun V, Clarke V, 2006. Using thematic analysis in psychology. Qual Res Psychol 3(2): 77-101. https://doi.org/10.1191/1478088706qp063oaCarayannis EG, Grigoroudis E, Campbell DF, Meissner D, Stamati D, 2018. The ecosystem as helix: an exploratory theory‐building study of regional coopetitive entrepreneurial ecosystems as quadruple/quintuple helix innovation models. R&amp;D Manage 48(1): 148-162. https://doi.org/10.1111/radm.12300Chema SG, Roseboom JE, 2003. A review of key issues and recent experiences in reforming agricultural research in Africa. Res Rep 24. ISNAR, The Hague.Choi J, Lee J, 2017. Repairing the R&amp;D market failure: public R&amp;D Subsidy and the composition of private R&amp;D. Research Policy 46 (8): 1465-1478. https://doi.org/10.1016/j.respol.2017.06.009Datta A, 2018. Strengthening research systems: concepts, actions, and actors, K4D Helpdesk Report. Institute of Development Studies, Brighton, UK.David PA, Hall BH, Toole AA, 2000. Is public R&amp;D a complement or substitute for private R&amp;D? A review of the econometric evidence. Research Policy 29: 497-529. https://doi.org/10.1016/S0048-7333(99)00087-6Delvenne P, Thoreau F, 2017. Dancing without listening to the music: learning from some failures of the 'national innovation systems' in Latin America. In: Research handbook on innovation governance for emerging economies. pp: 37-58. Edward Elgar Publishing. https://doi.org/10.4337/9781783471911.00007Devaux A, Torero M, Donovan J, Horton D, 2018. Agricultural innovation and inclusive value-chain development: a review. J Agribus Dev Emerg Econ 8 (1): 99-123. https://doi.org/10.1108/JADEE-06-2017-0065Díaz-Bonilla E, Saini E, Henry G, Creamer B, Trigo E, 2014. Global strategic trends and agricultural research and development in Latin America and the Caribbean: A framework for analysis. International Center for Tropical Agriculture (CIAT). Cali, Colombia.Dutrénit G, Natera JM, 2017. Procesos de diálogo para la formulación de políticas de CTI en América Latina y España. CLACSO, Buenos Aires.Edler J, Fagerberg J, 2017. Innovation policy: what, why, and how. Oxford Rev Econ Policy 33 (1): 2-23. https://doi.org/10.1093/oxrep/grx001Esquivel P, Orjuela A, Barros MP, Osorio C, 2017. Potential opportunities and challenges for research collaboration with Latin America in agriculture and food science. J Agr Food Chem 65 (37): 8096-8098. https://doi.org/10.1021/acs.jafc.7b03572Francis JA, Van Huis A, 2016. Introduction. Why focus on innovation systems: implications for research and policy. In: Innovation systems, pp. 8-13. The Technical Centre for Agricultural and Rural Cooperation (CTA), Wageningen.Geldes C, Heredia J, Felzensztein C, Mora M, 2017. Proximity as determinant of business cooperation for technological and non-technological innovations: a study of an agribusiness cluster. J Bus Ind Market 31 (1): 168-179. https://doi.org/10.1108/JBIM-01-2016-0003Guest G, MacQueen KM, Namey EE, 2011. Applied thematic analysis. Sage Publ, Thousand Oaks, CA, USA. https://doi.org/10.4135/9781483384436Hartwich F, Alexaki A, Baptista R, 2007. Innovation systems governance in Bolivia: Lessons for agricultural innovation policies. IFPRI Discussion Paper 00732, December 2007. International Food Policy Research Institute, Washington DC.Havas A, Weber KM, 2017. The 'fit' between forward-looking activities and the innovation policy governance sub-system: A framework to explore potential impacts. Technological Forecasting and Social Change 115: 327-337. https://doi.org/10.1016/j.techfore.2016.07.016Hillman K, Nilsson M, Rickne A, Magnusson T, 2011. Fostering sustainable technologies: a framework for analyzing the governance of innovation systems. Sci Publ Policy 38 (5): 403-415. https://doi.org/10.3152/030234211X12960315267499Howlett M, 2009. Governance modes, policy regimes, and operational plans: A multi-level nested model of policy instrument choice and policy design. Policy Sci 42: 73-89. https://doi.org/10.1007/s11077-009-9079-1Jaramillo H, Lugones F, Salazar M, 2000. Normalización de indicadores de innovación tecnológica en América Latina y el Caribe: Manual de Bogotá, Doc. 21557, CO-BAC, Bogotá.Kilelu CW, Klerk L, Leeuwis C, 2013. Unraveling the role of innovation platforms in supporting co-evolution of innovation: Contributions and tensions in a smallholder dairy development program. Agr Syst 118: 65-77. https://doi.org/10.1016/j.agsy.2013.03.003Lupova-Henry E, Dotti NF, 2019. Governance of sustainable innovation: Moving beyond the hierarchy-market-network trichotomy? A systematic literature review using the 'who-how-what' framework. J Clean Prod 210: 738-748. https://doi.org/10.1016/j.jclepro.2018.11.068Marino M, Lhuillery S, Parrotta P, Sala D, 2016. Additionality or crowding-out? An overall evaluation of public R&amp;D Subsidy on private R&amp;D expenditure. Research Policy 45 (9): 1715-1730. https://doi.org/10.1016/j.respol.2016.04.009Mas-Verdu F, Ortiz-Miranda D, García-Álvarez-Coque JM, 2016. Examining organizational innovations in different regional settings. J Bus Res 69 (11): 5324-5329. https://doi.org/10.1016/j.jbusres.2016.04.132McCluskey JJ, 2019. Why diversity and expectations matter. Agr Econ 50: 107-111. https://doi.org/10.1111/agec.12530OECD, 1999. Managing innovation systems. OECD, Paris. https://www.oecd.org/science/inno/2101733.pdf [March 2020].Norton GW, 2011. Impact assessment of the IFPRI agricultural science and technology indicators (ASTI) project. International Food Policy Research Institute, Washington DC.Pound B, Conroy C, 2017. The innovation systems approach to agricultural research and development. In: Agricultural systems. Agroecology and rural innovation for development; Snapp S, Pound B (eds). Academic Press, Elsevier, London, pp: 371-405. https://doi.org/10.1016/B978-0-12-802070-8.00011-6Ruttan VW, 2001. Technology, growth, and development: an induced innovation perspective. Oxford Univ Press, NY.Schot J, Steinmueller W, 2018. Three frames for innovation policy: R&amp;D, systems of innovation and transformative change. Research Policy 47 (9): 1554-1567. https://doi.org/10.1016/j.respol.2018.08.011Spielman DJ, 2005. Innovation systems perspectives on developing-country agriculture: A critical review. ISNAR Discussion paper No. 591-2016-39898. Int Policy Res Inst, Washington DC.Stads GJ, Beintema N, Pérez S, Flaherty K, Falconi C, 2016. Investigación agropecuaria en Latinoamérica y el Caribe. Un analisis de las instituciones, la inversion y las capacidades entre países. Inst Int Invest Pol Alim Banco Interamericano de Desarrollo, Washington DC:Steurer R, 2007. From government strategies to strategic public management: an exploratory outlook on the pursuit of cross‐sectoral policy integration. Eur Environ 17(3): 201-214. https://doi.org/10.1002/eet.452UNDP, 2004. Strategy note on governance for human development. United Nations Development Program, New York.Villalobos VM, García M, Avila F, 2017. La innovación para el logro de una agricultura competitiva, sustentable e inclusiva, Instituto Interamericano de Cooperación para la Agricultura, San José. Fundación Colegio de Postgraduados en Ciencias Agrícolas, México.Waddington H, White H, 2014. Farmer field schools: from agricultural extension to adult education, systematica review summary. Int Init for Impact Eval, Washington DC. https://doi.org/10.23846/SRS001ffs</p>
			</sec></body>
  <back>
    <ack>
      <p>Authors’  are  grateful  to  Dr.  Rocio  Lansac  and  Dr.  Jose-Luis  Alonso-Prados for their  coordination  of the  information  collection  stage  and  specific  comments  to  previous drafts.</p>
    </ack>
  </back>
</article>