Diana Hicks
Professor
- School of Public Policy
- ADVANCE IAC
- Technology Policy and Assessment Center
Overview
Dr. Diana Hicks is a Professor in the School of Public Policy, Georgia Institute of Technology specializing in metrics for science and technology policy. She was the first author on the Leiden Manifesto for research metrics published in Nature, which has been translated into 24 languages and won the 2016 Ziman award of the European Association for the Study of Science and Technology (EASST) for collaborative promotion of public interaction with science and technology. Her work has informed policymakers in the U.S., Europe and Japan. She has advised the OECD, Flanders, the Czech Republic, and Sweden on national research evaluation systems. She chaired the School of Public Policy for 10 years and co-chaired the international Atlanta Conference on Science and Innovation Policy for 10 years and has been an editor of Research Evaluation. Prof. Hicks has also taught at the Haas School of Business at the University of California, Berkeley; SPRU, University of Sussex, and worked at NISTEP in Tokyo. She earned her D.Phil and M.Sc. from SPRU, University of Sussex. In 2018 she was elected fellow of the American Association for the Advancement of Science (AAAS) for “distinguished contributions to the evaluation of national and international research and development enterprises, and for outstanding leadership in science and technology policy education.”
- D.Phil, SPRU, University of Sussex, Science and Technology Policy
- M.Sc., SPRU, University of Sussex, in Science, Technology and Industrialization
- B.A, Grinnell College, Physics
Interests
- Program Evaluation, Public Management and Administration
- Science, Technology, and Innovation Policy
Focuses:
- Asia (East)
- Europe
- United States
Courses
- PUBP-4010: Policy Task Force I
- PUBP-4020: Policy Task Force II
- PUBP-4410: Science,Tech& Pub Policy
- PUBP-6001: Intro to Public Policy
- PUBP-6401: Sci,Tech & Public Policy
- PUBP-8530: Adv Science& Tech Policy
Publications
Selected Publications
Journal Articles
- Trade literature provides a path from research to practice
In: Research Evaluation [Peer Reviewed]
Date: October 2024
The work of professionals practicing in the community provides a pathway for knowledge advances to reach practice. Yet outside of medicine, little attention has been paid to this phenomenon. Similarly, professions are defined by bodies of knowledge yet studies of professions do not attend to the dynamic relationship between professionals and the ever advancing frontiers of knowledge. In this paper, we delineate the pathway from research to practice as evidenced in trade literature. Our analysis is based on bibliometric and survey data. We find evidence that trade literature is informed by research in references to research papers found in trade periodicals, and trade press articles authored by researchers. Professionals feed back their advances in practice to the community by writing articles for trade publications, and sometimes these are articles are cited by scholarly journal articles, thus the exchange of knowledge is bi-directional to a certain extent. Our survey established that many professionals read trade literature because the contents are relevant to their practice. They trust, with caveats, the material they read but trust more in material with an obvious connection to public sector research. Professionals can often point to ways their practice has improved due to something they read in a trade periodical. Thus the trade literature has institutionalized a mechanism of indirect linkage between research and practice. Indexing trade periodicals could provide a valuable resource for those wishing to make visible the connection between research and practice.
- Seeing Impact: genres referencing journal articles
In: Profesional de la información [Peer Reviewed]
Date: 2023
This paper examines the societal impact of research from the perspective of interconnected genres. Information reaches professionals outside academia through many different types of documents. Those documents often connect with scholarship by referencing academic work, mentioning professors, or publishing articles authored by scholars. Here patterns of referencing journal articles are compared across professional genres. Such citation counts make visible societal impacts to the extent that a field engages a genre, and different genres favor different fields. Biomedical sciences are most visible in patent citation counts. News and social media most often reference medicine. Policy documents make heavy use of social science. Ulrich's indexing of trade journals, magazines, and newspapers suggests social sciences engage heavily with the professions through trade press. However, caution is warranted when using citations to indicate societal impact. Engagement with scholarship occurs not only through referencing but also through authorship and mentions. Not all citations indicate substantive engagement, particularly in social media. Academic literature is but one of many types of sources referenced in professional genres. And scholarship engages with many genres beyond those currently indexed, most notably trade press. Nevertheless, understanding citation patterns across heterogeneous professional genres offers a promising frontier for information sciences to provide a foundation for the analysis of scholarship’s societal impact.
All Publications
Journal Articles
- Trade literature provides a path from research to practice
In: Research Evaluation [Peer Reviewed]
Date: October 2024
The work of professionals practicing in the community provides a pathway for knowledge advances to reach practice. Yet outside of medicine, little attention has been paid to this phenomenon. Similarly, professions are defined by bodies of knowledge yet studies of professions do not attend to the dynamic relationship between professionals and the ever advancing frontiers of knowledge. In this paper, we delineate the pathway from research to practice as evidenced in trade literature. Our analysis is based on bibliometric and survey data. We find evidence that trade literature is informed by research in references to research papers found in trade periodicals, and trade press articles authored by researchers. Professionals feed back their advances in practice to the community by writing articles for trade publications, and sometimes these are articles are cited by scholarly journal articles, thus the exchange of knowledge is bi-directional to a certain extent. Our survey established that many professionals read trade literature because the contents are relevant to their practice. They trust, with caveats, the material they read but trust more in material with an obvious connection to public sector research. Professionals can often point to ways their practice has improved due to something they read in a trade periodical. Thus the trade literature has institutionalized a mechanism of indirect linkage between research and practice. Indexing trade periodicals could provide a valuable resource for those wishing to make visible the connection between research and practice.
- Seeing Impact: genres referencing journal articles
In: Profesional de la información [Peer Reviewed]
Date: 2023
This paper examines the societal impact of research from the perspective of interconnected genres. Information reaches professionals outside academia through many different types of documents. Those documents often connect with scholarship by referencing academic work, mentioning professors, or publishing articles authored by scholars. Here patterns of referencing journal articles are compared across professional genres. Such citation counts make visible societal impacts to the extent that a field engages a genre, and different genres favor different fields. Biomedical sciences are most visible in patent citation counts. News and social media most often reference medicine. Policy documents make heavy use of social science. Ulrich's indexing of trade journals, magazines, and newspapers suggests social sciences engage heavily with the professions through trade press. However, caution is warranted when using citations to indicate societal impact. Engagement with scholarship occurs not only through referencing but also through authorship and mentions. Not all citations indicate substantive engagement, particularly in social media. Academic literature is but one of many types of sources referenced in professional genres. And scholarship engages with many genres beyond those currently indexed, most notably trade press. Nevertheless, understanding citation patterns across heterogeneous professional genres offers a promising frontier for information sciences to provide a foundation for the analysis of scholarship’s societal impact.
- Widespread use of National Academies consensus reports by the American public
In: Proceedings of the National Academy of Sciences [Peer Reviewed]
Date: February 2022
- A characterization of professional media and its links to research
In: Scientometrics [Peer Reviewed]
Date: 2019
- Preferences for peer-reviewed versus other publication sources: a survey of general dentists in the National Dental PBRN
In: Implementation Science [Peer Reviewed]
Date: 2019
- Missed Opportunities for Detecting Alternative Nicotine Product Use in Youth: Data From the National Dental Practice-Based Research Network
In: Journal of Adolescent Health [Peer Reviewed]
Date: 2018
- The unbearable emptiness of tweeting—About journal articles
In: PlosOne [Peer Reviewed]
Date: November 2017
- An Investigation Into the Characteristics of Papers With High Scholarly Citations in Public Administration
In: Review of Public Personnel Administration [Peer Reviewed]
Date: March 2017
In this article, we investigate characteristics associated with highly cited journal articles in Public Administration, especially the extent to which high impact contributions are theoretical. Using citations as a measure of scholarly influence, we used a mixed qualitative and bibliometric approach to understand the factors associated with the most highly cited articles in Public Administration in the last 20 years. Specifically, we assessed the extent to which each article was theoretical or empirical in nature, the role of the journal in which each article was published, and the extent to which the article’s impact spanned disciplines. Results indicate that theoretical development, the journal in which an article is published, and strategic placement with regard to the intended audience matter for scholarly impact. We also identify that theoretical versus empirical approach of subdisciplines is aligned with the maturity of that subdiscipline, consistent with Kuhn’s ideas of scientific evolution.
- Dental Blogs, Podcasts, and Associated Social Media: Descriptive Mapping and Analysis
In: Journal of Medical Internet Research [Peer Reviewed]
Date: 2017
- Evolving Dental Media: Implications for Evidence-Based Dentistry
In: Journal of Evidence-Based Practice for The Dental Hygienist [Peer Reviewed]
Date: 2017
- Big Data
Date: 2015
- Hot Spots in Tracing the Impact of Federal Research
Date: 2015
- Reception of Spanish sociology by domestic and foreign audiences differs and has consequences for evaluation
In: Research Evaluation [Peer Reviewed]
Date: 2015
© 2014 © The Author 2014. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.In this article, we compare the reception of Spanish sociology by domestic and international audiences using citation counts as an indicator of audience interest. We compare papers highly cited in a national language database with those highly cited in the Web of Science. We find differences that might prove worrying within a national research evaluation system that emphasizes publishing in high impact factor, Web of Science indexed journals. We suggest that in the social sciences, such an emphasis may induce not simply more research excellence, but also narrower research agendas with long-term consequences for the Spanish sociology community. - Scientific teams: Self-assembly, fluidness, and interdependence
In: Journal of Informetrics [Peer Reviewed]
Date: 2015
- The Leiden Manifesto for Research Metrics
In: Nature [Peer Reviewed]
Date: 2015
- What is an emerging technology?
In: Research Policy [Peer Reviewed]
Date: 2015
There is considerable and growing interest in the emergence of novel technologies, especially from the policy-making perspective. Yet, as an area of study, emerging technologies lack key foundational elements, namely a consensus on what classifies a technology as 'emergent' and strong research designs that operationalise central theoretical concepts. The present paper aims to fill this gap by developing a definition of 'emerging technologies' and linking this conceptual effort with the development of a framework for the operationalisation of technological emergence. The definition is developed by combining a basic understanding of the term and in particular the concept of 'emergence' with a review of key innovation studies dealing with definitional issues of technological emergence. The resulting definition identifies five attributes that feature in the emergence of novel technologies. These are: (i) radical novelty, (ii) relatively fast growth, (iii) coherence, (iv) prominent impact, and (v) uncertainty and ambiguity. The framework for operationalising emerging technologies is then elaborated on the basis of the proposed attributes. To do so, we identify and review major empirical approaches (mainly in, although not limited to, the scientometric domain) for the detection and study of emerging technologies (these include indicators and trend analysis, citation analysis, co-word analysis, overlay mapping, and combinations thereof) and elaborate on how these can be used to operationalise the different attributes of emergence. - Comment on "Quantifying long-term scientific impact"
In: Science [Peer Reviewed]
Date: 2014
Wang et al. (Reports, 4 October 2013, p. 127) claimed high prediction power for their model of citation dynamics. We replicate their analysis but find discouraging results: 14.75% papers are estimated with unreasonably large μ (>5) and λ (>10) and correspondingly enormous prediction errors. The prediction power is even worse than simply using short-term citations to approximate long-term citations. - Comment on “Quantifying long-term scientific impact
In: Science [Peer Reviewed]
Date: 2014
- What are Grand Challenges?
Date: 2014
- The New York Times as a Resource for Mode 2
In: Science Technology and Human Values [Peer Reviewed]
Date: November 2013
The New York Times (NYT) receives more citations from academic journals than the American Sociological Review, Research Policy, or the Harvard Law Review. This article explores the reasons why scholars cite the NYT so much. Reasons include studying the newspaper itself or New York City, establishing public interest in a topic by referencing press coverage, introducing specificity, and treating the NYT very much like an academic journal. The phenomenon seems to reflect a mode 2 type of scholarship produced in the context of application, organizationally diverse, socially accountable, and aiming to be socially useful as well as high quality as assessed by peers. © The Author(s) 2013. - Detecting structural change in university research systems: A case study of British research policy
In: Research Evaluation [Peer Reviewed]
Date: 2013
- Detecting structural change in university research systems: A case study of British research policy
In: Research Evaluation [Peer Reviewed]
Date: 2013
- Ista mjerila nisu prikladna za sve: o me\djusobnoj prilagodbi nacionalnih evaluacijskih sustava i objavljivanja u društvenim znanostima
In: Revija za sociologiju
Date: 2013
- A boosted-trees method for name disambiguation
In: Scientometrics [Peer Reviewed]
Date: November 2012
This paper proposes a method for classifying true papers of a set of focal scientists and false papers of homonymous authors in bibliometric research processes. It directly addresses the issue of identifying papers that are not associated ("false") with a given author. The proposed method has four steps: name and affiliation filtering, similarity score construction, author screening, and boosted trees classification. In this methodological paper we calculate error rates for our technique. Therefore, we needed to ascertain the correct attribution of each paper. To do this we constructed a small dataset of 4,253 papers allegedly belonging to a random sample of 100 authors. We apply the boosted trees algorithm to classify papers of authors with total false rate no higher than 30% (i. e. 3,862 papers of 91 authors). A one-run experiment achieves a testing misclassification error 0.55%, testing recall 99.84%, and testing precision 99.60%. A 50-run experiment shows that the median of testing classification error is 0.78% and mean 0.75%. Among the 90 authors in the testing set (one author only appeared in the training set), the algorithm successfully reduces the false rate to zero for 86 authors and misclassifies just one or two papers for each of the remaining four authors. © 2012 Akadémiai Kiadó, Budapest, Hungary. - Performance-based university research funding systems
In: Research Policy [Peer Reviewed]
Date: March 2012
The university research environment has been undergoing profound change in recent decades and performance-based research funding systems (PRFSs) are one of the many novelties introduced. This paper seeks to find general lessons in the accumulated experience with PRFSs that can serve to enrich our understanding of how research policy and innovation systems are evolving. The paper also links the PRFS experience with the public management literature, particularly new public management, and understanding of public sector performance evaluation systems. PRFSs were found to be complex, dynamic systems, balancing peer review and metrics, accommodating differences between fields, and involving lengthy consultation with the academic community and transparency in data and results. Although the importance of PRFSs seems based on their distribution of universities' research funding, this is something of an illusion, and the literature agrees that it is the competition for prestige created by a PRSF that creates powerful incentives within university systems. The literature suggests that under the right circumstances a PRFS will enhance control by professional elites. PRFSs since they aim for excellence, may compromise other important values such as equity or diversity. They will not serve the goal of enhancing the economic relevance of research. © 2011 Elsevier B.V. - A Boosted-Trees Method for Name Disambiguation
In: Scientometrics
Date: 2012
- Complementary Assets and the Choice of Organizational Governance: Empirical Evidence From a Large Sample of US Technology-Based Firms
Date: 2012
- How Economics Shapes Science by Paula Stephan
In: Science and Public Policy
Date: 2012
- One size doesn’t fit all: on the co-evolution of national evaluation systems and social science publishing
In: Confero: Essays on Education, Philosophy and Politics [Peer Reviewed]
Date: 2012
- Pathways from discovery to commercialisation: using web sources to track small and medium-sized enterprise strategies in emerging nanotechnologies
In: Technology Analysis & Strategic Management [Peer Reviewed]
Date: 2012
- Pathways from discovery to commercialisation: using web sources to track small and medium-sized enterprise strategies in emerging nanotechnologies
In: Technology Analysis and Strategic Management [Peer Reviewed]
Date: 2012
- A Review of National University Research Evaluation and Funding Systems
Date: 2011
- Coverage and overlap of the new social science and humanities journal lists
In: Journal of the American Society for Information Science and Technology [Peer Reviewed]
Date: 2011
- Equity and excellence in research funding
In: Minerva [Peer Reviewed]
Date: 2011
- Mining
Date: 2011
- Structural change and industrial classification
In: Structural Change and Economic Dynamics [Peer Reviewed]
Date: 2011
- A taxonomy of small firm technology commercialization
In: Industrial and Corporate Change [Peer Reviewed]
Date: 2010
- De gevaren van partiële bibliometrische evaluatie in de sociale weten-schappen
In: Tijdschrift voor Sociologie [Peer Reviewed]
Date: 2010
- Evolving regimes of multi-university research evaluation
In: Higher Education [Peer Reviewed]
Date: 2009
- Informing and improving innovation policy
In: Science and Public Policy
Date: 2009
- Mergers, joint ventures, and licensing as commercialization strategies for technology based firms
Date: 2009
- The maturation of global corporate R&D: Evidence from the activity of U.S. foreign subsidiaries
In: Research Policy [Peer Reviewed]
Date: April 2008
This study empirically investigates the impact of foreign country factors like market size, technological strength of industries, and science and engineering (S&E) capability on the conduct of U.S. overseas R&D during the 1991-2002 period. We find that overseas markets primarily predict the entry of U.S. R&D, while the S&E capability of nations is strongly correlated with the post-entry intensity of U.S. foreign subsidiaries' innovative activity. We also find important inter-industry differences: U.S. electrical, electronics, computer, and telecommunication industries are strongly drawn towards overseas S&E capacity; industries including Machinery, Automobiles, and Transport equipment are primarily attracted by the technological strength of foreign industry; U.S. R&D in Chemicals mostly follows overseas markets. We discuss the implications of our results to the global organization of innovative activity and innovation policy. © 2007 Elsevier B.V. All rights reserved. - Mining the Internet for Competitive Technical Intelligence
In: Competitive Intelligence Magazine
Date: 2007
- University System Research Evaluation in Australia, the UK and US
In: Rivista italiana degli economisti [Peer Reviewed]
Date: 2007
- The Dangers of Partial Bibliometric Evaluation in the Social Sciences
In: Economia politica [Peer Reviewed]
Date: 2006
- Highly innovative small firms in the markets for technology
In: Research Policy [Peer Reviewed]
Date: June 2005
Long-lived small firms with a substantial, public record of innovative success are the focus of this paper. We label such firms "serial innovators" and argue that they are often specialist suppliers in markets for technology. To survive as specialist suppliers, firms must produce technology that is broadly tradable. Using Arora, Fosfuri and Gambardella's markets-for-technology framework, we hypothesize that such technology has certain characteristics. It is: high quality, general purpose, broadly based, quite basic, and concentrated in newer generations of technology. We find that serial innovators, survivors among the specialist technology suppliers, have mastered innovating in technology with these characteristics. This helps explain why these firms have become serious players in these markets - at least for a few years until a new generation of technology emerges. © 2005 Elsevier B.V. All rights reserved. - America’s Innovative Edge at Risk?
In: Research-Technology Management
Date: 2005
- Tracing knowledge diffusion
In: Scientometrics [Peer Reviewed]
Date: September 2004
Knowledge diffusion is the adaptation of knowledge in a broad range of scientific and engineering research and development. Tracing knowledge diffusion between science and technology is a challenging issue due to the complexity of identifying emerging patterns in a diverse range of possible processes. In this article, we describe an approach that combines complex network theory, network visualization, and patent citation analysis in order to improve the means for the study of knowledge diffusion. In particular, we analyze patent citations in the field of tissue engineering. We emphasize that this is the beginning of a longer-term endeavor that aims to develop and deploy effective, progressive, and explanatory visualization techniques for us to capture the dynamics of the evolution of patent citation networks. The work has practical implications on resource allocation, strategic planning, and science policy. - Bibliometric techniques in the evaluation of federally funded research in the United States
In: Research Evaluation [Peer Reviewed]
Date: August 2004
Research evaluation in the USA historically tended to rely more heavily on peer review than on bibliometric method, but interest in quantitative methods including bibliometrics appears to be growing. In this paper, we discuss the use of bibliometric techniques of research evaluation by the US federal government over the past decade. Within the past decade, commentators have pointed to something of a rebirth of interest in evaluation along with pressure on agencies to develop quantitative indicators. Evaluation of economic and societal outcomes of research has become a priority. Bibliometric method continues to evolve in response to these needs and therefore often finds application in evaluations of federal agency research. - Global research competition affects US output
In: School of Public Policy, Georgia Institute of Technology, Atlanta (November 1).(C:$$ _dh/work$$ New Folder$$ higher ed book chap
Date: 2004
- Real Numbers-Asian countries strengthen their research.
In: Issues in Science and Technology
Date: 2004
- The Evolving Research System
In: Computing Research News
Date: May 2001
- The changing composition of innovative activity in the US - A portrait based on patent analysis
In: Research Policy [Peer Reviewed]
Date: April 2001
In this paper, patent bibliometrics are used to investigate shifts underway in the American innovation system. Patent indicators point to extraordinarily dynamic innovation in information and health technologies accompanied by a shift in the center of US innovation from the East to the West Coast. Innovating companies are adapting to the demise of large corporate basic research laboratories by using their own research instead. Growth in university patenting is also striking, and universities have become dominant patentees in a few large, economically vibrant cities. The importance of universities to local innovation has also been revealed by the growth in referencing from patents to papers which allows us to see that companies preferentially reference papers from in-state public sector institutions. © 2001 Elsevier Science B.V. - Science and corporate strategy: a bibliometric update of Hounshell and Smith
In: Technology Analysis & Strategic Management [Peer Reviewed]
Date: 2001
- 360 degree linkage analysis
In: Research Evaluation [Peer Reviewed]
Date: August 2000
DuPont's citation and co-authoring links are tabulated and displayed in an exploration of the possibilities and problems inherent in a '360 degree' citation analysis. It becomes apparent that to produce this type of analysis regularly demands a high level of database infrastructure. The analysis makes visible the interconnected nature of scientific and technological developments and the web-like structure of the research world. - Research excellence and patented innovation
In: Science and Public Policy [Peer Reviewed]
Date: 2000
- Special issue on data and strategies in evaluating public RD-36
In: Research Evaluation
Date: 2000
- The difficulty of achieving full coverage of international social science literature and the bibliometric consequences
In: Scientometrics [Peer Reviewed]
Date: December 1999
This review of social science bibliometric literature seeks to establish characteristics of the social science literature and to understand their consequences for the coverage of literature databases and for interpretation of bibliometric social science indicators based on such databases. The paper reviews what we know about social science publishing and database coverage of it. It examines the main reasons why social science bibliometrics are problematic, namely: the centrality of books in social science literature and their high citation rate; and the national orientation of social science literatures. The paper then looks at reasons why social science bibliometrics holds increasing promise, namely: increasing internationalization; and good coverage of scholarly journals. - Does university-industry collaboration adversely affect university research?
In: Issues in Science & Technology
Date: 1999
- Six reasons to do long-term research
In: Research-Technology Management [Peer Reviewed]
Date: 1999
- Bibliometric indicators for national systems of innovation
Date: 1998
- Using Patent Data for Strategic Planning
In: Stevens Alliance for Technology Management (SATM): Innovation and Technology Management News
Date: 1998
- Desktop scientometrics
In: Scientometrics [Peer Reviewed]
Date: December 1997
Advanced scientometric tools are moving from the realm of the privileged few with access to mainframe and minicomputers to the desktop of researchers equipped with personal computers. This shift is not only due to the decreasing cost and technological advances in PCs but the ready availability of a powerful multitasking operating system, a versatile text processing language and easy access to the Internet. Furthermore, the latest releases of PC software, such as Microsoft Excel, make it possible to develop graphical user interfaces into complex bibliometric data for a wide spectrum of researchers and policy analysts. Recent developments in digital communication, in particular, tools to access the Internet via the World Wide Web will provide even greater flexibility to those researchers wishing to make their scientometric data available to a diverse international audience. This paper examines how the BESST project developed a Desktop Scientometric environment using public domain, hardware independent software, prototyped a graphical user interface to provide easy access to UK sectoral level bibliometric data and gives a glimpse into future developments. - How much is a collaboration worth? A calibrated bibliometric model
In: Scientometrics [Peer Reviewed]
Date: December 1997
Interest in collaboration is increasing in policy circles. There are numerous international and national programs to encourage collaboration, for example, between university and industry researchers. However, little is know about the way in which collaboration changes the impact of a research publication. This paper explores how the impact (average citations per paper) varies with different types of collaboration. A calibrated bibliometric model is derived that demonstrates that collaborating with an author from the home institution or another domestic institution increases the average impact by approximately 0.75 citations while collaborating with an author from a foreign institution increases the impact by about 1.6 citations. - A national research network viewed from an industrial perspective
In: Revue d’économie industrielle [Peer Reviewed]
Date: 1997
- Corporate publishing in life sciences
In: Biofutur [Peer Reviewed]
Date: 1997
- Publications: le jeu des signaux
In: Biofutur [Peer Reviewed]
Date: 1997
- A systemic view of British science
In: Scientometrics [Peer Reviewed]
Date: December 1996
Systemic analyses of national research systems are now within the reach of bibliometricians. By systemic we mean comprehensive, time series, institutionally based, sectoral level analyses of national research output. This paper describes such an analysis for the UK, a system comprising 8% of world scientific output. The paper analyses publishing size and the number of publishing institutions for each sector. Then each sector's intra-sectoral, inter-sectoral and international collaboration is assessed. The paper then examines the data by field, looking at sector publishing profiles across fields, and at how the collaborative patterns vary between fields. It concludes with a summary profile of each institutional sector. - Where is science going?
In: Science Technology and Human Values [Peer Reviewed]
Date: September 1996
Do researchers produce scientific and technical knowledge differently than they did ten years ago? What will scientific research look like ten years from now? Addressing such questions means looking at science from a dynamic systems perspective. Two recent books about the social system of science, by Ziman and by Gibbons, Limoges, Nowotny, Schwartzman, Scott, and Trow, accept this challenge and argue that the research enterprise is changing. This article uses bibliometric data to examine the extent and nature of changes identified by these authors, taking as an example British research. We use their theoretical frameworks to investigate five characteristics of research said to be increasingly pervasive - namely, application, interdisciplinarity, networking, internationalisation, and concentration of resources. Results indicate that research may be becoming more interdisciplinary and that research is increasingly conducted more in networks, both domestic and international; but the data are more ambiguous regarding application and concentration. - A morphology of Japanese and European corporate research networks
Date: May 1996
- Hospitals: the hidden research system
In: Science and Public Policy [Peer Reviewed]
Date: 1996
- International collaboration.
In: Nature
Date: 1996
- Science policy for a highly collaborative science system
In: Science and Public Policy [Peer Reviewed]
Date: 1996
- The relationship between publicly funded basic research and economic performance
Date: 1996
- Published papers, tacit competencies and corporate management of the public/private character of knowledge
In: Industrial and Corporate Change [Peer Reviewed]
Date: December 1995
This paper focuses on the movement of scientific and technological knowledge. It explores companies' reasons for publishing in the scientific and technical literature; reasons that turn on the need to link with other research organizations. The analysis begins by establishing that firms do indeed publish. Such publishing mediates links with other organizations, serving to signal the presence of tacit knowledge and to build the technical reputation necessary to engage in the barter-governed exchange of scientific and technical knowledge. Similar processes are seen in other areas of technical knowledge exchange. © 1995 Oxford University Press. - Questions of collaboration
In: Nature
Date: 1995
- Japanese corporations, scientific research and globalization
In: Research Policy [Peer Reviewed]
Date: 1994
In an age of 'stateless corporations' do Japanese companies remain dependent upon the national science system in their home country? They do. Japanese companies produce scientific papers in the international literature, including papers reporting basic scientific research, but they publish relatively few papers from their foreign affiliates. The papers are produced by laboratories located in Japan, and these are staffed predominantly by Japanese. In producing their scientific research they collaborate relatively more with domestic institutions and cite Japanese scientific work heavily. These few facts describing the published scientific output of Japanese companies document the integration of Japanese corporations into the Japanese science system and hence their dependence upon that system. The implications of this result are twofold. First, any weakness in publicly funded Japanese research could well affect Japanese corporate research in the long term, because they are enmeshed in this system. Second, when combined with the fact that the companies contribute to the scientific literature, this result throws into doubt the idea that these companies are now 'free riders' on world science. They not only contribute to our scientific knowledge, but in doing so their science draws most heavily on Japanese, not foreign sources. © 1994. - Science in Japanese Companies
In: Japan Journal for Science, Technology and Society [Peer Reviewed]
Date: 1993
- University-industry research links in Japan
In: Policy Sciences [Peer Reviewed]
Date: 1993
- Japanese industry no longer riding free
In: Social Sciences: News from the ESRC
Date: July 1992
- Instrumentation, interdisciplinary knowledge, and research performance in spin glass and superfluid helium three
In: Science, Technology & Human Values [Peer Reviewed]
Date: 1992
- A cautionary view of co-citation analysis
In: Research Evaluation [Peer Reviewed]
Date: 1991
Co-citation analysis requires frurther development and problems remain with current maps. With the help of seven basic questions it is hoped to allow a more critical examination of these maps and to bridge the gap between the true believers and the radical critics. © 1991 Beech Tree Publishing. - Defining Basic Research in Japanese Companies (< 特集> 基礎研究)
In: 研究技術計画 [Peer Reviewed]
Date: 1991
- Sociology of scientific knowledge: a reflexive citation analysis or science disciplines and disciplining science
In: Social Studies of Science [Peer Reviewed]
Date: 1991
- What is Bibliometrics?
In: Prometheus
Date: September 1990
- Can bibliometrics measure up?
In: Physics World
Date: 1990
- Is big really better?
In: Physics World
Date: 1989
- Is Big Really Better?
In: Physics World
Date: 1989
- Limitations and more limitations of co-citation analysis/bibliometric modelling: A reply to Franklin
In: Social Studies of Science [Peer Reviewed]
Date: 1988
- UK performance in basic solid state physics
In: Physics in Technology
Date: December 1987
Concern is growing about the health of UK basic research. There is also growing interest in the scope for quantitative indicators in science policy decisions. A Royal Society study has applied quantitative techniques to evaluate national performance in basic solid state physics. - Limitations of co-citation analysis as a tool for science policy
In: Social Studies of Science [Peer Reviewed]
Date: 1987
- National performance in basic research
In: Nature [Peer Reviewed]
Date: December 1986
A newly published report reviews the techniques available for evaluating national performance in basic research and applies these techniques to solid state physics and genetics. © 1986 Nature Publishing Group. - Bibliometric techniques for monitoring performance in technologically oriented research: the case of integrated optics
In: R&D Management [Peer Reviewed]
Date: 1986
- Archives mensuelles: juin 2015
- Complementary assets and the choice of organizational governance: Empirical evidence from a large sample of US technology-based firms
- Grand Challenges in U.S. science policy Attempt Policy Innovation
In: International Journal of Foresight and Innovation Policy [Peer Reviewed]
- IDEA paper
- Le manifeste de Leiden pour la mesure de la recherche
Chapters
- Bibliometrics as a Tool for Research Evaluation
Date: 2012
- Overview of models of performance-based research funding systems
Date: 2010
- Global research competition affects measured US academic output
Date: 2007
- The four literatures of social science
Date: 2004
- The changing science and technology environment
Date: 2002
- The Changing Science and Technology Environment
Date: 2002
- 11. Bibliometrics as a tool for research evaluation
Conferences
- Grand Challenges: Tracking a topos through US Science Policy
Date: 2014
- The organization of science: teams and networks
Date: 2014
- Enlightenment literature and the complex ecology of public knowledge
Date: 2013
- Policy Screening by Structural Change Detection: Can Policies Effectively Boost Research System Performance?
Date: 2012
- Policy screening by structural change detection: can policies effectively boost research system performance?
Date: 2012
- Systemic data infrastructure for innovation policy
Date: 2011
- Overview of models of performance-based Research funding systems
Date: December 2010
- Powerful Numbers or a Short Reflection on Influential Analyses in the History of Science of Science Policy
Date: October 2010
- Research Performance and Resource Allocation
Date: 2009
- The Effect of Foreign Science Policy on US Research
Date: 2008
- The US Research Enterprise in a Changing Global Science System
Date: 2008
- A broad overview of the US innovation system
Date: 2006
- S&T indicators reveal rapid strengthening in Asian research systems
Date: 2004
- Serial Innovators in the markets for technology
Date: 2003
- Strategic Research Alliances and 360 Degree Bibliometric Indicators
Date: July 2001
- Using indicators to assess evolving industry-science relationships
Date: 2000
- Systemic Indicators for the Knowledge-Based Economy
Date: 1996
- The classification of interdisciplinary journals: A new approach
Date: 1995
- 2C5 An Overview of Bibliometrics
Date: 1990
- An Overview of Bibliometrics
Date: 1990
- The interface between corporate R& D and academic research A bibliometric exploration of the changing structure and significance of the linkages in Britain and Japan
Working Papers
- Using narrative visualization to communicate the outcomes of Federal research
Date: 2014
- Systemic data infrastructure for innovation policy
Date: December 2010
- Towards a Bibliometric Database for the Social Sciences and Humanities – A European Scoping Project
Date: April 2009
- An Analysis of Small Business Patents by Industry and Firm Size
Date: November 2008
- Evolving regimes of multi-university research evaluation
Date: 2008
Since 1980, national university departmental ranking exercises have developed in several countries. This paper reviews exercises in the U.S., U.K. and Australia to assess the state-of-the-art and to identify common themes and trends. The findings are that the exercises are becoming more elaborate, even unwieldy, and that there is some retreat from complexity. There seems to be a movement towards combining peer evaluation with bibliometric measures. The exercises also seem to be effective in enhancing university focus on research strategy.
- A Taxonomy of Serial Innovators
Date: August 2006
- Identification of the technology commercialization strategies of high-tech small firms
Date: 2006
- Highly innovative small firms in the markets for technology
Date: 2005
Long-lived small firms with a substantial, public record of innovative success are the focus of this paper. We label such firms “serial innovators†and argue that they are often specialist suppliers in markets for technology. To survive as specialist suppliers, firms must produce technology that is broadly tradable. Using Arora, Fosfuri and Gambardella’s markets-for-technology framework, we hypothesize that such technology has certain characteristics. It is: high quality, general purpose, broadly based, quite basic, and concentrated in newer generations of technology. We find that serial innovators, survivors among the specialist technology suppliers, have mastered innovating in technology with these characteristics. This helps explain why these firms have become serious players in these markets – at least for a few years until a new generation of technology emerges.
- KISTI: Emerging technology assessment and training
Date: 2005
- Small Firms and Technology: Acquisitions, Inventor Movement, and Technology Transfer.
Date: 2004
- Small Serial Innovators: The Small Firm Contribution to Technical Change
Date: February 2003
- A Comparison of DOE, DOD, NIH and NSF Patent-to-Paper Citations
Date: November 2002
- Patent Citations to DOE Funded and Authored Research
Date: August 2002
- Bibliometric Analysis of Core Papers Fundamental to Tissue Engineering
Date: March 2002
- Beikoku ni okeru k\=oteki kenky\=u kaihatsu no hy\=oka shuh\=o
Date: 2002
- Quantitative Methods of Research Evaluation Used by the US Federal Government.
Date: 2002
- Quantitative methods of research evaluation used by the US Federal Government..-v. 86
Date: 2002
- Analysis of Anomalous Spike in Science Referencing
Date: August 2001
- Identifying Companies Whose Technology Builds Upon DMII-Funded Papers and Upon NSF-Funded Work in the Same Subject Area
Date: August 2001
- The Impact of ACS-funded Research on Patented Innovation: Patent Citations to ACS-funded Research Papers
Date: August 2000
- A Bibliometric and Cyberbibliometric Examination of IIASA's Output and Impact
Date: 2000
- Indicators for systems of innovation-a bibliometrics-based approach
Date: 1998
- The changing shape of British industrial research
Date: March 1997
- The Bibliometric Evaluation of Sectoral Scientific Trends
Date: June 1995
- The changing shape of British Science
Date: 1995
- The Effects of Size and Other Factors on the Research Performance of University Departments
Date: May 1993
- Trends in Corporate R&D in Europe and Japan
Date: 1993
- Defining Basic Research in Japanese Companies & Science in Japanese Companies: A Preliminary Analysis
Date: 1991
Thesis / Dissertations
- Beyond Serendipity: Factors Affecting Performance in Condensed Matter Physics
Other Publications
- Innovation Policy in Europe: Measurement and Strategy
Date: 2009