Handbook on the Theory and Practice of Program Evaluation

Handbook on the Theory and Practice of Program Evaluation

Elgar original reference

Edited by Albert N. Link and Nicholas S. Vonortas

As this volume demonstrates, a wide variety of methodologies exist to evaluate particularly the objectives and outcomes of research and development programs. These include surveys, statistical and econometric estimations, patent analyses, bibliometrics, scientometrics, network analyses, case studies, and historical tracings. Contributors divide these and other methods and applications into four categories – economic, non-economic, hybrid and data-driven – in order to discuss the many factors that affect the utility of each technique and how that impacts the technological, economic and societal forecasts of the programs in question.

Chapter 7: Research value mapping and evaluation: theory and application

Barry Bozeman and Gordon Kingsley

Subjects: economics and finance, economics of innovation, public sector economics, innovation and technology, economics of innovation


Despite three decades’ progress in the ability to conceptualize, measure and evaluate research impacts, a gaping hole remains in research evaluation methods and technique: the ability to evaluate the sociotechnical impacts of research. Economic evaluations and quality evaluations have progressed nicely, but techniques for measuring impacts on society or impacts on technological evolution have not kept pace. Part of this gap is due to difficulties in building analytical tools for analysis of sociotechnical impacts (Averch, 1991). Professional researchers have developed powerful economic tools to measure economic impacts of research, sophisticated bibliometric tools to measure validly the impacts of research outputs on scientific fields and the course of science, and peer review techniques continue to be refined and employed in assessing projects, programs and proposals. But there has been remarkably little progress in the ability to measure directly, systematically, and validly the impacts of research on sociotechnical change. The limitations of tools for understanding the sociotechnical impacts of science are not surprising when one considers the difficulty of the task and the adolescent stage in the development of research evaluation.

You are not authenticated to view the full text of this chapter or article.

Elgaronline requires a subscription or purchase to access the full text of books or journals. Please login through your library system or with your personal username and password on the homepage.

Non-subscribers can freely search the site, view abstracts/ extracts and download selected front matter and introductory chapters for personal use.

Your library may not have purchased all subject areas. If you are authenticated and think you should have access to this title, please contact your librarian.

Further information