Abstract:
Selecting among alternative projects is a core management task in all innovating organizations. In this paper, we focus on the evaluation of frontier scientific research projects. We argue that the “intellectual distance” between the knowledge embodied in research proposals and an evaluator’s own expertise systematically relates to the evaluations given. To estimate relationships, we designed and executed a grant proposal process at a leading research university in which we randomized the assignment of evaluators and proposals to generate 2,130 evaluator–proposal pairs. We find that evaluators systematically give lower scores to research proposals that are closer to their own areas of expertise and to those that are highly novel. The patterns are consistent with biases associated with boundedly rational evaluation of new ideas. The patterns are inconsistent with intellectual distance simply contributing “noise” or being associated with private interests of evaluators. We discuss implications for policy, managerial intervention, and allocation of resources in the ongoing accumulation of scientific knowledge.
Reference:
Looking Across and Looking Beyond the Knowledge Frontier: Intellectual Distance, Novelty, and Resource Allocation in Science. Kevin J. Boudreau, Eva C. Guinan, Karim R. Lakhani, and Christoph Riedl. Management Science, 2016 62:10, 2765-2783.
Keywords: scientific knowledge, grant proposals, intellectual distance, novelty, resource allocation in science, innovating organizations, evaluation of frontier scientific research projects.
Join for free INPST as a member
The International Natural Product Sciences Taskforce (INPST) maintains up-to-date lists with conferences, grants and funding opportunities, jobs and open positions, and journal special issues with relevance for the area of phytochemistry and food chemistry, pharmacology, pharmacognosy research, and natural product science.