Do we have the right metrics? How Virtue Ethics, Accounting, Efficiency Analysis and Machine Learning can help
| Componente | Categoria |
|---|---|
| Giorgio Matteucci | Componenti strutturati del gruppo di ricerca |
| Simone Di Leo | Dottorando/Assegnista/Specializzando componente non strutturato del gruppo di ricerca |
| Giammarco Quaglia | Dottorando/Assegnista/Specializzando componente non strutturato del gruppo di ricerca |
| Renato Bruni | Componenti strutturati del gruppo di ricerca |
| Alessandro Avenali | Componenti strutturati del gruppo di ricerca |
| Componente | Qualifica | Struttura | Categoria |
|---|---|---|---|
| John Carson | Associate Professor | Department of History & STS Program, the University of Michigan, Ann Arbor (USA) | Altro personale aggregato Sapienza o esterni, titolari di borse di studio di ricerca |
| Thyago Nepomuceno | Professor | Technology Center at the Federal University of Pernambuco (Brazil) | Altro personale aggregato Sapienza o esterni, titolari di borse di studio di ricerca |
| Joanna Wolszczak-Derlacz | Associate Professor | Faculty of Management and Economics, Gdansk University of Technology (Poland) | Altro personale aggregato Sapienza o esterni, titolari di borse di studio di ricerca |
We live in the society of evaluation that permeates all aspects of academic and intellectual activity. Quantitative assessments of the activities carried out by scholars proliferate going hand in hand with initiatives and manifestos that highlight their limitations and shortcomings. In this project, we address the issue of "right evaluation" keeping a neutral approach, i.e. without having ideological prejudices for or against the evaluation itself.
This ambitious objective will require overcoming a number of theoretical and methodological challenges. They include:
i) Development of an ontological framework to include the concepts related to "right evaluation" and "right metrics";
ii) Development of a comprehensive and multidimensional performance model as a base for robust empirical analysis;
iii) Integration of existing datasets with interviews and a questionnaire to account for scholars' psychology and motivation;
iv) Development of new methodologies to estimate the performance of scholars within their institutional context.
Despite the relevance of this topic for research and educational policy-making, there are very few contributions on this issue.
To face these challenges we will adopt an interdisciplinary and qualitative-quantitative multi-methods approach combining virtue ethics and accounting with efficiency analysis and machine learning.
We will try to demonstrate that a "right evaluation" cannot be separated from a good evaluation and that to make a good evaluation it is necessary to go beyond the existing quantitative measures currently used but also beyond the superficial and ideological criticisms towards evaluation. When evaluating one must evaluate well, that means considering all costs, including moral ones, of the evaluation and who has to pay for them.