EVALUATING EVALUATIONS BY INCLUDING NORMATIVE ETHICS, MANAGEMENT SCIENCE AND ARTIFICIAL INTELLIGENCE IN A VISUAL ANALYTICS ENVIRONMENT Project acronym: EVAL^2
| Componente | Categoria |
|---|---|
| Giorgio Matteucci | Componenti strutturati del gruppo di ricerca |
| Renato Bruni | Componenti strutturati del gruppo di ricerca |
| Marco Angelini | Dottorando/Assegnista/Specializzando componente non strutturato del gruppo di ricerca |
| Daniele Nardi | Componenti strutturati del gruppo di ricerca |
| Alessandro Avenali | Componenti strutturati del gruppo di ricerca |
| Componente | Qualifica | Struttura | Categoria |
|---|---|---|---|
| Henk F. Moed | Senior researcher, equivalent of a Full Professor | Former professor of Research Assessment at the University of Leiden, visiting scholar at Sapienza university of Rome | Altro personale aggregato Sapienza o esterni, titolari di borse di studio di ricerca |
| Leopold Simar | Emeritus Professor of Statistics | ISBA Dept. Universitél Catholique de Louvain, Louvain la Neuve, Belgium | Altro personale aggregato Sapienza o esterni, titolari di borse di studio di ricerca |
This project aims at developing a comprehensive conceptual, analytical and empirical framework for the critical assessment of currently employed research and education evaluation practices.
This objective will require overcoming a number of theoretical and methodological challenges, among which: i) designing a wide-ranging framework extending and integrating existing conceptual, analytical and empirical frameworks taking into account recent contributions from moral philosophy -especially normative ethics; ii) integrating existing datasets with case studies, questionnaires and use cases; iii) developing new (more robust) methodologies to estimate the performance of education and research; iv) exploration of what is inside the black box of rankings to include financial data; v) developing a visual analytics environment to implement and test the new performance indicators.
Despite the relevance of this topic for research and educational policy making, there are very few contributions on this issue.
To face these challenges we will adopt a multi-methods interdisciplinary approach. In particular, the research activity foreseen in this project will undertake a number of coordinated actions including the following: 1) Build a Proof of Concepts of the wide-ranging integrated framework. 2) Integrate existing relevant data on research and education (which are available thanks to the other projects in which the research team is involved) within an artificial intelligence based visual analytic environment. 3) Develop a prototype of the visual analytic system for the assessment of performance models. 4) Carry out case studies (on the Italian balance sheets of universities in comparison with UK universities) to assess the feasibility and the improvements of existing rankings by integrating financial data. 5) Developing a questionnaire for the inclusion of emotional intelligence in the traditional evaluation framework.