Do local curriculum scores correlate with national residency test results? A pluriannual, nationwide survey of Italian Medical Universities

Submitted: 26 January 2021
Accepted: 9 February 2021
Published: 12 February 2021
Abstract Views: 1538
PDF: 708
Appendix: 114
HTML: 114
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Authors

In Italy, to match medical doctors to specialty residencies, the Minister of Education organizes a national multiple choice questions exam composed of 140 items. The curriculum grants additional points based on the candidates' grade average and graduation mark. Both national and international policies assume that curriculum scores can be evaluated in absolute terms, irrespective of the course attended by the candidate or its University of graduation. A fair inquiry over the current criteria of selection is not available to this day. Hence, this study aimed at investigating the degree of association between results in the Italian national residency test and the score given for each candidate's curriculum. We calculated Spearman's correlation coefficients between the score obtained at the 2019 test and curriculum scores. A moderate/high degree of correlation (rho=0.600) was reached. Spearman's rho ranged from 0.447 to 0.788, considering the single Universities. We thus measured a modest but non-negligible between-University variability. As differences between test and curriculum scores across institutions may determine the admission or not to the residency for many candidates, the authors call for broader attention on the topic.

Dimensions

Altmetric

PlumX Metrics

Downloads

Download data is not yet available.

PlumX Metrics

PlumX Metrics  provide insights into the ways people interact with individual pieces of research output (articles, conference proceedings, book chapters, and many more) in the online environment. Examples include, when research is mentioned in the news or is tweeted about. Collectively known as PlumX Metrics, these metrics are divided into five categories to help make sense of the huge amounts of data involved and to enable analysis by comparing like with like.

Citations

Directive 36/EC of the European Parliament and of the Council on the recognition of professional qualifications [Internet]; Sep 30, 2005. Available from: http://data.europa.eu/eli/dir/2005/36/oj/eng
Decree n. 859 from the Minister of Education for the admission test in the Italian medical specialty schools [Internet]; May 2, 2019. Available from: https://www.universitaly.it/index.php/content/ssm1819-normativa
European Commission. Regulated professions database [Internet]; ongoing [cited 2020 Apr 16]. Available from: https://ec.europa.eu/growth/tools-databases/regprof/index.cfm?action=homepage
Enpam - Eurispes. Il termometro della salute 1° Rapporto sul Sistema sanitario [Internet]; 2017 [cited 2020 Oct 15]. Available from: https://eurispes.eu/ricerca-rapporto/enpam-eurispes-il-termometro-della-salute-1-rapporto-sul-sistema-sanitario-2017/
Messick S. Standards of validity and the validity of standards in performance assessment. Educ Meas Issues Pract 1995;14:5-8. DOI: https://doi.org/10.1111/j.1745-3992.1995.tb00881.x
R Core Team. R: A language and environment for statistical computing. [Internet]. Vienna, Austria; 2020. Available from: https://www.R-project.org

How to Cite

Tarchi, L., Damiani, S., Marini, S., Cappelli, C., Liuzzi, G., Minerva, M., & Politi, P. (2021). Do local curriculum scores correlate with national residency test results? A pluriannual, nationwide survey of Italian Medical Universities. Italian Journal of Medicine, 15(2). https://doi.org/10.4081/itjm.2021.1470