Avoiding Fuzzy Letter Grading Systems: Designed Research to Ensure Fair Translation of Academic Performance into Letter Grades That Provide Tangible Measures of the Skills International Employers Seek from College Graduates
pp. 76-92 | Published Online: June 2021 | DOI: 10.22521/unibulletin.2021.101.5
Background/purpose – College graduates from Small Island Developing States (SIDS) often seek regional and international employment. However, grading systems differ across countries and regions, making it difficult for international and regional employers to accurately interpret and translate foreign Letter Grades into the skills and personal attributes graduates need to secure regional and international employment. This study investigated the ability of SIDS to adequately represent on the global labor market the employability of their graduates after having completed a program specifically guided by learning outcomes, assessments, and Letter Grading.
Materials/methods – Bayesian statistics is considered robust in providing empirical evidence. Consequently, it was employed in this study to look for evidence linking the evaluation descriptors SIDS use in their Letter Grading System to the skills and levels their graduates actually attained in order to make them employable on equal grounds.
Results – The findings suggest that the Letter Grading System used by SIDS is inadequate for reliably communicating the level of academic mastery and competencies needed for graduating students to achieve employability on the international market.
Conclusion – Ultimately, SIDS must design and implement ambiguity-free, homogeneous Letter Grading Systems that include comprehensive qualitative indicators of the evaluation criteria used to rank their graduates if they are to convey valid and consistent messages to those who need to interpret them (i.e., prospective employers).
Keywords: Employability, Assessment, Bayesian statistics, Letter grade system.References
Alsuwaiket, M., Blasi, A. H., & Al-Msie'deen, R. A. (2019). Formulating module assessment for improved academic performance predictability in higher education. Engineering, Technology & Applied Science Research, 9(3), 4287-4291. https://doi.org/10.48084/etasr.2794
Chan, S. W., Ahmad, M. F., Zaman, I., & Ko., W. S. (2018). Employers’ perception on important employability skills in the manufacturing industry. International Journal of Engineering and Technology, 7(2-29), 170-175. http://dx.doi.org/10.14419/ijet.v7i2.29.13311
Contino, J. (2012). A case study of the alignment between curriculum and assessment in the New York State Earth Science standards-based system. Journal of Science Education and Technology, 22(1), 62-67. https://doi.org/10.1007/s10956-012-9376-x
Fletcher, R. B., Meyer, L. H., Anderson, H., Johnston, P., & Rees, M. (2012). Faculty and students’ conceptions of assessment in higher education. Higher Education, 64(1), 119-133. https://doi.org/10.1007/s10734-011-9484-1
Gervais, J. (2016). The operational definition of competency-based education. The Journal of Competency-Based Education, 1(2), 98-106. https://doi.org/10.1002/cbe2.1011
Ghani, E. K., Rappa, R., & Gunardi, A. (2018). Employers’ perceived accounting graduates’ soft skills. Academy of Accounting and Financial Studies Journal, 22(5). https://www.abacademies.org/articles/employers-perceived-accounting-graduates-soft-skills-7582.html
Jacob, B. A., & Levitt, S. D. (2003). Rotten apples: An investigation of the prevalence and predictors of teacher cheating. Quarterly Journal of Economics, 118(3), 843-877. https://doi.org/10.1162/00335530360698441
Kafle, B. (2020). Teachers’ Perception of Letter Grading System and Its Challenges a Qualitative Study in Vyas Municipality of Tanahun. American Journal of Educational Research, 8(9), 622-632. https://doi.org/10.12691/education-8-9-3
Kass, R. E., & Raftery, A. E. (1995). Bayes factors. Journal of the American Statistical Association, 90(430), 773-795. https://doi.org/10.1080/01621459.1995.10476572
Lisá, E., Hennelová, K., & Newman, D. (2019). Comparison between employers’ and students’ expectations in respect of employability skills of university graduates. International Journal of Work-Integrated Learning, 20(1), 71-82. https://www.ijwil.org/files/IJWIL_20_1_71_82.pdf
Liu, X., Zhang, B., Liang, L. L., Fulmer, G., Kim, B., & Yuan, H. (2009). Alignment between the physics content standard and standardized test: a comparison among US–NY, Singapore, and China-Jiangsu. Science Education, 93(5), 777-797. https://doi.org/10.1002/sce.20330
MacDonald, S. K., Williams, L. M., Lazowski, R. A., Horst, S. J., & Barron, K. E. (2014). Faculty attitudes toward general education assessment: A qualitative study about their motivation. Research & Practice in Assessment, 9(1), 74-90. https://www.rpajournal.com/faculty-attitudes-toward-general-education-assessment-a-qualitative-study-about-their-motivation/
Murdan, S. (2005). Exploring relationships between coursework and examination marks: A study from one school of pharmacy. Pharmacy Education, 5(2), 97-104. https://pharmacyeducation.fip.org/pharmacyeducation/article/view/112
Opstad, L. (2020). Why are There Different Grading Practices Based on Students’ Choice of Business Major? Educational Process: International Journal, 9(1), 43-57. https://doi.org/10.22521/edupij.2020.91.3
Ornstein, A. C. (1994). Grading practices and policies: An overview and some suggestions. NASSP Bulletin, 78(561), 55-64. https://doi.org/10.1177%2F019263659407856111
Pang, E., Wong, M., Leung, C. H., & Coombes, J. (2019). Competencies for fresh graduates’ success at work: Perspectives of employers. Industry and Higher Education, 33(1), 55-65. https://doi.org/10.1177%2F0950422218792333
Pazil, A. H. M., & Razak, R. C. (2019). Perspectives of Asian employers on graduates’ soft skills: A systematic review. Universal Journal of Educational Research, 7(11), 2397-2405. https://doi.org/10.13189/ujer.2019.071117
Stefan, A. M., Gronau., Q. F., Schönbrodt., F. D., & Wagenmakers, E.-J. (2019). A tutorial on Bayes Factor Design Analysis using an informed prior. Behavior Research Methods, 51(3), 1042-1058. https://doi.org/10.3758/s13428-018-01189-8
► New issue coming soon! (Volume 11 Issue 1, 2022)
► Call for Papers
UNIBULLETIN is calling for submissions. Authors are invited to submit papers from the all fields of the Education (General) and Social Sciences (General) in the international context. All submissions should be presented only in English.