Methods for Double-Blind Peer Review and Grade Prediction of Student Software Projects
In software engineering courses with many students, it is often impossible for a professor to give a detailed review of the software project for each student. One solution is to give students a task to make reviews for a few projects. One review consists of a comment on a project and a score. The score represents an ordinal number of the project when student sorts all projects in order by quality. The comment can be used as feedback to their colleagues and the score can be used in the final grade prediction. Double-blind peer review is used to prevent favoritism and unfairness. In the paper methods for random projects distribution, reviews gathering and analysis are presented. Methods have been used on over 100 projects and data gathered from them show moderate to high correlation with final grades. Project rank and project points have correlation factors from r=-0.6 to r=-0.66 and significance p<0.001. Projects have been independently graded with automatic tests.