Grading untrusted student code and 1000 untrusted student repos with Jenkins?
Hi, I'm interested in using Jenkins to help test and grade student code written for CS programming assignments. The code might be in a git repo or might be submitted on a web form. I need a security boundary because I don't trust the student code and also want to keep some things hidden from the students. So I cant just include the jenkinsfile in the students repo for example.
How would you recommend I use jenkins in each of these use cases? ...and which plugins will be useful?
For the first case assume I have 200 to 1000 student github repos that need to be graded overnight. I have say 50 local VMs ready to use - so CPU horsepower is not a problem. Typically I want to capture the unit test output, which tests pass and some kind of score too.
... and is there a plugin I can use to record the score / results to a database independently of the student repo?
For the second assume I have a web application backend that wants to enqueue a code snippet to be graded in the next 5 seconds.