What do students or photographers learn if AI is creating the end product? Do you grade the AI program?
Well, I’ve been retired since 2017 (in order to explore photography … another story), but off the top of my head:
Content Area: Undergraduate Computer Science.
Assignment summary: Given a problem statement (a specification?) the student will create a document that:
(1) Identifies the criteria for determining if the product is “correct"
(2) Identifies the AI program that will be used;
(3) Provides the student’s Plan for Assessing the AI’s product—which objectives, etc., will the student expect from the AI’s product, etc.
(4) Provides a copy of the prompts provided to the AI
(5) Contains the Students “grade” for what the AI produced—optionally justifying the grade given.
[If appropriate, students may have several iterations of steps 2 through 5, above. If so, these are likewise to be submitted.]
A variation of this type of assignment is: After step 1, above, students write their own solution to the problem. (Call this step 1*) In this variation, the student has an additional step (5*) Critically compare the AI product with the student’s solution.
Group assignment variation: Another variation is to have students exchange their Plans for Assessing the AI along with the solutions provided by the respective AI sessions. (Note students DO NOT exchange their own solutions or evaluations of the AI’s performance). Each student then performs a evaluation of both their and their partner’s sessions: such evaluation to compare and contrast (by some concrete criteria) both sessions/products and recommendations for the next “problem set” to be assessed by the class.
I could envision adapting and enlarging this assignment for a more advanced class in mathematics, theory, etc., to have students identify a theoretical point or—better— identify a known “hard” problem (expecting the program to either fail or hallucinate) and create their own evaluation criteria, annotated with justifications. The idea here is to determine when to trust AI solutions to human solutions given difficult settings.
As to whether I grade the AI program depends upon the course level/setting and my particular educational objective. This example would be for an intermediate undergraduate class looking at Software Engineering practices, etc. For an introductory level course (similar content), I would grade the program and submit my results to the class *after* students had completed the assignment.
I apologize for the length and any missing details in the description above. It’s been a while … .