Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Transcript: https://drive.google.com/file/d/1bx4bEE7rRG-vpcotOPM9vQUXcmx17vGh/view?usp=drive_link

Time:

Monday, May 20, 2024

1pm EDT | 5pm UTC

Agenda:

1:00 pm - 1:30 pm EDT: Presentation of 5 Lessons Learned Building AI Assessments (Presentation)

1:30 pm - 1:45 pm EDT: Q&A

1:45 pm - 2:00 pm EDT: Open Agenda

Assets:

  1. 5 Lessons Learned Building AI Assessments (Presentation)

  2. Open Source Templates

    1. Assistant Template - For phased interactions with an AI that involve user input, AI feedback, and optional AI scoring. Can build things like case study reviews, writing feedback, AI debates, etc.

    2. Completion Template - For one-off interactions with an AI, like generating MCQs

  3. Demo Apps

    1. Guided Case Study : A case study review where students review a case study, critically reflect on it, and receive AI-generated feedback that is guided by what the faculty thinks is important about the case study. 

    2. Writing Feedback  : A writing exercise where a student drafts an introduction paragraph for a grant application. Again, they receive AI-generated feedback that is guided by what the faculty thinks is important to include in their writing. They then have a chance to revise their original draft. 

    3. AI Debate : A student has a chance to engage in a debate with AI (in this case, about Digital Health in Medicine as the topic). The AI is guided to debate the student for two rounds and then summarize lessons learned and good points made by the student. 

    4. MCQ Wizard : Generate MCQ questions with optional feedback and hinting based on faculty requirements.

...