Responsible AI(Day 2)

Responsible AI(Day 2)

Agenda

Day 2, February 27, 2024

Time

Speaker(s)

Event/Title

Session 1: 9:00-10:30 am

9:00 am - 9:10 am

James Sharpnack (Duolingo)

Opening Remarks (10min)

9:10 am - 10:15 am

Virginia Dignum (Umea Univ)

Introduction: Jill Burstein

Keynote (1hr): Beyond AI hype: Responsible governance; Challenges and opportunities for next generation AI in education (tentative)

10:15 am - 10:30 am

Poster spotlight presenters

Poster spotlights (2min each):

  1. Towards an Educator-Centered Method for Measuring Bias in Large Language Model-Based Chatbot Tutors [poster]
  2. Could ChatGPT be an Engineer? Evaluating Higher Education Vulnerability to AI Assistants
  3. Identifying Vulnerabilities and Fortifying Defenses in Automated Short-Answer Grading
  4. Evaluation of the instance weighting strategy for transfer learning of educational predictive models [slide]
  5. Exploring the Relationship Between Feature Attribution Methods and Model Performance

Break: 10:30am - 11:00am (Posters; light refreshments available near session rooms)

Session 2: 11:00 am - 12:30 pm

11:00 am - 11:30 am

Emma Brunskill (Stanford Univ)

Talk (30min): Reinforcement learning and education and augmenting teachers, and maybe proxy rewards

11:30 am - 12:20 pm

Panelists:

Dora Demszky, Sue Lottridge, Matthew Johnson, Cristina Conati

Moderator: Lydia Liu

Panel 1 (50min): Responsibly developing, evaluating, and using (Generative) AI for education

12:20 pm- 12:30 pm

Jill Burstein

Pre-lunch announcements

Lunch: 12:30-2:00 pm

Session 3: 2:00pm - 3:30pm

2:00 pm - 2:30 pm

Victoria Yaneva (NBME)

Talk (30min): LLMs and Educational Assessment in Medicine: Is Generating Clinically Accurate Test Content Within Reach?

2:30pm - 3:00 pm

Will Belzak (Duolingo)

Talk (30min): Evaluating Measurement Bias in Highly-Diverse Populations of Test Takers

3:00 pm - 3:30 pm

Renzhu Yu (Columbia University)

Talk (30min): Digital Inequalities in the Era of LLMs

Break: 3:30 - 4:00 pm (Posters)

Session 4: 4:00 pm - 5:00pm

4:00 pm - 4:50 pm

Panelists:

AJ Alvero, Carrie Demmans Epp, Lavar Edmonds, Michael Madaio, & Caroline & Michael Running Wolf

Moderator: Serena Wang

Panel 2 (50min): Centering Equity and Underserved Populations (or "underserved communities") in AI4ED: Opportunities and challenges

4:50 pm - 5:00 pm

Jill Burstein (Duolingo)

Closing remarks (10min)

Collaborating Organizations

Collaborating Organizations