The educational implications of the dynamic peda-agent as study buddy are astounding.
This visual outlines my multi-step pipeline for designing AI-powered dynamic Peda-Agents, also referred to as synthetic agents—which are animated digital tutors that support online [math] learning in emotionally intelligent and pedagogically meaningful ways. Starting with visual character creation (via any text-to-image models) and progressing through image-to-video generation, natural speech synthesis, and real-time audio-visual lip syncing (using tools such as WAN 2.1, OpenAI API, LatentSync), each step is carefully calibrated for educational effectiveness. In the final stage, the MathSpring (MS) research team at UMass Amherst conducts a human-in-the-loop review of the synthetic agent to ensure accuracy, tone, and alignment with instructional goals and MS teaching philosophy. This approach reflects our ongoing research to develop emotionally responsive, story-driven, and culturally aware math learning companions.
This work builds on my July 2023 original video demonstrating how to integrate generative AI with intelligent tutoring systems—and marks a pivotal step toward reimagining the future of learning companions as emotionally attuned, pedagogically rich, and culturally resonant guides in math education.
Image credits: Sai Gattupalli