top of page

LLM based VR Conversational Interface

In this project, we integrated a Large Language Model into Virtual Reality as a VR chatbot. As applications, we explored several scenarios such as using the VR chatbot for training communication skills for job training, practicing presentations Q&A and exploring presenting body language using LLMs.

Publications

Exploring the Use of Large Language Model-Driven Chatbots in Virtual Reality to Train Autistic Individuals in Job Communication Skills

Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems

Ziming Li, Pinaki Prasanna Babar, Mike Barry, Roshan L Peiris

Project Team

Hannah La
Vaidehi Kushare
Pinaki Babar
Ziming Li
Roshan Peiris
bottom of page