StageCraft VR
Developed by a team of two for a client, StageCraft is a VR application that allows user to practice their presentation skills in front of a mock audience that can respond with questions and give feedback to the presenter.
The project utilizes OpenAI Whisper to transcribe the presentation audio and is then questions are generated using GPT 3.5 based on the contents of the presentation. The questions are then sent to AWS Polly text-to-speech system so the audience members can verbally interact with the presenter. Throughout the presentation various data are collected to find points of improvement for the presenter. The system will detect how often filler words are used and long pauses during the presentation. At the end, a heatmap of where the presenter is looking will be generated based on head tracking data.
Contributions:
- Presentation System
- Classrooms and User Settings Data
- UI
- Build Porting