WebMoti

Overview

Custom video conferencing interface for a research project studying hybrid learning for neurodivergent students. Twilio Video streamed two camera feeds (classroom overview + whiteboard) to remote participants, who could interact with a physical robotic hand.

Forked from the twilio-video-app-react open-source template and heavily customized:

• Toolchain migration: Create React App → Vite, React 16 → 19, MUI v4 → v7, Enzyme → React Testing Library
• Raise hand queue: students join an ordered speaker queue; the professor sees who’s next in real time
• Notify button: sends a customizable audio cue to the professor (tones or TTS voice clips), designed around neurodivergent communication needs
• Robot hand control: buttons trigger physical gestures (raise, wave, etc.) via the Python backend
• Classroom audio controls: remote mute, mic mixing, and volume controls across participant modes
• Camera controls: zoom, pan, rotation, and quality switching for the remote feeds, all keyboard-shortcut accessible
• Live captions: WebSocket overlay fed from a speech recognition stream
• Python/FastAPI backend: raise hand queue (SSE), captions WebSocket, TTS, session scheduling