AI‑Driven Wealth & Portfolio Management Platform for Retail Banking Customers
MEHEARSAL, created by Muse Scene Lab, is a browser-based platform for collaborative rehearsals that enables musicians to practice with virtual bandmates. For our capstone project, we're collaborating with Muse Scene Lab to add two new features to the platform: a Web Audio Engine and a Hand Gesture Recognition system.
The Web Audio Engine extension introduces real-time synthesis for three additional instruments Rhodes MK-80 electric piano, electric bass, and acoustic guitar. Developed in C++ with JUCE and compiled to WebAssembly using Emscripten, it routes MIDI through Tone.js and the Web Audio API's AudioWorklet system into the WASM engine for real-time processing and playback. The Hand Tracking feature enables musicians to control the site and simulate leading a virtual band using natural movements detected by a regular webcam, leveraging MediaPipe Hands for landmark detection and gesture recognition, while WASM modules manage performance-critical tasks to ensure low latency. Only a browser and camera are needed, no specialized hardware is required.
The project is being built by a five-person team covering synth engine architecture, WASM/backend integration, gesture recognition, and frontend/UI design. The outcome is a technically ambitious platform that brings studio-quality, AI-assisted rehearsal to any web browser.








