What they did
The poster wanted to try mixing AI coding with motion tracking and music. Over one long session with Claude on Fable 5.2, they described the instrument, tested each version and reported back what was broken or missing. Claude wrote a single HTML file with no build step or backend. It uses MediaPipe hand tracking in the browser: you pinch with both hands and pull apart to leave a string in the air, then sweep a fingertip across it to play. Every sound is made live with the Web Audio API (Karplus-Strong for plucked strings, oscillators and FM for the rest), with a beat sequencer, a looper, chord-following, and video, MP3, WAV and stem export. The code and a live demo are on GitHub Pages.
How it went
The poster reports about two hours from start to finish, 83 requests and about 31 million tokens, nearly all of them cached re-reads, with about 286,000 tokens of output. It ran inside a Claude Max plan, so there was no separate bill. They say gesture detection took the most rounds: telling a pluck from a hold or a pull needed a dead zone against tracking jitter. One tester in the comments found it sometimes too touchy and sometimes slow to respond.
Worth knowing
Commenters in both threads pointed to an earlier Instagram reel of a near identical instrument and said the idea was copied; the poster had not credited it, though that one was not open source. It needs Chrome or Edge on a computer, good light and hands 40 to 80 cm from the camera. The post names the model but not the harness.