Inspiration
All of us are musicians, and we've all had the same problem: practicing alone, you don't always know what you're getting wrong. A note is a little flat, an entrance is a bit late, and nobody's there to catch it. We started with singing, where it's the hardest to hear yourself, and built an app that shows you exactly where you went wrong, directly on the sheet music.
What it does
Gensing lets you sing through a piece and see exactly how it went. Upload your sheet music and record yourself singing it. Gensing listens to the recording and gives you the sheet music back with every note colored by how you did. It shows whether you were in tune, a little sharp or flat, on the wrong note, early or late, or whether you skipped a note or added one.
On top of that, you get an overall score and a few tips on what to work on and how to fix it. If you want to hear a mistake, click the note and it plays back that part of your recording.
How we built it
We built Gensing with React, FastAPI and Python. music21 reads the sheet music and librosa tracks the pitch of your voice. From there, our own algorithm turns your recording into notes, matches them to the score, and grades them. Claude then turns the results into feedback.
Challenges we ran into
The hardest part was turning a recording into notes. Voices slide, wobble, and repeat notes, so finding where one note ends and the next begins took a lot of tuning. Matching those notes to the score was tricky too, since one missed note could throw off everything after it.
Accomplishments that we're proud of
We're proud that it actually works from start to finish. You can sing a piece and get your sheet music back with every mistake marked in the right place. Most singing apps only show a pitch line, but Gensing tells you which note went wrong, how, and where in the piece. We're also proud of the UI. We gave it a retro desktop look that makes it fun to use. Building all of that in 24 hours, with each of us working on a different part, is something we're really proud of.
What we learned
We learned that something easy for a musician, like telling two notes apart, is really hard to teach a computer.
What's next for Gensing
Next, we want to fine-tune Gensing so the algorithm adjusts to the style of music you're singing. We also want to support more complex classical and opera singing, and eventually expand to other instruments, so any musician can get the same note-by-note feedback.
Built With
- claude
- cursor
- fastapi
- librosa
- music21
- opensheetmusicdisplay
- python
- react
- typescript
- vite
