Technology
What we've built, and what we're building.
Chapter 1
Hearing
It starts from an engine that hears every note.
The recognition engine
Under the page, it hears every note.
Lift the page; the engine comes apart.
It starts as sound: eight seconds, bars 1 to 3.
Sound is drawn as pitch over time.
A small model on the phone reads it.
Every key, judged more than 40 times a second.
The judgments become notes: pitch, start, end.
The follower finds each note on the page.
Back to one page: thirty-seven notes, heard.
40+/sec
Checks every key
88keys
Every one heard
Real time
Right on the phone
92–94%
Note accuracy¹
¹ On a public piano benchmark, across our current models.
Score following
You play. The page keeps up.
Lit notes and keys visualise what the engine reports.
The accompanying orchestra
An orchestra that listens, and follows you.
- You play
- The engine will conduct
- Each part will take its cue
Chopin, Piano Concerto No. 1 in E minor, Op. 11 · II. Romance · Bars 34–45 as printed
Chapter 2
Reading
It starts from sheet music on paper.
From paper to a live score
“Your left hand lets go the moment the right hand comes in.”
1 · Paper
It starts as the printed page on your stand.
2 · A live score
It will become a live score, clean on the screen.
Your marks on the score
3 · Your teacher's note
Your teacher's notes will land bar by bar.
4 · Your pencil
Your pencil will go there too: an arc, a circle.