Playing chords with hand signs: your fingers are the new instrument
Making music by moving your hands through the air isn't a new idea. In the 1920s, Leon Theremin built an instrument that read the electric field around two antennas: the theremin. You moved your hands through empty space and produced sound without touching anything. The catch was that the theremin was brutally difficult — pitch was continuous, and the slightest tremor ruined the note.
Today we have the one thing the theremin couldn't offer: a computer that understands your hand. Hand tracking turns that continuous, slippery space into discrete, dependable signs.
What does the camera see in your hand?
Air Chord detects the 21 joints of your hand thirty times a second: the wrist, the knuckles of your palm, and the three joints of every finger. Those points form a skeleton, and the system reads three things from it:
- How many fingers are open — sets the degree of the chord (1 through 7)
- The tilt angle of your hand — turns the chord major or minor
- The rotation of your palm — changes the character of the sound (the effects)
One important detail: the video never leaves your device. The recognition model runs inside the browser, and the camera stream is never sent to any server.
From finger count to chord
The system reads your finger count not as a specific note, but as a scale degree. That distinction changes everything: two fingers plays B° in A minor and Dm in C major. Your hand movements stay the same while the music adapts to whatever key you chose.
Major and minor: the angle of your wrist
Sometimes you want to hear the same degree sound wistful, and sometimes bright. You don't need to learn a separate sign for that — you just tilt your wrist. Tilt it inward and the chord turns major; tilt it outward and it turns minor. Keep your hand upright and you get the scale's own chord.
The nice thing about this design is that the gesture matches the emotion: a small turn of the same hand changes the color of the music, just like a guitarist striking the same chord hard or soft.
6 tips for nailing every sign
- Mind the light: Strong light behind your hand (a window) makes recognition harder. Let the light fall on your face instead.
- Distance: Hold your hand at chest height, 40–70 cm from the camera.
- Spread your fingers: On the two- and three-finger signs, don't let your fingers stick together.
- Palm toward the camera: Show the inside of your hand, not the edge.
- Make clean transitions: When changing degree, drop briefly to neutral and then form the new sign decisively.
- Plain background: Avoid other moving hands or busy patterns behind you.
Why is this better than tapping a screen?
You can tap chord buttons on a phone too — but your eyes end up locked on the screen. Playing in the air keeps your head up, your hands visible and your gaze on the camera. When you're singing, that difference shows up in both your voice and your video: easier breathing, a more natural posture, and a far more striking image.
Like learning a new instrument — only shorter
Every instrument has a learning curve. Air Chord's is measured in minutes: five signs and one wrist movement. Yet its expressive range isn't shallow — degrees, chord quality, octaves, distortion, arpeggios and rhythm layers give you hours of depth to explore.
Raise your hands and give it a try. Worst case, you lose five minutes; best case, the distance between you and music closes completely.