Small decisions. Interesting possibilities.Submit contentSubmit

Both hands on a piano, in real time

@typesafeai's Jev controls the 2 hands and each finger to play the piano in real-time. Jev only "sees" what we see and plays this from the "note waterfall". It uses @browser_use's jev-ultrafast and some decision scheduling to make this happen in real-time. Sound on ๐Ÿ”ˆ๐Ÿ”‰๐Ÿ”Š

Added to Jevfast

How it uses Jev

Jev controls both hands and each finger using the visible note waterfall as input. The post says jev-ultrafast and decision scheduling support real-time play, but does not describe the decision state or outputs.

App workflow

  1. Read the visible note waterfall

    Read the visible note waterfall.

  2. Schedule Jev decisions for piano control

    Schedule Jev decisions for piano control.

  3. Translate decisions into hand and finger actions

    Translate decisions into hand and finger actions.

  4. Play the notes in real time

    Play the notes in real time.

Why it is interesting

The example combines a bounded visual input with scheduling to coordinate many simultaneous controls.