Small decisions. Interesting possibilities.Submit contentSubmit

MuJoCo robot-arm control

tested Jev as a real-time robotics policy in MuJoCo it struggled at first, so i split each update into two calls: decide what to do next, then decide how to move the arm and gripper Jev doesn’t accept images, it gets simplified geometry and contacts as text here

Added to Jevfast

How it uses Jev

The post says the MuJoCo controller sends Jev simplified geometry and contact information as text, then splits each update into two calls: decide the next action, then decide how to move the arm and gripper.

App workflow

  1. Convert simulator geometry and contacts to text

    Convert simulator geometry and contacts to text.

  2. Ask Jev what to do next

    Ask Jev what to do next.

  3. Ask Jev how to move the arm and gripper

    Ask Jev how to move the arm and gripper.

  4. Apply the movement in MuJoCo

    Apply the movement in MuJoCo.

Why it is interesting

Separating the task decision from motion control is a concrete adjustment made after the initial setup struggled.