Small decisions. Interesting possibilities.Submit contentSubmit

Just-in-time model selection in Goose

Experimentation with Jev from @typesafeai and our harness @goose_oss Use Jev to take a prompt and JIT select a model just before the turn runs. Jev and models like it will be useful in many areas and this is just early prototype code on a first idea

Added to Jevfast

How it uses Jev

Goose sends a prompt to Jev to select a model just before the turn runs.

App workflow

  1. Prepare a prompt

    A prompt is ready for a Goose turn.

  2. Select a model

    Jev makes the just-in-time model-selection decision.

  3. Run the turn

    The chosen model is used when the turn begins.

Why it is interesting

It places model selection at the point of use, so a routing decision can precede the model execution for each turn.