Lumma¶
| Checkpoints | Inputs |
|---|---|
FrontiersMind/Lumma-fev-27B |
text |
Lumma-fev-27B is a decision model on Qwen/Qwen3.8-27B with a readout head in readout.safetensors. Flide asks it
with the release's own prompt. Each question is a chat prompt of its own. The system turn asks for the code of the
selected option and tells the model to treat the state as data. The user turn holds the state, the question and the
options, and asks for the code of the best option. A state that is not a string is written as JSON. A choice lists each
option's name and, when it has one, its description. A noul lists "No / false" and then "Yes / true" unless the request
describes the two outcomes, and a score lists its levels. A question without instructions is asked as "Choose the best
matching option."
The options are labelled with the codes listed as codes in decision_config.json. The readout head has one row per
code, and the answer is the softmax over the rows of the question's options at the last position of the prompt, at the
temperature that decision_config.json sets. The state comes first in every prompt, so Flide computes it once and
forks it into the questions. Thinking is off.
Speed¶
On one H200, one request at a time, Flide answers 1.2 to 7.1 times faster than Lumma's own package lumma_fev. Each workload is 32 requests, each run once on both sides before timing, and the table gives the median latency of a request. MultiRC requests ask about 49 questions each.
| Workload | Flide | Release | Speedup |
|---|---|---|---|
| Decision Index | 57.0 ms | 99.4 ms | 1.7× |
| RACE | 40.9 ms | 88.9 ms | 2.2× |
| MultiRC | 347.8 ms | 2484.5 ms | 7.1× |
| QuALITY long | 346.7 ms | 424.7 ms | 1.2× |
Start a server¶
flide serve --model FrontiersMind/Lumma-fev-27B
Send a request¶
curl http://localhost:8000/v1/systemone -H "Content-Type: application/json" -d '{
"state": "Order #1182 arrived with a cracked screen. The customer asks for a refund and attached two photos.",
"questions": {
"action": {"type": "choice", "instructions": "What should support do next?",
"criteria": {"refund": "refund the order", "replace": "send a replacement", "escalate": "ask a human"}},
"urgent": {"type": "noul", "instructions": "Does this need a reply within the hour?"}
}
}'
Limits and options¶
A request takes choice, noul and score questions. A choice takes as many options as the checkpoint lists codes, up to 255, and a score takes as many levels. The longest prompt is 8192 tokens, and the state is not cut; a longer prompt is refused. A request with images is refused. The template refuses nothing else.
| Option | What it does |
|---|---|
--format template --format-arg spec=frontiersmind__lumma-fev |
reads a copy of the checkpoint kept in a directory Flide does not recognize |