Skip to content

mammoth

Checkpoints Inputs
baselabs/mammoth-1, baselabs/elephant-1 text

mammoth-1 (27B) and elephant-1 (9B) are Base Labs' decision models on Qwen3.5. Their release serves them with OneJev's qev and a patch, so Flide serves them with the OneJev family: OneJev's prompt for every question, the answer slots read from the output head at the question's last token, and the calibration.json next to the weights when a checkpoint ships one (these two ship none).

They read a prompt in two blocks. In the full-attention layers the system turn and the state see each other in both directions, and so do the tokens of one question with its options and answer line; a question sees the state, and the state never sees a question. The Gated DeltaNet layers stay causal. The checkpoints say so in readout.json and under modeling_overrides in config.json, and Flide reads it at load. The state is still computed once and forked into the questions, each block read whole, and the state block ends where the question text starts, as in the release.

Speed

On one H200, one request at a time, Flide answers 1.6 to 4.9 times faster with mammoth-1 and 2.0 to 7.9 times faster with elephant-1 than their own engine.py on OneJev's qev with the checkpoints' serve.patch (transformers 5.19 with block masks, torch 2.8). Each workload is 32 requests, each run once on both sides before timing, and the table gives the median latency of a request. MultiRC requests ask about 49 questions each.

mammoth-1

Workload Flide Release Speedup
Decision Index 61.9 ms 203.7 ms 3.3×
RACE 41.4 ms 201.0 ms 4.9×
MultiRC 433.9 ms 982.6 ms 2.3×
QuALITY long 352.5 ms 571.9 ms 1.6×

elephant-1

Workload Flide Release Speedup
Decision Index 19.8 ms 104.7 ms 5.3×
RACE 12.9 ms 102.0 ms 7.9×
MultiRC 133.1 ms 447.5 ms 3.4×
QuALITY long 109.2 ms 219.5 ms 2.0×

Start a server

flide serve --model baselabs/mammoth-1

Send a request

curl http://localhost:8000/v1/systemone -H "Content-Type: application/json" -d '{
  "state": "Order #1182 arrived with a cracked screen. The customer asks for a refund and attached two photos.",
  "questions": {
    "action": {"type": "choice", "instructions": "What should support do next?",
               "criteria": {"refund": "refund the order", "replace": "send a replacement", "escalate": "ask a human"}},
    "urgent": {"type": "noul", "instructions": "Does this need a reply within the hour?"}
  }
}'

Limits and options

A request takes choice, noul and score questions, with OneJev's limits: a choice with more options than the model has answer slots is asked in chunks, so a choice takes up to 256 options, and a score takes as many levels as the model has slots. The longest state plus question is 32768 tokens and the longest request 65536. A request with images is refused, as the release reads text only.

Option What it does
?debias=3 asks each question in 3 cyclic shifts of its options and combines them (default 1, the order given)