Skip to content

JADE

Checkpoints Inputs
theunnecessarythings/JADE text

JADE is a LoRA adapter on Qwen/Qwen3.8-27B. Flide reads the adapter the release serves with vLLM, in vllm-adapter/: rank-8 LoRAs on the projections and a rank-256 LoRA on the output head, all at the scaling its configuration gives (alpha over r). Flide runs them beside the base weights and reads the output head's rows of the answer codes with their LoRA, with no extra package.

Flide asks it with the release's own prompt. Each question is a chat prompt of its own. The system turn asks for the code of the selected option and tells the model to treat the state as data. The user turn holds "State:" with the state, "Question:" with the question, and "Options:" with one line per option, and asks for the letter code of the best option. A state that is not a string is written as JSON. A choice lists each option's name and, when it has one, its description. A noul lists "No / false" and then "Yes / true" unless the request describes the two outcomes. A question without instructions is asked as "Choose the best matching option.".

The options are labelled with the codes of decision_config.json, and the answer is the softmax over the codes of the question's options at the first token of the reply, at the temperature that decision_config.json sets. The state comes first in every prompt, so Flide computes it once and forks it into the questions. Thinking is off.

Speed

On one H200, one request at a time, Flide answers 1.7 to 9.2 times faster than JADE's own JadeEngine on vLLM 0.30. Each workload is 32 requests, each run once on both sides before timing, and the table gives the median latency of a request. MultiRC requests ask about 49 questions each. The release keeps a prefix cache across requests, so it is emptied after that first run and the timed requests are read afresh on both sides.

Workload Flide Release Speedup
Decision Index 61.6 ms 123.3 ms 2.0×
RACE 44.1 ms 102.5 ms 2.3×
MultiRC 368.5 ms 3379.9 ms 9.2×
QuALITY long 367.6 ms 642.2 ms 1.7×

Start a server

flide serve --model theunnecessarythings/JADE

Send a request

curl http://localhost:8000/v1/systemone -H "Content-Type: application/json" -d '{
  "state": "Order #1182 arrived with a cracked screen. The customer asks for a refund and attached two photos.",
  "questions": {
    "action": {"type": "choice", "instructions": "What should support do next?",
               "criteria": {"refund": "refund the order", "replace": "send a replacement", "escalate": "ask a human"}},
    "urgent": {"type": "noul", "instructions": "Does this need a reply within the hour?"}
  }
}'

Limits and options

A request takes choice and noul questions, and a score is refused. A choice takes up to 255 options. The longest prompt is 8191 tokens; a longer prompt is refused. A request with images is refused.

Option What it does
--format template --format-arg spec=theunnecessarythings__jade reads a copy of the checkpoint kept in a directory Flide does not recognize