OpenThai-SystemOne-Ollama

OpenThai-SystemOne v0.3 for Ollama

OpenThai-SystemOne is an open Thai + English System One decision model (0.8B, Apache-2.0). It does not generate text: given a state (text or JSON) and typed questions it returns probabilities: choice between named options, noul (yes/no) and score on an ordered scale.

This repo is its Ollama build for Ollama's System One API (POST /v1/systemone, Ollama ≥ 0.35), the same API Ollama serves Nimble and Tev1 with. Everything runs on your machine; no API key.

ollama pull iapp/openthai-systemone                       # ollama.com: 0.8b (= 0.8b-q8_0), 0.8b-q4_K_M, 0.8b-bf16
ollama pull hf.co/iapp/OpenThai-SystemOne-Ollama:Q8_0     # the same files from this repo

The curl example below uses the hf.co name; with the ollama.com pull, use "model": "iapp/openthai-systemone".

curl http://localhost:11434/v1/systemone -d '{
  "model": "hf.co/iapp/OpenThai-SystemOne-Ollama:Q8_0",
  "state": {"ticket": "ลูกค้าแจ้งว่าโดนหักเงินซ้ำสองครั้ง ขอเงินคืนด่วน โทรมาสามรอบแล้ว"},
  "questions": {
    "department": {"type": "choice", "instructions": "ทีมใดควรรับผิดชอบ",
                   "criteria": {"billing": "การเงิน/ค่าบริการ", "technical": "ระบบใช้งานไม่ได้", "sales": null}},
    "frustration": {"type": "score", "instructions": "ลูกค้าหงุดหงิดแค่ไหน",
                    "criteria": ["ใจเย็น", "หงุดหงิดแต่สุภาพ", "โกรธมาก"]},
    "refund_requested": {"type": "noul", "instructions": "ลูกค้าขอเงินคืนอย่างชัดเจนหรือไม่"}
  }
}'

{"model": "hf.co/iapp/OpenThai-SystemOne-Ollama:Q8_0",
 "answers": {
   "department": {"type": "choice", "choice": "billing", "probabilities": {"billing": 0.9515, "technical": 0.0334, "sales": 0.0151}, "confidence": 0.7959},
   "frustration": {"type": "score", "score": 1.8771, "legend": {"0": "ใจเย็น", "1": "หงุดหงิดแต่สุภาพ", "2": "โกรธมาก"},
                   "probabilities": {"0": 0.0216, "1": 0.0797, "2": 0.8987}, "confidence": 0.6537},
   "refund_requested": {"type": "noul", "noul": 0.9805}},
 "usage": {"input_tokens": 741, "output_tokens": 4}}

(Probabilities rounded. The whole request is part of every question's prompt, so the same question can score slightly differently next to other questions.)

How this build differs from the main repo

Ollama does not run OpenThai-SystemOne's 256-slot decision head. For each question it renders one chat prompt (the whole request as JSON plus Requested field: "<name>", with the model's Qwen3.5 chat template and thinking off) and reads the next-token probabilities of the answer letters A–Z. The weights here are therefore v0.3 fine-tuned for that prompt:

• 3,000 steps (192k questions) on the v0.3 training mix, rendered exactly as Ollama 0.35 renders them (a byte-exact port of Ollama's decision/systemone.go, checked against Go) and tokenized by llama.cpp, as Ollama's runner does.
• Loss = cross-entropy over the question's candidate letters only, which is the softmax Ollama computes.
• One temperature, fitted on held-out records, is folded into the final norm (Ollama always scores at temperature 1).
• The GGUF files are a plain Qwen3.5 (qwen35) text model with tied embeddings; the Modelfile / system file sets the system prompt the model was trained with and num_ctx 8192.

Compared with the main repo's own API (pip install openthai-systemone): Ollama allows 2–26 options per question (the main API: 255), runs one prompt per question (the shared prefix is cached), and has no order-invariant mode and no abstain answer.

Evaluation (through Ollama 0.35)

All columns were run by us through Ollama's /v1/systemone on the same records: the first 800 of each set, keeping only records whose questions have ≤ 26 options (Ollama's limit; drops banking77 and the 60-way MASSIVE-th intents). The first column is the original v0.3 weights with their 256-slot head on the same records, for reference. choice / noul = accuracy, score = exact level. Harness: scripts/25_competitor_eval.py --model ollama:<name> --max-options 26 in the GitHub repo.

Public 13 subsets (Bespoke Nimble's public benchmark)

Thai sets (8 sets, 12 rows; wisesight and SIB-200 held out of training)

Latency (median end to end through Ollama, one model loaded, idle H100, Thai requests): 1 question 23 ms (Q8_0), 23 ms (Q4_K_M), 26 ms (BF16); 3 questions 136 / 127 / 142 ms. Same setup: Tev1 0.8B 22 / 102 ms, Tev1 4B 66 / 406 ms, Nimble 9B 69 / 392 ms. Ollama runs one prompt per question, reusing the shared prefix.

BF16 scores the same as Q8_0 (public 74.3, Thai 82.5).

Files

Modelfile builds the same model from a local file (ollama create openthai-systemone -f Modelfile); system and params are what ollama pull hf.co/... applies.

Limits

• Up to 26 options per question (Ollama). For more options, bucket them, or use the main repo's API (255 options).
• Not a chat model: ollama run will produce text, but the model was only trained to answer /v1/systemone prompts.
• A small model: use confidence and route low-confidence decisions to a bigger model or a person.

License

Apache-2.0. Built by iApp Technology / OpenThai on Qwen3.5-0.8B-Base (Apache-2.0). Not affiliated with TypeSafe AI, Bespoke Labs or Together AI.