Kiel-3-Cyber is an open-weight model from Tech, released under Apache License 2.0. It has 7.6B parameters and a 32,768-token context. At 16-bit it needs about 18.3 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index.
Kiel-3-Cyber-7B is an elite autonomous cybersecurity expert model fine-tuned from Qwen2.5-Coder-7B-Instruct.
Runs On
What it takes to serve Kiel-3-Cyber (7.6B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.
| Precision | Weights | Memory needed | Cheapest setup | Per hour | Also fits |
|---|---|---|---|---|---|
| 16-bit | 15.2 GB | 18.3 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 8-bit | 7.6 GB | 9.1 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
| 4-bit | 3.8 GB | 4.6 GB | 1x MI300X (192 GB) Vultr |
$1.85 | 1x H100 $1.99 · 1x MI325X $2.00 |
Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 23, 2026.
Kiel-3-Cyber on every accelerator the SAVRN Index prices, at every precision
Model Card
By Tech, published under apache-2.0, revision 58509f8e5a71.
Kiel-3-Cyber-7B is an elite autonomous cybersecurity expert model fine-tuned from Qwen2.5-Coder-7B-Instruct. Designed specifically for advanced vulnerability analysis, threat modeling, code security reviews, and CVE parsing, Kiel-3-Cyber incorporates explicit Deep Chain-of-Thought (CoT) reasoning inside tags before delivering precise mitigation strategies. saidutta69/CyberSec-Reasoning-Premium moro72842/cybersecurity-sft-dataset AlicanKiraz0/All-CVE-Records-Training-Dataset nvidia/OpenCodeReasoning Kiel-3-Cyber is trained on a standardized multi-turn system/user/assistant prompt layout with explicit step-by-step reasoning wrappers: You can load and run Kiel-3-Cyber-7B using the standard…
Read Tech's full model card
Kiel-3-Cyber-7B
Kiel-3-Cyber-7B is an elite autonomous cybersecurity expert model fine-tuned from Qwen2.5-Coder-7B-Instruct. Designed specifically for advanced vulnerability analysis, threat modeling, code security reviews, and CVE parsing, Kiel-3-Cyber incorporates explicit Deep Chain-of-Thought (CoT) reasoning inside <think> tags before delivering precise mitigation strategies.
Model Details
- Base Model: Qwen2.5-Coder-7B-Instruct
- Fine-tuning Framework: Unsloth / Hugging Face TRL (
SFTTrainer) - Precision: 16-bit (Merged safetensors)
- Max Sequence Length: 1024 tokens (Inference context)
- Training Data Sources:
saidutta69/CyberSec-Reasoning-Premiummoro72842/cybersecurity-sft-datasetAlicanKiraz0/All-CVE-Records-Training-Datasetnvidia/OpenCodeReasoning
Prompt Structure
Kiel-3-Cyber is trained on a standardized multi-turn system/user/assistant prompt layout with explicit step-by-step reasoning wrappers:
<|start_header_id|>system<|end_header_id|>
You are Kiel-3-Cyber, an elite autonomous cybersecurity expert. You analyze vulnerabilities, parse code architectures, and formulate precise mitigations. Always reason step-by-step inside <think> tags before delivering your final answer.<|eot_id|>
<|start_header_id|>user<|end_header_id|>
{Your security or code analysis query here}<|eot_id|>
<|start_header_id|>assistant<|end_header_id|>
<think>
{Step-by-step threat analysis and vulnerability assessment}
</think>
{Final mitigation or code patch}
<|eot_id|>
Quick Start (Inference Example)
You can load and run Kiel-3-Cyber-7B using the standard Hugging Face transformers pipeline: ``` Python from transformers import AutoModelForCausalLM, AutoTokenizer import torch
model_id = "your_hf_username/kiel-3-cyber-7b" # Replace with your repo ID
tokenizer = AutoTokenizer.from_pretrained(model_id) model = AutoModelForCausalLM.from_pretrained( model_id, torch_dtype=torch.bfloat16 if torch.cuda.is_bf16_supported() else torch.float16, device_map="auto" )
prompt = """<|start_header_id|>system<|end_header_id|> You are Kiel-3-Cyber, an elite autonomous cybersecurity expert. You analyze vulnerabilities, parse code architectures, and formulate precise mitigations. Always reason step-by-step inside tags before delivering your final answer.<|eot_id|> <|start_header_id|>user<|end_header_id|> Perform an in-depth security review of this authentication controller code structure and identify any potential authorization bypass vectors.<|eot_id|> <|start_header_id|>assistant<|end_header_id|> """
inputs = tokenizer([prompt], return_tensors="pt").to("cuda") outputs = model.generate( **inputs, max_new_tokens=512, temperature=0.7, top_p=0.9, use_cache=True )
print(tokenizer.decode(outputs[0], skip_special_tokens=True)) Capabilities & Use Cases Vulnerability Identification: Pinpoints flaws such as SQL injection, Cross-Site Scripting (XSS), insecure deserialization, and authorization bypasses.
CVE Parsing & Mapping: Translates raw CVE records into structured risk assessments and remediation guidelines.
Secure Code Architecture: Evaluates software designs and refactors vulnerable code snippets securely.
Configuration
- Architecture
- Qwen2ForCausalLM
- Context length (tokens)
- 32,768
- Layers
- 28
- Hidden size
- 3,584
- Feed-forward size
- 18,944
- Attention heads
- 28
- Key/value heads
- 4
- Vocabulary size
- 152,064
- Stored precision
- bfloat16
- Model type
- qwen2
Identity and Version
- Repository
- kiel2/Kiel-3-Cyber
- Publisher
- Tech
- Task
- Not stated by the source
- Modality
- Other
- Library
- Not stated by the source
- Parameters
- 7.6B parameters
- Languages
- en
- Revision
- 58509f8e5a717d6db8372426bbb74e0d8cfe5b2d
- First published
- 2026-09-26
- Last updated
- 2026-10-05
Files and Weights
12 files, 15.2 GB in total. The weights are 4 files totalling 15.2 GB in safetensors.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| model-00001-of-00004.safetensors | Weights | 4.9 GB | dfcf0b02ae15 |
| model-00002-of-00004.safetensors | Weights | 4.9 GB | 05e0ade18f66 |
| model-00003-of-00004.safetensors | Weights | 4.3 GB | e0006063b706 |
| model-00004-of-00004.safetensors | Weights | 1.1 GB | 5aa6e5cbe642 |
| config.json | Configuration | 1.6 KB | — |
| generation_config.json | Configuration | 239 B | — |
| model.safetensors.index.json | Configuration | 27.8 KB | — |
| README.md | Documentation | 3.5 KB | — |
| chat_template.jinja | Other | 2.5 KB | — |
| .gitattributes | Repository | 1.6 KB | — |
| tokenizer.json | Tokenizer | 11.4 MB | ea43b2885426 |
| tokenizer_config.json | Tokenizer | 7.6 KB | — |
License and Download
- License
- apache-2.0
- Access
- Open weights, no gate
- Download size
- 15.2 GB
Released by Tech through its official repository on Hugging Face. Read the license.
Built From
- Adapter of unsloth/Qwen2.5-Coder-7B-Instruct
- Derived from unsloth/Qwen2.5-Coder-7B-Instruct
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 15.2 GB |
| 16-bit | 15.2 GB |
| 8-bit | 7.6 GB |
| 4-bit | 3.8 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About Kiel-3-Cyber
How much GPU memory does Kiel-3-Cyber need?
About 18.3 GB at 16-bit and 4.6 GB at 4-bit: the weights (7.6B parameters) plus a working margin. A long context needs more.
What is the cheapest GPU to run Kiel-3-Cyber on?
At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.
Can I use Kiel-3-Cyber commercially?
Yes. Kiel-3-Cyber is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.
What is Kiel-3-Cyber's context length?
32,768 tokens, from the maximum position embeddings in its published configuration.