GGUF exports of reaperdoesntknow/Qwen3.5-2B-CyberSec for local inference with llama.cpp-compatible runtimes.
The source model is associated with the Trendyol Cybersecurity Instruction Tuning Dataset. No benchmark or safety-evaluation results are published with this GGUF release.
Available files
| File |
Reported size |
Practical use |
Qwen3.5-2B.BF16.gguf |
3.90 GB |
Highest-fidelity GGUF build |
Qwen3.5-2B.Q8_0.gguf |
2.08 GB |
High-quality quantized build |
Qwen3.5-2B.Q4_K_M.gguf |
1.31 GB |
Recommended local starting point |
Qwen3.5-2B.BF16-mmproj.gguf |
repository artifact |
Multimodal projector; see caveat below |
Run locally
llama-cli \
-hf reaperdoesntknow/Qwen3.5-2B-CyberSec-GGUF:Q4_K_M \
--jinja
With Ollama:
ollama run hf.co/reaperdoesntknow/Qwen3.5-2B-CyberSec-GGUF:Q4_K_M
Multimodal note
A BF16 projector file is present, and the source-model configuration includes vision components. This release does not include a documented multimodal smoke-test receipt. Verify the projector, prompt format, runtime version, and image path before claiming multimodal support.
Intended use
- Local qualitative evaluation of the source checkpoint.
- CPU or consumer-GPU experimentation.
- Comparison of BF16, Q8_0, and Q4_K_M output quality.
Limitations and safety
- Quantization can change quality and behavior relative to the source checkpoint.
- The release has no published benchmark, regression, or safety report.
- Generated security instructions may be wrong, unsafe, or dual use.
- Do not execute generated commands without review and isolation.
- Do not rely on the model as an authoritative security control or decision-maker.
Lineage and license
Part of the CIx cybersecurity model collection.
