# qwen2.5-0.5b-topo-governed-cbp-fineweb by Frank Morales Source: https://savrn.com/models/qwen2-5-0-5b-topo-governed-cbp-fineweb Markdown alternate of the page above; the site index is https://savrn.com/llms.txt --- ## Runs On What it takes to serve qwen2.5-0.5b-topo-governed-cbp-fineweb (494M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them. | Precision | Weights | Memory needed | Cheapest setup | Per hour | Also fits | | --- | --- | --- | --- | --- | --- | | 16-bit | 1.0 GB | 1.2 GB | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) (192 GB) Vultr | $1.85 | [1x H100](https://savrn.com/ai-index/pricing/gpus/h100) $1.99 · [1x MI325X](https://savrn.com/ai-index/pricing/gpus/mi325x) $2.00 | | 8-bit | 0.5 GB | 0.6 GB | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) (192 GB) Vultr | $1.85 | [1x H100](https://savrn.com/ai-index/pricing/gpus/h100) $1.99 · [1x MI325X](https://savrn.com/ai-index/pricing/gpus/mi325x) $2.00 | | 4-bit | 0.2 GB | 0.3 GB | 1x [MI300X](https://savrn.com/ai-index/pricing/gpus/mi300x) (192 GB) Vultr | $1.85 | [1x H100](https://savrn.com/ai-index/pricing/gpus/h100) $1.99 · [1x MI325X](https://savrn.com/ai-index/pricing/gpus/mi325x) $2.00 | Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the [SAVRN Index](https://savrn.com/ai-index/pricing/gpus), read Oct 7, 2026. [qwen2.5-0.5b-topo-governed-cbp-fineweb on every accelerator the SAVRN Index prices, at every precision](https://savrn.com/models/qwen2-5-0-5b-topo-governed-cbp-fineweb/gpus) ## Model Card By Frank Morales, published under apache-2.0, revision 87e0aba84982. article: https://medium.com/ai-simplified-in-plain-english/the-architecture-of-permanence-how-topo-cbp-tamed-the-uncharted-stream-a17c1d8425af ### Qwen2.5-0.5B-Topo-Governed-CBP-FineWeb An open-weights causal transformer checkpoint evaluating the synthesis of Continual Backpropagation (CBP) and the Topological Governor (TOPO-2026) under non-stationary online web streaming. This model validates that an autoregressive foundation model can continuously adapt to streaming data without experiencing representational drift or catastrophic forgetting on silicon. - Base Model: Qwen/Qwen2.5-0.5B - Governing Framework: TOPO-2026 Topological Governor - Training Protocol: Continual Backpropagation with dual-phase manifold projection - Streaming Dataset: HuggingFaceFW/fineweb-edu (sample-10BT) - Optimization Horizon: 5,000 continuous gradient steps - Execution Seed: 123 (deterministic across Python, NumPy, PyTorch, and CUDA) - Companion Code: [GitHub: CDL_CBP_TOPO.ipynb](https://github.com/frank-morales2020/AST/blob/main/CDL_CBP_TOPO.ipynb) ### Model Summary [Read the full model card (894 words)](https://savrn.com/models/qwen2-5-0-5b-topo-governed-cbp-fineweb/card) ## Configuration Architecture Qwen2ForCausalLM Context length (tokens) 32,768 Layers 24 Hidden size 896 Feed-forward size 4,864 Attention heads 14 Key/value heads 2 Vocabulary size 151,936 Model type qwen2 ## Identity and Version Repository frankmorales2020/qwen2.5-0.5b-topo-governed-cbp-fineweb Publisher Frank Morales Task Text generation Modality Text Library Not stated by the source Parameters 494M parameters Languages en Revision 87e0aba84982394dfa933a3221c5ab10282fb567 First published 2026-09-25 Last updated 2026-09-27 ## Files and Weights 8 files, 999.5 MB in total. The weights are 1 file totalling 988.1 MB in safetensors. Weights1 file · 988.1 MB Configuration2 files · 1.4 KB Tokenizer2 files · 11.4 MB Documentation1 file · 9.0 KB Other1 file · 2.4 KB Repository1 file · 1.6 KB Every file | File | Type | Size | SHA-256 | | --- | --- | --- | --- | | model.safetensors | Weights | 988.1 MB | c8a0fd8978dd | | config.json | Configuration | 1.3 KB | — | | generation_config.json | Configuration | 139 B | — | | README.md | Documentation | 9.0 KB | — | | chat_template.jinja | Other | 2.4 KB | — | | .gitattributes | Repository | 1.6 KB | — | | tokenizer.json | Tokenizer | 11.4 MB | 12ada7d4fbf1 | | tokenizer_config.json | Tokenizer | 697 B | — | ## License and Download License apache-2.0 Access Open weights, no gate Download size 988.1 MB [Download from Frank Morales](https://huggingface.co/frankmorales2020/qwen2.5-0.5b-topo-governed-cbp-fineweb) Released by Frank Morales through its official repository on Hugging Face. [Read the license](https://www.apache.org/licenses/LICENSE-2.0). ## Built From - Derived from [Qwen/Qwen2.5-0.5B](https://savrn.com/models/qwen2-5-0-5b) - Trained on (disclosed) [HuggingFaceFW/fineweb-edu](https://savrn.com/datasets/fineweb-edu) ## Memory Requirements | Precision | Weights in memory | | --- | --- | | As published | 988.1 MB | | 16-bit | 1.0 GB | | 8-bit | 0.5 GB | | 4-bit | 0.2 GB | Weights only, from the published parameter count; the key-value cache and runtime add to this. ## Questions About qwen2.5-0.5b-topo-governed-cbp-fineweb ### How much GPU memory does qwen2.5-0.5b-topo-governed-cbp-fineweb need? About 1.2 GB at 16-bit and 0.3 GB at 4-bit: the weights (494M parameters) plus a working margin. A long context needs more. ### What is the cheapest GPU to run qwen2.5-0.5b-topo-governed-cbp-fineweb on? At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists. ### Can I use qwen2.5-0.5b-topo-governed-cbp-fineweb commercially? Yes. qwen2.5-0.5b-topo-governed-cbp-fineweb is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors. ### What is qwen2.5-0.5b-topo-governed-cbp-fineweb's context length? 32,768 tokens, from the maximum position embeddings in its published configuration. ## Similar Models Model · Text generation ### [Qwen2.5-0.5B-Instruct](https://savrn.com/models/qwen2-5-0-5b-instruct) [Qwen](https://savrn.com/model-publishers/qwen) Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models in these domains. - Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g, tables), and generating structured outputs especially JSON. More resilient to the diversity of system prompts, enhancing role-play implementation and… Open weights apache-2.0 494M parameters 32,768 tokens transformers [View model](https://savrn.com/models/qwen2-5-0-5b-instruct) Model · Text generation ### [Qwen2.5-0.5B](https://savrn.com/models/qwen2-5-0-5b) [Qwen](https://savrn.com/model-publishers/qwen) Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models in these domains. - Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g, tables), and generating structured outputs especially JSON. More resilient to the diversity of system prompts, enhancing role-play implementation and… Open weights apache-2.0 494M parameters 32,768 tokens transformers [View model](https://savrn.com/models/qwen2-5-0-5b) Model · Text generation ### [Qwen2-0.5B](https://savrn.com/models/qwen2-0-5b) [Qwen](https://savrn.com/model-publishers/qwen) Qwen2 is the new series of Qwen large language models. For Qwen2, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters, including a Mixture-of-Experts model. This repo contains the 0.5B Qwen2 base language model. Compared with the state-of-the-art opensource language models, including the previous released Qwen1.5, Qwen2 has generally surpassed most opensource models and demonstrated competitiveness against proprietary models across a series of benchmarks targeting for language understanding, language generation, multilingual capability, coding, mathematics, reasoning, etc. For more details, please refer to our blog… Open weights apache-2.0 494M parameters 131,072 tokens transformers [View model](https://savrn.com/models/qwen2-0-5b) Model · Text generation ### [DeepReasoning_1R](https://savrn.com/models/deepreasoning-1r) [Convergent Intelligence](https://savrn.com/model-publishers/reaperdoesntknow) Part of the Standalone Models by Convergent Intelligence LLC: Research Division DistilQwen Collection — Our only BF16 series. Proof-weighted distillation from Qwen3-30B-A3B → 1.7B and 0.6B on H100. Three teacher variants (Instruct, Thinking, Coder), nine models, 2,788 combined downloads. The rest of the portfolio proves structure beats scale on CPU. This collection shows what happens when you give the methodology real hardware. This model is part of the Convergent Intelligence LLC: Research Division portfolio. All models in this portfolio are developed under the Discrepancy Calculus (DISC) framework — a measure-theoretic approach to understanding and controlling the gap between what a model… Open weights 494M parameters 32,768 tokens transformers [View model](https://savrn.com/models/deepreasoning-1r) Model · Text generation ### [math-slm-qwen2.5-0.5b-v4](https://savrn.com/models/math-slm-qwen2-5-0-5b-v4) [Mandavi Singh](https://savrn.com/model-publishers/singhmandavi) A domain-specific small language model for step-by-step math problem solving, built by team03 (SLM Learners) for the Pramana SLM++ Bootcamp Round 2 submission. For an OpenAI-compatible endpoint, serve with servehf.py (stdlib + transformers only, no Ollama needed). Precision note: training ran in bf16 compute (QLoRA 4-bit NF4 base), but the merged checkpoint uploaded here is float16 (the merge step reloads the base in fp16). - Public Hugging Face datasets pulled via pulldata.py; licenses verified through the HF API on 2026-09-05 and recorded in datamanifest.md. - Held-out eval set built with buildheldouteval.py from raw ExamBench rows never used in training, with a final overlap check that… Open weights apache-2.0 494M parameters 32,768 tokens [View model](https://savrn.com/models/math-slm-qwen2-5-0-5b-v4) Model · Text generation ### [Lurfa-1.3](https://savrn.com/models/lurfa-1-3) [Noeme](https://savrn.com/model-publishers/noeme) This is the model card of a transformers model that has been pushed on the Hub. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model. Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019). Open weights 494M parameters 32,768 tokens transformers [View model](https://savrn.com/models/lurfa-1-3) ## Frank Morales [All models and datasets](https://savrn.com/model-publishers/frankmorales2020) ## Versions - [87e0aba84982](https://savrn.com/models/qwen2-5-0-5b-topo-governed-cbp-fineweb/versions/87e0aba84982) · current 2026-09-27 ## Explore More - [All text generation models](https://savrn.com/models/tasks/text-generation) - [All models under apache-2.0](https://savrn.com/models/licenses/apache-2-0) - [Model comparisons](https://savrn.com/models/comparisons) - [The model directory](https://savrn.com/models) - [Open model prices by host](https://savrn.com/ai-index/pricing/open-models) ## Source - Repository metadata, read 2026-09-27. - [Hugging Face record](https://huggingface.co/frankmorales2020/qwen2.5-0.5b-topo-governed-cbp-fineweb) - [How the hub is built](https://savrn.com/model-hub/methodology)