SAVRN
Search Contact SAVRN

Open-weight model · Text generation

SharperSwarm

by Convergent Intelligence reaperdoesntknow/SharperSwarm

SAGI (Swarm AGI) is a novel causal language model that integrates swarm intelligence dynamics with transformer architecture.

Parameters103M
Context1,024
Weights412.8 MB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads4.3k

Runs On

What it takes to serve SharperSwarm (103M parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 0.2 GB 0.2 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 0.1 GB 0.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Sep 18, 2026.

Model Card

By Convergent Intelligence, published under apache-2.0, revision c0ed9a32e7e7.

SAGI (Swarm AGI) is a novel causal language model that integrates swarm intelligence dynamics with transformer architecture. The model treats cognition as a dynamic, adaptive system where multiple internal "agents" collaborate through differentiable routing, trust mechanisms, and shared memory. V3.2 introduces a revolutionary Self-Assessment Layer, allowing the system to predict its own performance, identify skill gaps, and autonomously design its own learning curriculum. 1. Pre-Assessment: Predict success, identify risks, recommend strategy. 2. Execution: Generate with selected strategy. 3. Real-Time Monitoring: Catch and correct errors during generation. 4. Post-Assessment: Update skill…

Read Convergent Intelligence's full model card

SAGI V3.2 - SELF-AWARE AGI

SAGI (Swarm AGI) is a novel causal language model that integrates swarm intelligence dynamics with transformer architecture. The model treats cognition as a dynamic, adaptive system where multiple internal "agents" collaborate through differentiable routing, trust mechanisms, and shared memory.

V3.2 introduces a revolutionary Self-Assessment Layer, allowing the system to predict its own performance, identify skill gaps, and autonomously design its own learning curriculum.

Architecture Evolution: Swarm-8 V3.2

┌─────────────────────────────────────────────────────────────────────────┐
│                    Swarm-8 V3.2 - SELF-AWARE AGI                        │
├─────────────────────────────────────────────────────────────────────────┤
│                                                                         │
│  ┌────────────────────────────────────────────────────────────────┐   │
│  │                    SELF-ASSESSMENT LAYER                       │   │
│  ├────────────────────────────────────────────────────────────────┤   │
│  │  • Performance Predictor     • Skill Gap Analyzer              │   │
│  │  • Auto-Curriculum Gen       • Real-Time Error Detector        │   │
│  │  • Capability Boundary Detector                                 │   │
│  └────────────────────────────────────────────────────────────────┘   │
│                                                                         │
│  ┌────────────────────────────────────────────────────────────────┐   │
│  │                  AGI CORE (7 Subsystems)                       │   │
│  ├────────────────────────────────────────────────────────────────┤   │
│  │  • Hierarchical Memory       • Causal World Model              │   │
│  │  • Meta-Learner              • Concept Library                 │   │
│  │  • Reflection Engine         • Uncertainty Reasoner            │   │
│  │  • Adversarial Self-Play                                       │   │
│  └────────────────────────────────────────────────────────────────┘   │
│                                                                         │
│  ┌────────────────────────────────────────────────────────────────┐   │
│  │                 SWARM CORE (20 Agents)                         │   │
│  ├────────────────────────────────────────────────────────────────┤   │
│  │  • Vectorized Agents         • Differentiable Routing          │   │
│  │  • Dynamic Resource Mgmt     • Trust-Based Activation          │   │
│  └────────────────────────────────────────────────────────────────┘   │
└─────────────────────────────────────────────────────────────────────────┘

Key V3.2 Enhancements

  • Predictive Self-Awareness: Estimates success probability and identifies risks before attempting a task.
  • Skill Taxonomy: Systematic tracking of 24 core skills across Cognition, Knowledge, Code, Creativity, and Planning.
  • Autonomous Learning: Self-designed, personalized learning paths via the Auto-Curriculum Generator.
  • Real-Time Correction: Proactive error detection during the generation process.
  • Boundary Mapping: Precise identification of capability edges with expansion strategies.

Usage

Installation

pip install torch transformers datasets sagi-swarm

Quick Start

from transformers import AutoModelForCausalLM, AutoTokenizer

# Load model and tokenizer
model = AutoModelForCausalLM.from_pretrained("reaperdoesntknow/SAGI")
tokenizer = AutoTokenizer.from_pretrained("reaperdoesntknow/SAGI")

# Generate text
prompt = "Explain the concept of emergence in swarm intelligence:"
inputs = tokenizer(prompt, return_tensors="pt")

outputs = model.generate(
    **inputs,
    max_new_tokens=150,
    temperature=0.7,
    do_sample=True,
    pad_token_id=tokenizer.eos_token_id,
)

print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Skill Taxonomy (24 Core Skills)

  • Cognition: Pattern recognition, Causal reasoning, Concept formation.
  • Knowledge: Fact retrieval, Knowledge integration, Common sense.
  • Code: Syntax understanding, Algorithm design, Debugging, Optimization.
  • Creativity: Divergent thinking, Novel combination, Generative synthesis.
  • Planning: Goal decomposition, Dependency analysis, Resource allocation.
  • Meta-Cognition: Self-monitoring, Error detection, Strategy selection, Uncertainty quantification.

Decision Flow (V3.2)

  1. Pre-Assessment: Predict success, identify risks, recommend strategy.
  2. Execution: Generate with selected strategy.
  3. Real-Time Monitoring: Catch and correct errors during generation.
  4. Post-Assessment: Update skill proficiencies, check boundaries, refine future predictions.
  5. Learning: Update internal models and curricula.

Safety & Limitations

  • Experimental Research Prototype: Not intended for production use.
  • Code Execution: Model includes tool-use capabilities (Python sandbox). Use with caution.
  • Intrinsic Motivation: Self-improving systems may exhibit unpredictable growth patterns.

License

Apache License 2.0

Citation

@software{sagi2026,
  title={SAGI: Self-Aware General Intelligence System},
  author={Reaperdoesntknow},
  year={2026},
  url={https://huggingface.co/reaperdoesntknow/SAGI},
  version={3.2.0}
}

Convergent Intelligence Portfolio

By Convergent Intelligence LLC: Research Division

Top Models from Our Lab

Total Portfolio: 41 models | 2,781 total downloads

Last updated: 2026-03-28 12:57 UTC


From the Convergent Intelligence Portfolio

DistilQwen Collection — Our only BF16 series. Proof-weighted distillation from Qwen3-30B-A3B → 1.7B and 0.6B on H100. Three teacher variants (Instruct, Thinking, Coder), nine models, 2,788 combined downloads. The rest of the portfolio proves structure beats scale on CPU. This collection shows what happens when you give the methodology real hardware.

Top model: Qwen3-1.7B-Coder-Distilled-SFT — 508 downloads

Full methodology: Structure Over Scale (DOI: 10.57967/hf/8165)

Convergent Intelligence LLC: Research Division

Discrepancy Calculus Foundation

This model is part of the Convergent Intelligence LLC: Research Division portfolio. All models in this portfolio are developed under the Discrepancy Calculus (DISC) framework — a measure-theoretic approach to understanding and controlling the gap between what a model should produce and what it actually produces.

DISC treats training singularities (loss plateaus, mode collapse, catastrophic forgetting) not as failures to be smoothed over, but as structural signals that reveal the geometry of the learning problem. Key concepts:

  • Discrepancy Operator (D): Measures the gap between expected and observed behavior at each training step
  • Jump Sets: Boundaries where model behavior changes discontinuously — these are features, not bugs
  • Ghost Imprinting: Teacher knowledge that transfers to student models through weight-space topology rather than explicit distillation signal

For the full mathematical treatment, see Discrepancy Calculus: Foundations and Core Theory (DOI: 10.57967/hf/8194).

Citation chain: Structure Over Scale (DOI: 10.57967/hf/8165) → Three Teachers to Dual Cognition (DOI: 10.57967/hf/8184) → Discrepancy Calculus (DOI: 10.57967/hf/8194)

Configuration

Architecture
SwarmForCausalLM
Context length (tokens)
1,024
Layers
14
Hidden size
512
Feed-forward size
2,048
Attention heads
16
Vocabulary size
50,290
Model type
swarm_agi

Identity and Version

Repository
reaperdoesntknow/SharperSwarm
Publisher
Convergent Intelligence
Task
Text generation
Modality
Text
Library
transformers
Parameters
103M parameters
Languages
en
Revision
c0ed9a32e7e7424b084578673410d25c5024a1e2
First published
2026-01-21
Last updated
2026-09-18

Files and Weights

12 files, 417.6 MB in total. The weights are 1 file totalling 412.8 MB in safetensors.

Weights1 file · 412.8 MB
Configuration4 files · 6.0 KB
Tokenizer5 files · 4.8 MB
Documentation1 file · 10.9 KB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights412.8 MB ab30c51ea6a1
added_tokens.jsonConfiguration778 B
config.jsonConfiguration1.5 KB
generation_config.jsonConfiguration132 B
special_tokens_map.jsonConfiguration3.5 KB
README.mdDocumentation10.9 KB
.gitattributesRepository1.5 KB
merges.txtTokenizer456.3 KB
swarm_tokenizer.jsonTokenizer653 B
tokenizer.jsonTokenizer3.6 MB
tokenizer_config.jsonTokenizer6.9 KB
vocab.jsonTokenizer798.2 KB

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
412.8 MB
Download from Convergent Intelligence

Released by Convergent Intelligence through its official repository on Hugging Face. Read the license.

Built From

  • Trained on (disclosed) MuskumPillerum/General-Knowledge
  • Trained on (disclosed) agentica-org/DeepCoder-Preview-Dataset
  • Trained on (disclosed) openai/gsm8k
  • Trained on (disclosed) roneneldan/TinyStories
  • Trained on (disclosed) tangyuhang/KnowLogic

Memory Requirements

PrecisionWeights in memory
As published412.8 MB
16-bit0.2 GB
8-bit0.1 GB
4-bit0.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About SharperSwarm

How much GPU memory does SharperSwarm need?

About 0.2 GB at 16-bit and 0.1 GB at 4-bit: the weights (103M parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run SharperSwarm on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

Can I use SharperSwarm commercially?

Yes. SharperSwarm is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

What is SharperSwarm's context length?

1,024 tokens, from the maximum position embeddings in its published configuration.

Similar Models

Model · Text generation

macbert4csc-base-chinese

Ming Xu (徐明)

macbert4csc-base-chinese evaluate SIGHAN2015 test data: 由于训练使用的数据使用了SIGHAN2015的训练集(复现paper),在SIGHAN2015的测试集上达到SOTA水平。 模型结构,魔改于softmaskedbert: 本项目开源在中文文本纠错项目:pycorrector,可支持macbert4csc模型,通过如下命令调用: 当然,你也可使用transformers调用: SIGHAN+Wang271K中文纠错数据集,数据格式: 如果需要训练macbert4csc,请参考https://github.com/shibing624/pycorrector/tree/master/pycorrector/macbert MacBERT is an improved BERT with novel MLM as correction pre-training task, which mitigates the discrepancy of pre-training and fine-tuning. Here is an example of our pre-training task. Except for the new pre-training task, we also incorporate the following techniques. Note that our MacBERT can be directly replaced with the original BERT as there is no…

Open weights apache-2.0 102M parameters 512 tokens transformers

Model · Text generation

pythia-70m-deduped

EleutherAI

The Pythia Scaling Suite is a collection of models developed to facilitate interpretability research (see paper). It contains two sets of eight models of sizes 70M, 160M, 410M, 1B, 1.4B, 2.8B, 6.9B, and 12B. For each size, there are two models: one trained on the Pile, and one trained on the Pile after the dataset has been globally deduplicated. All 8 model sizes are trained on the exact same data, in the exact same order. We also provide 154 intermediate checkpoints per model, hosted on Hugging Face as branches. The Pythia model suite was designed to promote scientific research on large language models, especially interpretability research. Despite not centering downstream performance as a…

Open weights apache-2.0 96M parameters 2,048 tokens transformers

Model · Text generation

distilgpt2

DistilBERT community

DistilGPT2 (short for Distilled-GPT2) is an English-language model pre-trained with the supervision of the smallest version of Generative Pre-trained Transformer 2 (GPT-2). Like GPT-2, DistilGPT2 can be used to generate text. Users of this model card should also consider information about the design, training, and limitations of GPT-2. CONTENT WARNING: Readers should be aware this section contains content that is disturbing, offensive, and can propagate historical and current stereotypes. As the developers of GPT-2 (OpenAI) note in their model card, “language models like GPT-2 reflect the biases inherent to the systems they were trained on.” Significant research has explored bias and…

Open weights apache-2.0 88M parameters transformers

Model · Text generation

ivieai_star_v1.0

George O. Uwaifo

This model is a fine-tuned version of GeorgeUwaifo/iviegpt2new01cresults on an unknown dataset. It achieves the following results on the evaluation set: The following hyperparameters were used during training: - learningrate: 5e-05 - trainbatchsize: 4 - evalbatchsize: 8 - gradientaccumulationsteps: 4 - totaltrainbatchsize: 16 - lrschedulertype: linear - lrschedulerwarmupsteps: 387 - numepochs: 5 - mixedprecisiontraining: Native AMP - Transformers 5.16.1 - Pytorch 2.11.0+cu128 - Datasets 4.8.5 - Tokenizers 0.23.1

Open weights mit 124M parameters transformers