SAVRN
Search Contact SAVRN

Open-weight model · Text generation

Collision-1B

by viraj R collision-10M/Collision-1B

COLLISION-1B is the official primary flagship model of the COLLISION ecosystem. Packing 999,376,128 parameters (~1.00B) into an optimized 24-layer transformer architecture, it delivers rich contextual reasoning, full 1,024-token context capacity, and…

Parameters
Context
Weights2.2 GB
Licensemit
AccessOpen weights
Monthly Downloads540

Model Card

By viraj R, published under mit, revision a711f648e34c.

COLLISION-1B is the official primary flagship model of the COLLISION ecosystem. Packing 999,376,128 parameters (~1.00B) into an optimized 24-layer transformer architecture, it delivers rich contextual reasoning, full 1,024-token context capacity, and state-of-the-art hybrid NLP capabilities with grounded web and local retrieval. Run everything in your browser on free Google Colab in under 10 seconds: Clone this repository and run pure PyTorch inference directly: COLLISION features a complete, zero-latency NLP pipeline: COLLISION includes a full dual-process cognitive architecture featuring non-linear Graph-of-Thoughts (GoT) and Hegelian Dialectics: The flagship features an advanced…

Read viraj R's full model card

COLLISION-1B & Industrial NLP Suite

A High-Efficiency 999.38M Parameter Flagship Transformer with Natural Web Grounding & Complete In-House NLP Toolkit

---## Why COLLISION-1B?

COLLISION-1B is the official primary flagship model of the COLLISION ecosystem. Packing 999,376,128 parameters (~1.00B) into an optimized 24-layer transformer architecture, it delivers rich contextual reasoning, full 1,024-token context capacity, and state-of-the-art hybrid NLP capabilities with grounded web and local retrieval.

┌────────────────────────────────────────────────────────────────────────┐
│                        COLLISION UNIFIED SYSTEM                        │
├────────────────────────────────────────────────────────────────────────┤
│  1. COLLISION Neural Flagship (999.38M Parameters, Causal Transformer) │
│  2. Natural Grounded Synthesis Engine (Grounded Answering & Citations) │
│  3. Multi-Source Live Web & Local Knowledge Retrieval (RAG)            │
│  4. Industrial In-House NLP Suite (`collision.nlp` Subsystem):         │
│     ├── Zero-Latency Conversational Dialogue                           │
│     ├── TextRank Keyphrase & Entity Extraction                         │
│     ├── 10-Domain Topic Classifier & Formality Scorer                  │
│     ├── Grammar, Spelling & Typographical Proofreader                  │
│     ├── Readability Indices (Flesch Ease, Kincaid Grade, Gunning Fog)  │
│     ├── Context Reading Comprehension QA                               │
│     ├── Deterministic Math, Geometry, Statistics & Unit Conversions    │
│     └── Semantic Text Similarity (Cosine, TF-IDF, Jaccard, N-Grams)    │
│  5. Synaptic Cognitive Brain (`collision.brain` Subsystem):            │
│     ├── System 1 / System 2 Dual-Process Controller                    │
│     ├── Graph-of-Thoughts (GoT) Hegelian Dialectics                    │
│     └── Global Workspace Theory (GWT) Conscious Broadcasting           │
└────────────────────────────────────────────────────────────────────────┘

Comparative Performance Benchmarks

Metric / Capability COLLISION-1.0B COLLISION-10M SmolLM-135M TinyLlama-1.1B
Active Parameters 999.38 Million 10.28 Million 135 Million 1.10 Billion
Layers / Heads / Dim 24 / 16 / 2048 6 / 8 / 384 30 / 9 / 576 22 / 32 / 2048
Context Window 1,024 tokens 256 tokens 2,048 tokens 2,048 tokens
Natural Web Grounding? YesBuilt-in (Tri-Modal) YesBuilt-in External only External only
Full Industrial NLP Suite? Yes11 Integrated Tasks Yes11 Integrated Tasks None None
Deterministic Math & Stats? Yes100% Precision Engine Yes100% Precision Engine Hallucination-prone Hallucination-prone
Role & Deployment Target Production Flagship Edge / Micro-device Research SLM Base LLM

Quickstart

Option 1: Python Package (Recommended)

pip install git+https://github.com/viraj3106/Collision-1.46M.git
from collision import CollisionService

service = CollisionService()

# 1. Natural Web Grounded Answering
res = service.ask("What is the latest release version of PyTorch in 2025?", mode="WEB")
print(res["answer"])

# 2. Exact Deterministic Math & Conversions
math_res = service.ask("What is 45 * 12 + 180 / 4?", mode="AUTO")
print(math_res["answer"])

Option 2: 1-Click Interactive Google Colab

Run everything in your browser on free Google Colab in under 10 seconds:


Option 3: Standalone Single-File Raw Inference (Zero Dependencies)

Clone this repository and run pure PyTorch inference directly:

git clone https://huggingface.co/collision-10M/Collision-1B
cd Collision-1B
python release_inference.py --prompt "Artificial intelligence is" --checkpoint model.pt

In-House NLP Toolkit (collision.nlp)

COLLISION features a complete, zero-latency NLP pipeline:

TextRank Keyphrase Extraction

from collision.nlp import CollisionNLPEngine

kp = CollisionNLPEngine.extract_keywords(
    "Quantum computing relies on qubits, superposition, and entanglement to execute algorithms."
)
print("Keyphrases:", kp.keyphrases)
# ['execute quantum algorithms', 'Quantum computing relies', 'quantum algorithms']

Multi-Domain Topic Classification

top = CollisionNLPEngine.classify_topic(
    "The patient underwent cardiac bypass surgery following clinical diagnosis."
)
print(f"Topic: {top.primary_topic} ({top.confidence*100:.0f}% confidence)")
# Topic: Medicine & Health (99% confidence)

Grammar, Spelling & Typo Proofreading

proof = CollisionNLPEngine.proofread("I ate a apple on the the kitchen table .")
print(proof.corrected_text)
# "I ate an apple on the kitchen table."

Readability & Complexity Scoring

read = CollisionNLPEngine.analyze_readability("Empirical research indicates significant statistical correlation.")
print(f"Flesch Ease: {read.flesch_reading_ease} | Level: {read.reading_level}")

Synaptic Cognitive Brain (collision.brain)

COLLISION includes a full dual-process cognitive architecture featuring non-linear Graph-of-Thoughts (GoT) and Hegelian Dialectics:

from collision.brain import get_collision_brain

brain = get_collision_brain()

# Deliberative Hegelian reasoning (Thesis -> Antithesis -> Synthesis)
res = brain.think(
    query="Can artificial neural networks achieve subjective consciousness or only functional simulation?",
    domain="Philosophy & AI",

The flagship features an advanced cognitive architecture designed to emulate dual-process cognitive dynamics:

                  ┌──────────────────────────────┐
                  │    Perceptual Input Buffer   │
                  └──────────────┬───────────────┘
                                 │
                 ┌───────────────┴───────────────┐
                 ▼                               ▼
       ┌──────────────────┐            ┌──────────────────┐
       │     System 1     │            │     System 2     │
       │ (Fast Heuristic) │            │ (Deep Dialectic) │
       └─────────┬────────┘            └─────────┬────────┘
                 │                               │
                 └───────────────┬───────────────┘
                                 ▼
                  ┌──────────────────────────────┐
                  │   Global Workspace (GWT)     │
                  │   - Epistemic Verification   │
                  │   - Synaptic Memory (LTP)    │
                  └──────────────┬───────────────┘
                                 ▼
                         Grounded Output

Technical Architecture Specifications

  • Parameter Count: 999,376,128 (~1.00B)
  • Architecture: Causal Decoder-Only Transformer (Weight-Tied Embeddings)
  • Layers (n_layer): 24
  • Hidden Size (d_model): 2048
  • Attention Heads (n_head): 16
  • Feedforward Dimension (d_ff): 5376
  • Context Length: 1,024 tokens
  • Vocabulary: Custom Byte-Pair Encoding (BPE, 32,000 vocab)
  • Checkpoint SHA-256: bdd986e2a4964a6a204224dbd973625abe192cd4f6e23dceb79e273a29b19c88
  • Edge Flagship Variant (10M): d256d46d962d6416fe22d2cfe80b13df0574279fb980d7d8576c2bdcf3775b97 (10,282,304 parameters)

Community & Ecosystem

@misc{collision2026,
  author = {Viraj et al.},
  title = {Collision-1B: High-Efficiency Scaled Transformer & Grounded NLP Intelligence System},
  year = {2026},
  publisher = {Hugging Face},
  howpublished = {\url{https://huggingface.co/collision-10M/Collision-1B}}
}

Configuration

Vocabulary size
32,000

Identity and Version

Repository
collision-10M/Collision-1B
Publisher
viraj R
Task
Text generation
Modality
Text
Library
transformers
Parameters
Not stated by the source
Languages
en
Revision
a711f648e34cb61b0bb270b5c978b91b917236a9
First published
2026-09-04
Last updated
2026-09-18

Files and Weights

124 files, 2.2 GB in total. The weights are 1 file totalling 2.2 GB in pt.

Weights1 file · 2.2 GB
Configuration91 files · 599.7 KB
Tokenizer4 files · 21.8 KB
Documentation5 files · 14.1 KB
Other22 files · 13.1 MB
Repository1 file · 1.5 KB
Every file
FileTypeSizeSHA-256
model.ptWeights2.2 GB bdd986e2a496
collision/__init__.pyConfiguration277 B
collision/__main__.pyConfiguration105 B
collision/answering/__init__.pyConfiguration265 B
collision/answering/engine.pyConfiguration14.4 KB
collision/answering/schemas.pyConfiguration1.1 KB
collision/chat.pyConfiguration5.1 KB
collision/cli.pyConfiguration5.3 KB
collision/config.pyConfiguration3.4 KB
collision/grounding/__init__.pyConfiguration721 B
collision/grounding/engine.pyConfiguration13.7 KB
collision/grounding/extractor.pyConfiguration4.5 KB
collision/grounding/fallback.pyConfiguration3.6 KB
collision/grounding/policy.pyConfiguration1.5 KB
collision/grounding/schemas.pyConfiguration3.7 KB
collision/grounding/synthesizer.pyConfiguration5.4 KB
collision/inference/__init__.pyConfiguration180 B
collision/inference/config.pyConfiguration1.1 KB
collision/inference/engine.pyConfiguration5.9 KB
collision/inference/generation.pyConfiguration887 B
collision/info.pyConfiguration2.2 KB
collision/nlp/__init__.pyConfiguration1.5 KB
collision/nlp/analytics.pyConfiguration20.7 KB
collision/nlp/comprehension.pyConfiguration7.5 KB
collision/nlp/engine.pyConfiguration39.8 KB
collision/nlp/processor.pyConfiguration23.3 KB
collision/rag/__init__.pyConfiguration550 B
collision/rag/chunker.pyConfiguration3.9 KB
collision/rag/embeddings.pyConfiguration4.8 KB
collision/rag/engine.pyConfiguration5.9 KB
collision/rag/index.pyConfiguration4.0 KB
collision/rag/retriever.pyConfiguration2.3 KB
collision/rag/schemas.pyConfiguration2.2 KB
collision/readiness_check.pyConfiguration9.7 KB
collision/routing/__init__.pyConfiguration825 B
collision/routing/classifier.pyConfiguration6.1 KB
collision/routing/confidence.pyConfiguration2.0 KB
collision/routing/engine.pyConfiguration11.5 KB
collision/routing/fusion.pyConfiguration2.5 KB
collision/routing/router.pyConfiguration5.1 KB
collision/routing/schemas.pyConfiguration4.8 KB
collision/routing/verifier.pyConfiguration8.1 KB
collision/service.pyConfiguration24.4 KB
collision/setup.pyConfiguration1.2 KB
collision/web/__init__.pyConfiguration901 B
collision/web/engine.pyConfiguration12.0 KB
collision/web/extractor.pyConfiguration3.3 KB
collision/web/fetch.pyConfiguration3.1 KB
collision/web/ranker.pyConfiguration3.0 KB
collision/web/schemas.pyConfiguration3.2 KB
collision/web/search.pyConfiguration6.1 KB
config.jsonConfiguration238 B
data/aggregate_telemetry.pyConfiguration4.0 KB
data/audit_dataset.pyConfiguration8.5 KB
data/audit_generation_quality.pyConfiguration15.0 KB
data/build.pyConfiguration8.7 KB
data/build_augmented_v1.pyConfiguration4.5 KB
data/build_instruct.pyConfiguration30.6 KB
data/build_real_world_v2.pyConfiguration4.3 KB
data/build_v5.pyConfiguration22.8 KB
data/build_v5_expanded.pyConfiguration23.4 KB
data/build_v9_redesigned.pyConfiguration20.3 KB
data/clean_real_world.pyConfiguration9.4 KB
data/data_collection_status.pyConfiguration14.0 KB
data/generate_corpus.pyConfiguration11.3 KB
data/generate_synthetic_augmented.pyConfiguration8.3 KB
data/instructions/collision_sft_v1/deduplication_report.jsonConfiguration210 B
data/instructions/collision_sft_v1/quality_audit.jsonConfiguration226 B
data/make_3m_results_pdf.pyConfiguration5.6 KB
data/monitor_real_world.pyConfiguration2.5 KB
data/preferences/build_preference_v3.pyConfiguration27.1 KB
data/prepare.pyConfiguration6.2 KB
data/prepare_v4.pyConfiguration5.4 KB
data/real_world/reports/data_cleaning_report.jsonConfiguration483 B
data/report.pyConfiguration4.3 KB
data/run_generalization_test.pyConfiguration4.0 KB
data/scaling_dry_run.pyConfiguration4.4 KB
data/stats.pyConfiguration2.4 KB
data/tokenize.pyConfiguration10.8 KB
generate.pyConfiguration11.3 KB
generation_config.jsonConfiguration81 B
inference/generate.pyConfiguration6.9 KB
model/__init__.pyConfiguration30 B
model/attention.pyConfiguration2.2 KB
model/blocks.pyConfiguration1.1 KB
model/config.pyConfiguration3.5 KB
model/embeddings.pyConfiguration769 B
model/transformer.pyConfiguration3.1 KB
model_metadata.jsonConfiguration1.3 KB
tokenizer/config.jsonConfiguration179 B
tokenizer/merges.jsonConfiguration11.9 KB
tokenizer/stats.jsonConfiguration862 B
DESCRIPTION.mdDocumentation1.7 KB
README.mdDocumentation10.9 KB
data/instructions/collision_sft_v1/dataset_card.mdDocumentation739 B
data/instructions/collision_sft_v2/dataset_card.mdDocumentation377 B
data/instructions/collision_sft_v3/dataset_card.mdDocumentation348 B
checksums.sha256Other652 B
collision_quickstart.ipynbOther7.6 KB
data/collision_augmented_v2.jsonlOther198.3 KB
data/collision_synthetic_v2.jsonlOther196.5 KB
data/instructions/collision_conversation_v1_gold/gold_set.jsonlOther161.0 KB
data/instructions/collision_conversation_v1_rejected/train.jsonlOther521.7 KB
data/instructions/collision_conversation_v1_rejected/validation.jsonlOther86.2 KB
data/instructions/collision_conversation_v2_seed/v2_seed.jsonlOther62.4 KB
data/instructions/collision_sft_v1/train.jsonlOther1.8 MB
data/instructions/collision_sft_v1/validation.jsonlOther197.9 KB
data/instructions/collision_sft_v2/train.jsonlOther1.7 MB
data/instructions/collision_sft_v2/validation.jsonlOther191.3 KB
data/instructions/collision_sft_v3/train.jsonlOther1.1 MB
data/instructions/collision_sft_v3/validation.jsonlOther126.1 KB
data/preferences/preference_dataset_v3.jsonlOther3.3 MB
data/preferences/preference_dataset_v3_train.jsonlOther3.0 MB
data/preferences/preference_dataset_v3_val.jsonlOther334.2 KB
data/real_world/cleaned/collision_real_world_v1.jsonlOther2.1 KB
data/real_world/cleaned/collision_real_world_v2.jsonlOther1.7 KB
data/real_world/cleaned/real_world_cleaned.jsonlOther2.7 KB
data/real_world/raw/feedback_batch.jsonlOther3.2 KB
data/real_world/rejected/real_world_rejected.jsonlOther1.5 KB
.gitattributesRepository1.5 KB
collision/inference/tokenizer.pyTokenizer836 B
data/tokenizer_investigation.pyTokenizer3.2 KB
tokenizer.jsonTokenizer78 B
tokenizer/vocab.jsonTokenizer17.7 KB

License and Download

License
mit
Access
Open weights, no gate
Download size
2.2 GB
Download from viraj R

Released by viraj R through its official repository on Hugging Face. Read the license.

Built From

  • Trained on (disclosed) collision_dataset_v5_expanded

Memory Requirements

PrecisionWeights in memory
As published2.2 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About Collision-1B

Can I use Collision-1B commercially?

Yes. Collision-1B is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.

Similar Models

Fine-tune Qwen3 (14B) for free using our Google Colab notebook! - Read our Blog about Qwen3 support: unsloth.ai/blog/qwen3 - View the rest of our notebooks in our docs here. Qwen3-Coder is available in multiple sizes. Today, we're excited to introduce Qwen3-Coder-30B-A3B-Instruct. This streamlined model maintains impressive performance and efficiency, featuring the following key enhancements: - Significant Performance among open models on Agentic Coding, Agentic Browser-Use, and other foundational coding tasks. - Long-context Capabilities with native support for 256K tokens, extendable up to 1M tokens using Yarn, optimized for repository-scale understanding. - Agentic Coding supporting for…

Open weights apache-2.0 transformers

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp