Parameters—
Context262,144
Weights43.2 GB
License—
AccessOpen weights
Monthly Downloads—
Model Card
The publisher has not written a card for this model.
Configuration
- Architecture
- Xing4_0ForCausalLM
- Context length (tokens)
- 262,144
- Layers
- 40
- Hidden size
- 3,584
- Feed-forward size
- 9,216
- Attention heads
- 32
- Key/value heads
- 32
- Vocabulary size
- 131,072
- Routed experts
- 64
- Experts active per token
- 4
- RoPE base
- 10,000
- Model type
- xing4_0
Identity and Version
- Repository
- 21g/Xing4.0-29B-A4B
- Publisher
- 21g
- Task
- Not stated by the source
- Modality
- Other
- Library
- Not stated by the source
- Parameters
- Not stated by the source
- Languages
- Not stated by the source
- Revision
- 4f19646d0dec7a07f212263957e70e916c38ee5b
- First published
- 2026-09-18
- Last updated
- 2026-09-18
Files and Weights
36 files, 43.2 GB in total. The weights are 30 files totalling 43.2 GB in safetensors.
Weights30 files · 43.2 GB
Configuration4 files · 7.3 KB
Other1 file · 4.1 KB
Repository1 file · 1.5 KB
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| model-00001-of-00041.safetensors | Weights | 1.2 GB | 6c19fc3fbfff |
| model-00002-of-00041.safetensors | Weights | 256.4 MB | ab1cd49d6e7e |
| model-00003-of-00041.safetensors | Weights | 1.5 GB | b08405c0922f |
| model-00004-of-00041.safetensors | Weights | 1.5 GB | 05a3fabd4638 |
| model-00005-of-00041.safetensors | Weights | 1.5 GB | bf3a4bde4e14 |
| model-00006-of-00041.safetensors | Weights | 1.5 GB | f928e208bcbc |
| model-00007-of-00041.safetensors | Weights | 1.5 GB | c94d17f945f0 |
| model-00008-of-00041.safetensors | Weights | 1.5 GB | 61cff93ca27b |
| model-00009-of-00041.safetensors | Weights | 1.5 GB | 879f05d8cc89 |
| model-00010-of-00041.safetensors | Weights | 1.5 GB | 1d9ba1b0cc59 |
| model-00011-of-00041.safetensors | Weights | 1.5 GB | 1268ad3016df |
| model-00012-of-00041.safetensors | Weights | 1.5 GB | 8fe4f1109225 |
| model-00013-of-00041.safetensors | Weights | 1.5 GB | a32993fd0a40 |
| model-00014-of-00041.safetensors | Weights | 1.5 GB | b7189b732cb3 |
| model-00015-of-00041.safetensors | Weights | 1.5 GB | 78f8341503a5 |
| model-00016-of-00041.safetensors | Weights | 1.5 GB | 5dc590c58248 |
| model-00017-of-00041.safetensors | Weights | 1.5 GB | 8a4fbb77e847 |
| model-00018-of-00041.safetensors | Weights | 1.5 GB | fe75c267e5b1 |
| model-00019-of-00041.safetensors | Weights | 1.5 GB | b91ca7256f1c |
| model-00020-of-00041.safetensors | Weights | 1.5 GB | 120f74ff6e90 |
| model-00021-of-00041.safetensors | Weights | 1.5 GB | 69cf7ea2a008 |
| model-00022-of-00041.safetensors | Weights | 1.5 GB | 2cb65fd5d22b |
| model-00023-of-00041.safetensors | Weights | 1.5 GB | 755c571e9d71 |
| model-00024-of-00041.safetensors | Weights | 1.5 GB | 7d7317f38bb7 |
| model-00025-of-00041.safetensors | Weights | 1.5 GB | cbacd8cdb560 |
| model-00026-of-00041.safetensors | Weights | 1.5 GB | 0c7e7bce0064 |
| model-00027-of-00041.safetensors | Weights | 1.5 GB | 28367baf4ed3 |
| model-00028-of-00041.safetensors | Weights | 1.5 GB | b78b2e0b85fb |
| model-00029-of-00041.safetensors | Weights | 1.5 GB | 79ab6d43e6dc |
| model-00030-of-00041.safetensors | Weights | 1.5 GB | 6834833290a3 |
| config.json | Configuration | 1.6 KB | — |
| configuration.json | Configuration | 48 B | — |
| configuration_xing4_0.py | Configuration | 5.4 KB | — |
| generation_config.json | Configuration | 211 B | — |
| chat_template.jinja | Other | 4.1 KB | — |
| .gitattributes | Repository | 1.5 KB | — |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
- Download size
- 43.2 GB
Download from 21g
Released by 21g through its official repository on Hugging Face.
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 43.2 GB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About Xing4.0-29B-A4B
What is Xing4.0-29B-A4B's context length?
262,144 tokens, from the maximum position embeddings in its published configuration.