L-CED-15B is an open-weight model from Gugu8. It has 1,048,576-token context. Its published files total 3.3 TB. It draws 12.5k downloads a month.
DeepSeek V4.1-Flash CED + CSA2 + Engram + Single-Pass mHC + DSpark - Looped decoder (recurrent depth) + Mixture-of-Recursions routing - 15B total, ~2-3.5B active, 1M context staged See ARCHITECTURE.md for full spec.
Parameters—
Context1,048,576
Weights2.2 TB
License—
AccessOpen weights
Monthly Downloads12.5k
Model Card
DeepSeek V4.1-Flash CED + CSA2 + Engram + Single-Pass mHC + DSpark - Looped decoder (recurrent depth) + Mixture-of-Recursions routing - 15B total, ~2-3.5B active, 1M context staged See ARCHITECTURE.md for full spec. Target: frontier reasoning per active param on SWE-bench / Terminal-Bench / DeepSWE.
Excerpt from the card by Gugu8.
Configuration
- Context length (tokens)
- 1,048,576
- Hidden size
- 3,072
- Attention heads
- 24
- Key/value heads
- 8
- Head dimension
- 128
- Vocabulary size
- 129,280
- Routed experts
- 96
- Experts active per token
- 6
- Sliding window (tokens)
- 128
- RoPE base
- 10,000
- Model type
- l_ced_moe
Identity and Version
- Repository
- Gugu8/L-CED-15B
- Publisher
- Gugu8
- Task
- Not stated by the source
- Modality
- Other
- Library
- Not stated by the source
- Parameters
- Not stated by the source
- Languages
- Not stated by the source
- Revision
- 6a760b697f23beb085cdb2524cb1d67c5005eaad
- First published
- 2026-09-22
- Last updated
- 2026-10-11
Files and Weights
365 files, 3.3 TB in total. The weights are 124 files totalling 2.2 TB in pt.
Weights124 files · 2.2 TB
Configuration7 files · 14.1 KB
Documentation2 files · 2.4 KB
Other125 files · 1.1 TB
Repository107 files · 33.8 MB
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| 15b-train/ep_100000_r0.pt | Weights | 21.5 GB | d84eb22403a5 |
| 15b-train/ep_10000_r0.pt | Weights | 10.2 GB | b21289480427 |
| 15b-train/ep_10000_r1.pt | Weights | 10.2 GB | 52ac067ead95 |
| 15b-train/ep_1000_r0.pt | Weights | 10.2 GB | 70bb9a9e827a |
| 15b-train/ep_1000_r1.pt | Weights | 10.2 GB | dcad7378b349 |
| 15b-train/ep_101000_r0.pt | Weights | 21.5 GB | a73095b81d1f |
| 15b-train/ep_102000_r0.pt | Weights | 21.5 GB | 1a1f62638fbc |
| 15b-train/ep_103000_r0.pt | Weights | 21.5 GB | 23f438555085 |
| 15b-train/ep_104000_r0.pt | Weights | 21.5 GB | 160eeb630004 |
| 15b-train/ep_105000_r0.pt | Weights | 21.5 GB | bbf393f081c0 |
| 15b-train/ep_106000_r0.pt | Weights | 21.5 GB | 0207d33080ed |
| 15b-train/ep_11000_r0.pt | Weights | 10.2 GB | 9a35d08f6eb1 |
| 15b-train/ep_11000_r1.pt | Weights | 10.2 GB | 167eac48f2db |
| 15b-train/ep_12000_r0.pt | Weights | 10.2 GB | 381c573633fb |
| 15b-train/ep_12000_r1.pt | Weights | 10.2 GB | df9372e64084 |
| 15b-train/ep_13000_r0.pt | Weights | 20.4 GB | dd5f395bb2be |
| 15b-train/ep_14000_r0.pt | Weights | 21.5 GB | 83f006f6c9be |
| 15b-train/ep_15000_r0.pt | Weights | 21.5 GB | f11daa5abc00 |
| 15b-train/ep_16000_r0.pt | Weights | 21.5 GB | 26093d6185fe |
| 15b-train/ep_17000_r0.pt | Weights | 21.5 GB | 6a9a215e06df |
| 15b-train/ep_18000_r0.pt | Weights | 21.5 GB | ab021764e0b5 |
| 15b-train/ep_19000_r0.pt | Weights | 21.5 GB | e6f57a4a8675 |
| 15b-train/ep_20000_r0.pt | Weights | 21.5 GB | ef86b708e18b |
| 15b-train/ep_2000_r0.pt | Weights | 10.2 GB | 2af82ac0b6f9 |
| 15b-train/ep_2000_r1.pt | Weights | 10.2 GB | 60b65e1536d2 |
| 15b-train/ep_21000_r0.pt | Weights | 21.5 GB | 6709e9847f02 |
| 15b-train/ep_22000_r0.pt | Weights | 21.5 GB | 90587b75b482 |
| 15b-train/ep_23000_r0.pt | Weights | 21.5 GB | 19730f7664b2 |
| 15b-train/ep_24000_r0.pt | Weights | 21.5 GB | e51df3340215 |
| 15b-train/ep_25000_r0.pt | Weights | 21.5 GB | e4f68392dcb2 |
| 15b-train/ep_26000_r0.pt | Weights | 21.5 GB | 8e15dbf5452b |
| 15b-train/ep_27000_r0.pt | Weights | 21.5 GB | dc95e7d00057 |
| 15b-train/ep_28000_r0.pt | Weights | 21.5 GB | 0ded2d0965e2 |
| 15b-train/ep_29000_r0.pt | Weights | 21.5 GB | 5408382d1b10 |
| 15b-train/ep_30000_r0.pt | Weights | 21.5 GB | 14356ce9815f |
| 15b-train/ep_3000_r0.pt | Weights | 10.2 GB | 5eb0e7540787 |
| 15b-train/ep_3000_r1.pt | Weights | 10.2 GB | 53fd2119f9cd |
| 15b-train/ep_31000_r0.pt | Weights | 21.5 GB | c09c523aa6bb |
| 15b-train/ep_32000_r0.pt | Weights | 21.5 GB | 890805dbd11a |
| 15b-train/ep_33000_r0.pt | Weights | 21.5 GB | 2a53f51c8eb9 |
| 15b-train/ep_34000_r0.pt | Weights | 21.5 GB | 2c4f95d452a2 |
| 15b-train/ep_35000_r0.pt | Weights | 21.5 GB | 2e5e2f1fc4fe |
| 15b-train/ep_36000_r0.pt | Weights | 21.5 GB | ca93a04aea49 |
| 15b-train/ep_37000_r0.pt | Weights | 21.5 GB | 99a309d5fad2 |
| 15b-train/ep_38000_r0.pt | Weights | 21.5 GB | 02863e2da846 |
| 15b-train/ep_39000_r0.pt | Weights | 21.5 GB | df3b1fd60799 |
| 15b-train/ep_40000_r0.pt | Weights | 21.5 GB | 01bf91c9bab6 |
| 15b-train/ep_4000_r0.pt | Weights | 10.2 GB | 0455c66be50c |
| 15b-train/ep_4000_r1.pt | Weights | 10.2 GB | 506dddf6471d |
| 15b-train/ep_41000_r0.pt | Weights | 21.5 GB | 7a41ac8c7816 |
| 15b-train/ep_42000_r0.pt | Weights | 21.5 GB | f63668ac3872 |
| 15b-train/ep_43000_r0.pt | Weights | 21.5 GB | 193777fb7736 |
| 15b-train/ep_44000_r0.pt | Weights | 21.5 GB | e2d1688a46e8 |
| 15b-train/ep_45000_r0.pt | Weights | 21.5 GB | 9e4229a5c557 |
| 15b-train/ep_46000_r0.pt | Weights | 21.5 GB | 293448282449 |
| 15b-train/ep_47000_r0.pt | Weights | 21.5 GB | 8934d8fb715a |
| 15b-train/ep_48000_r0.pt | Weights | 21.5 GB | a25e635f66af |
| 15b-train/ep_49000_r0.pt | Weights | 21.5 GB | f2d1111e45d2 |
| 15b-train/ep_50000_r0.pt | Weights | 21.5 GB | a68f1fe76307 |
| 15b-train/ep_5000_r0.pt | Weights | 10.2 GB | cad43dd3ba7b |
| 15b-train/ep_5000_r1.pt | Weights | 10.2 GB | a42edf8442f4 |
| 15b-train/ep_51000_r0.pt | Weights | 21.5 GB | 088ab2b1f67c |
| 15b-train/ep_52000_r0.pt | Weights | 21.5 GB | 6b70eded4fb3 |
| 15b-train/ep_53000_r0.pt | Weights | 21.5 GB | ba6e8054847e |
| 15b-train/ep_54000_r0.pt | Weights | 21.5 GB | 4654f52c99db |
| 15b-train/ep_55000_r0.pt | Weights | 21.5 GB | 52caee8148d8 |
| 15b-train/ep_56000_r0.pt | Weights | 21.5 GB | 844ab5b35d01 |
| 15b-train/ep_57000_r0.pt | Weights | 21.5 GB | b2e2229147fd |
| 15b-train/ep_58000_r0.pt | Weights | 21.5 GB | 0f6cdf0e22bc |
| 15b-train/ep_59000_r0.pt | Weights | 21.5 GB | 62ff51152db4 |
| 15b-train/ep_60000_r0.pt | Weights | 21.5 GB | d990eea62b2f |
| 15b-train/ep_6000_r0.pt | Weights | 10.2 GB | 4e200a143f0a |
| 15b-train/ep_6000_r1.pt | Weights | 10.2 GB | 328e7d94b4cd |
| 15b-train/ep_61000_r0.pt | Weights | 21.5 GB | f8b7c8f50fae |
| 15b-train/ep_62000_r0.pt | Weights | 21.5 GB | 019b5492cea4 |
| 15b-train/ep_63000_r0.pt | Weights | 21.5 GB | 3c8b216649b4 |
| 15b-train/ep_64000_r0.pt | Weights | 21.5 GB | 987e2b3e2393 |
| 15b-train/ep_65000_r0.pt | Weights | 21.5 GB | 9ed48615eb48 |
| 15b-train/ep_66000_r0.pt | Weights | 21.5 GB | fbd357db68ee |
| 15b-train/ep_67000_r0.pt | Weights | 21.5 GB | 5ee11d592645 |
| 15b-train/ep_68000_r0.pt | Weights | 21.5 GB | 3c7e78a76d0a |
| 15b-train/ep_69000_r0.pt | Weights | 21.5 GB | 45ce49357763 |
| 15b-train/ep_70000_r0.pt | Weights | 21.5 GB | 8a7b4d6bdcd2 |
| 15b-train/ep_7000_r0.pt | Weights | 10.2 GB | f4b022f2b012 |
| 15b-train/ep_7000_r1.pt | Weights | 10.2 GB | 0ca5aec05ce3 |
| 15b-train/ep_71000_r0.pt | Weights | 21.5 GB | c73621249591 |
| 15b-train/ep_72000_r0.pt | Weights | 21.5 GB | 803d0d80112c |
| 15b-train/ep_73000_r0.pt | Weights | 21.5 GB | 62dab693ebd8 |
| 15b-train/ep_74000_r0.pt | Weights | 21.5 GB | 0a0d572a776d |
| 15b-train/ep_75000_r0.pt | Weights | 21.5 GB | c99f8bb17577 |
| 15b-train/ep_76000_r0.pt | Weights | 21.5 GB | f0a7e0e8b93c |
| 15b-train/ep_77000_r0.pt | Weights | 21.5 GB | ae7be6a109ea |
| 15b-train/ep_78000_r0.pt | Weights | 21.5 GB | d4968d8804f7 |
| 15b-train/ep_79000_r0.pt | Weights | 21.5 GB | 6bcb4ee260b9 |
| 15b-train/ep_80000_r0.pt | Weights | 21.5 GB | 9cebffaa6c37 |
| 15b-train/ep_81000_r0.pt | Weights | 21.5 GB | b3da37eeb2f5 |
| 15b-train/ep_82000_r0.pt | Weights | 21.5 GB | 8634c7da2f5f |
| 15b-train/ep_83000_r0.pt | Weights | 21.5 GB | 41bbbf1402f0 |
| 15b-train/ep_84000_r0.pt | Weights | 21.5 GB | b2049a427c46 |
| 15b-train/ep_85000_r0.pt | Weights | 21.5 GB | 96df0fa36c50 |
| 15b-train/ep_86000_r0.pt | Weights | 21.5 GB | d5c14031a407 |
| 15b-train/ep_87000_r0.pt | Weights | 21.5 GB | b983bf35463a |
| 15b-train/ep_88000_r0.pt | Weights | 21.5 GB | 90b10d74ad5c |
| 15b-train/ep_89000_r0.pt | Weights | 21.5 GB | 057e2c28595b |
| 15b-train/ep_90000_r0.pt | Weights | 21.5 GB | 2c9688bdb74b |
| 15b-train/ep_9000_r0.pt | Weights | 10.2 GB | a8b0e383f866 |
| 15b-train/ep_9000_r1.pt | Weights | 10.2 GB | 5050c27b3eb3 |
| 15b-train/ep_91000_r0.pt | Weights | 21.5 GB | b1d5c4cc0dbe |
| 15b-train/ep_92000_r0.pt | Weights | 21.5 GB | 94413dcdf8d0 |
| 15b-train/ep_93000_r0.pt | Weights | 21.5 GB | 63da1c277744 |
| 15b-train/ep_94000_r0.pt | Weights | 21.5 GB | bce220f4e83c |
| 15b-train/ep_95000_r0.pt | Weights | 21.5 GB | 1ea53ca71730 |
| 15b-train/ep_96000_r0.pt | Weights | 21.5 GB | 3feacbaafc20 |
| 15b-train/ep_97000_r0.pt | Weights | 21.5 GB | f7cdc9640a5d |
| 15b-train/ep_98000_r0.pt | Weights | 21.5 GB | 8f6b963b8179 |
| 15b-train/ep_99000_r0.pt | Weights | 21.5 GB | dc4cd0a53d68 |
| experiments/arith/looped.pt | Weights | 3.2 MB | d39549732628 |
| experiments/arith/vanilla.pt | Weights | 4.8 MB | b3a7b385c014 |
| proxy-ddp/ckpt_1000.pt | Weights | 1.0 GB | c9bec7cd325b |
| proxy-ddp/ckpt_1500.pt | Weights | 1.0 GB | 97e1b39ef41e |
| proxy-ddp/ckpt_500.pt | Weights | 1.0 GB | 69eb7b2dfe48 |
| proxy/ckpt_1000.pt | Weights | 1.0 GB | 757334958627 |
| proxy/ckpt_1500.pt | Weights | 1.0 GB | 9a4c11471ae0 |
| proxy/ckpt_500.pt | Weights | 1.0 GB | ddd008f94536 |
| 15b-train/status.json | Configuration | 74 B | — |
| 15b/config.json | Configuration | 368 B | — |
| 15b/modeling_l_ced.py | Configuration | 10.5 KB | — |
| config.json | Configuration | 961 B | — |
| data-mix-1.5T.yaml | Configuration | 940 B | — |
| experiments/arith/results.json | Configuration | 298 B | — |
| post-train-curriculum.yaml | Configuration | 929 B | — |
| ARCHITECTURE.md | Documentation | 1.8 KB | — |
| README.md | Documentation | 514 B | — |
| 15b-train/ckpt_1000/__0_0.distcp | Other | 7.9 GB | 32108e5d4021 |
| 15b-train/ckpt_1000/__1_0.distcp | Other | 18.1 GB | 3190083f491b |
| 15b-train/ckpt_10000/__0_0.distcp | Other | 7.9 GB | 82a11dbc4f04 |
| 15b-train/ckpt_10000/__1_0.distcp | Other | 18.1 GB | 546f85f181a9 |
| 15b-train/ckpt_100000/__0_0.distcp | Other | 8.0 GB | ad3c7ec08eaa |
| 15b-train/ckpt_101000/__0_0.distcp | Other | 8.0 GB | 6386fdcff685 |
| 15b-train/ckpt_102000/__0_0.distcp | Other | 8.0 GB | 723179f6ec96 |
| 15b-train/ckpt_103000/__0_0.distcp | Other | 8.0 GB | 9ac7e95c46dc |
| 15b-train/ckpt_104000/__0_0.distcp | Other | 8.0 GB | 856c296b979c |
| 15b-train/ckpt_105000/__0_0.distcp | Other | 8.0 GB | 4ed8feb12573 |
| 15b-train/ckpt_106000/__0_0.distcp | Other | 8.0 GB | e0994bd2e530 |
| 15b-train/ckpt_11000/__0_0.distcp | Other | 7.9 GB | 394e77a9289e |
| 15b-train/ckpt_11000/__1_0.distcp | Other | 18.1 GB | 3e638c1177d7 |
| 15b-train/ckpt_114000/__0_0.distcp | Other | 8.0 GB | 1c95927dd1d3 |
| 15b-train/ckpt_12000/__0_0.distcp | Other | 7.9 GB | 2ca77b134184 |
| 15b-train/ckpt_12000/__1_0.distcp | Other | 18.1 GB | 1622fae98f07 |
| 15b-train/ckpt_13000/__0_0.distcp | Other | 8.0 GB | ab5ff673c44a |
| 15b-train/ckpt_14000/__0_0.distcp | Other | 8.0 GB | 97c978771c4c |
| 15b-train/ckpt_15000/__0_0.distcp | Other | 8.0 GB | 4b6ee5186d2b |
| 15b-train/ckpt_16000/__0_0.distcp | Other | 8.0 GB | 905a5bfca674 |
| 15b-train/ckpt_17000/__0_0.distcp | Other | 8.0 GB | a2a96b37993f |
| 15b-train/ckpt_18000/__0_0.distcp | Other | 8.0 GB | a4fcee7e3976 |
| 15b-train/ckpt_19000/__0_0.distcp | Other | 8.0 GB | fd2dd09f85a8 |
| 15b-train/ckpt_2000/__0_0.distcp | Other | 7.9 GB | be69e49dbb21 |
| 15b-train/ckpt_2000/__1_0.distcp | Other | 18.1 GB | b246938becd6 |
| 15b-train/ckpt_20000/__0_0.distcp | Other | 8.0 GB | b0dac8ed2f97 |
| 15b-train/ckpt_21000/__0_0.distcp | Other | 8.0 GB | 366d975fb495 |
| 15b-train/ckpt_22000/__0_0.distcp | Other | 8.0 GB | 432f5e90ef49 |
| 15b-train/ckpt_23000/__0_0.distcp | Other | 8.0 GB | 3d2ccdd0ca4e |
| 15b-train/ckpt_24000/__0_0.distcp | Other | 8.0 GB | 5030d0ac15c7 |
| 15b-train/ckpt_25000/__0_0.distcp | Other | 8.0 GB | 40c8d2d1d8ad |
| 15b-train/ckpt_26000/__0_0.distcp | Other | 8.0 GB | 1e083d21ca56 |
| 15b-train/ckpt_27000/__0_0.distcp | Other | 8.0 GB | 1e21db7631d4 |
| 15b-train/ckpt_28000/__0_0.distcp | Other | 8.0 GB | b2adee52caf1 |
| 15b-train/ckpt_29000/__0_0.distcp | Other | 8.0 GB | 195e2914fcde |
| 15b-train/ckpt_3000/__0_0.distcp | Other | 7.9 GB | 3599e337c73e |
| 15b-train/ckpt_3000/__1_0.distcp | Other | 18.1 GB | d91d81a0f3d4 |
| 15b-train/ckpt_30000/__0_0.distcp | Other | 8.0 GB | e0aeb805ad11 |
| 15b-train/ckpt_31000/__0_0.distcp | Other | 8.0 GB | 0d155817cfc3 |
| 15b-train/ckpt_32000/__0_0.distcp | Other | 8.0 GB | 4f6565206a7b |
| 15b-train/ckpt_33000/__0_0.distcp | Other | 8.0 GB | b751c36ae01c |
| 15b-train/ckpt_34000/__0_0.distcp | Other | 8.0 GB | 06830961095b |
| 15b-train/ckpt_35000/__0_0.distcp | Other | 8.0 GB | 1418d800ef6e |
| 15b-train/ckpt_36000/__0_0.distcp | Other | 8.0 GB | ea206686c809 |
| 15b-train/ckpt_37000/__0_0.distcp | Other | 8.0 GB | 03d2e47240ea |
| 15b-train/ckpt_38000/__0_0.distcp | Other | 8.0 GB | 1ffb40a5d156 |
| 15b-train/ckpt_39000/__0_0.distcp | Other | 8.0 GB | b37bbbf5c3a8 |
| 15b-train/ckpt_4000/__0_0.distcp | Other | 7.9 GB | 94c2bf8176bd |
| 15b-train/ckpt_4000/__1_0.distcp | Other | 18.1 GB | 315c79a70159 |
| 15b-train/ckpt_40000/__0_0.distcp | Other | 8.0 GB | 5f33b6a6968d |
| 15b-train/ckpt_41000/__0_0.distcp | Other | 8.0 GB | 079ec618522f |
| 15b-train/ckpt_42000/__0_0.distcp | Other | 8.0 GB | ef74227cbcb7 |
| 15b-train/ckpt_43000/__0_0.distcp | Other | 8.0 GB | 01308ae2d5c3 |
| 15b-train/ckpt_44000/__0_0.distcp | Other | 8.0 GB | 52197b06c155 |
| 15b-train/ckpt_45000/__0_0.distcp | Other | 8.0 GB | fafa2849fd85 |
| 15b-train/ckpt_46000/__0_0.distcp | Other | 8.0 GB | 9baccfd8f4ea |
| 15b-train/ckpt_47000/__0_0.distcp | Other | 8.0 GB | 8e24184810cb |
| 15b-train/ckpt_48000/__0_0.distcp | Other | 8.0 GB | c91d2ad5ce5f |
| 15b-train/ckpt_49000/__0_0.distcp | Other | 8.0 GB | 0c9011333c3d |
| 15b-train/ckpt_5000/__0_0.distcp | Other | 7.9 GB | b6e922cd4f91 |
| 15b-train/ckpt_5000/__1_0.distcp | Other | 18.1 GB | 6bdd8b1ab23b |
| 15b-train/ckpt_50000/__0_0.distcp | Other | 8.0 GB | c061a51ac736 |
| 15b-train/ckpt_51000/__0_0.distcp | Other | 8.0 GB | 7d64918c186e |
| 15b-train/ckpt_52000/__0_0.distcp | Other | 8.0 GB | 1a0e3996fcf5 |
| 15b-train/ckpt_53000/__0_0.distcp | Other | 8.0 GB | 47ea41682db0 |
| 15b-train/ckpt_54000/__0_0.distcp | Other | 8.0 GB | 489182eee11e |
| 15b-train/ckpt_55000/__0_0.distcp | Other | 8.0 GB | bffb323603de |
| 15b-train/ckpt_56000/__0_0.distcp | Other | 8.0 GB | c793682d3541 |
| 15b-train/ckpt_57000/__0_0.distcp | Other | 8.0 GB | a67ba0c991eb |
| 15b-train/ckpt_58000/__0_0.distcp | Other | 8.0 GB | 07a509fabd8b |
| 15b-train/ckpt_59000/__0_0.distcp | Other | 8.0 GB | 69f4bc6219d8 |
| 15b-train/ckpt_6000/__0_0.distcp | Other | 7.9 GB | 98151ddba8e4 |
| 15b-train/ckpt_6000/__1_0.distcp | Other | 18.1 GB | c5bc44d14217 |
| 15b-train/ckpt_60000/__0_0.distcp | Other | 8.0 GB | 28dd386a68b3 |
| 15b-train/ckpt_61000/__0_0.distcp | Other | 8.0 GB | 6f17d06e28a7 |
| 15b-train/ckpt_62000/__0_0.distcp | Other | 8.0 GB | c351b1291e9c |
| 15b-train/ckpt_63000/__0_0.distcp | Other | 8.0 GB | 316366373fd7 |
| 15b-train/ckpt_64000/__0_0.distcp | Other | 8.0 GB | 7de33d1b4f4f |
| 15b-train/ckpt_65000/__0_0.distcp | Other | 8.0 GB | 56216f7becd1 |
| 15b-train/ckpt_66000/__0_0.distcp | Other | 8.0 GB | 224044083b65 |
| 15b-train/ckpt_67000/__0_0.distcp | Other | 8.0 GB | b3b1c79bb0ed |
| 15b-train/ckpt_68000/__0_0.distcp | Other | 8.0 GB | 266bb458df20 |
| 15b-train/ckpt_69000/__0_0.distcp | Other | 8.0 GB | 1527be523e0e |
| 15b-train/ckpt_7000/__0_0.distcp | Other | 7.9 GB | cab0402b7414 |
| 15b-train/ckpt_7000/__1_0.distcp | Other | 18.1 GB | 5446a509251b |
| 15b-train/ckpt_70000/__0_0.distcp | Other | 8.0 GB | b296319c5e1c |
| 15b-train/ckpt_71000/__0_0.distcp | Other | 8.0 GB | 6abdd8ddf4ce |
| 15b-train/ckpt_72000/__0_0.distcp | Other | 8.0 GB | 40803b565219 |
| 15b-train/ckpt_73000/__0_0.distcp | Other | 8.0 GB | 1a624cb3ed11 |
| 15b-train/ckpt_74000/__0_0.distcp | Other | 8.0 GB | deaa8879314f |
| 15b-train/ckpt_75000/__0_0.distcp | Other | 8.0 GB | ddbeb42d56ad |
| 15b-train/ckpt_76000/__0_0.distcp | Other | 8.0 GB | f97b6553bdda |
| 15b-train/ckpt_77000/__0_0.distcp | Other | 8.0 GB | e4bc60b454f7 |
| 15b-train/ckpt_78000/__0_0.distcp | Other | 8.0 GB | 759f2f627249 |
| 15b-train/ckpt_79000/__0_0.distcp | Other | 8.0 GB | 41d6f95256ff |
| 15b-train/ckpt_80000/__0_0.distcp | Other | 8.0 GB | 32344b1d521e |
| 15b-train/ckpt_81000/__0_0.distcp | Other | 8.0 GB | 3b2857f3e6d6 |
| 15b-train/ckpt_82000/__0_0.distcp | Other | 8.0 GB | 15e2437bcc79 |
| 15b-train/ckpt_83000/__0_0.distcp | Other | 8.0 GB | dc7f6d5ba783 |
| 15b-train/ckpt_84000/__0_0.distcp | Other | 8.0 GB | 539a8d7c64a7 |
| 15b-train/ckpt_85000/__0_0.distcp | Other | 8.0 GB | 614f2c6697ea |
| 15b-train/ckpt_86000/__0_0.distcp | Other | 8.0 GB | 617a631babb9 |
| 15b-train/ckpt_87000/__0_0.distcp | Other | 8.0 GB | f3ae15ae20bc |
| 15b-train/ckpt_88000/__0_0.distcp | Other | 8.0 GB | 460e91b59aa3 |
| 15b-train/ckpt_89000/__0_0.distcp | Other | 8.0 GB | 2584e5cbbcb0 |
| 15b-train/ckpt_9000/__0_0.distcp | Other | 7.9 GB | 346a9b85f445 |
| 15b-train/ckpt_9000/__1_0.distcp | Other | 18.1 GB | 7308c53bc6c6 |
| 15b-train/ckpt_90000/__0_0.distcp | Other | 8.0 GB | 79bc569b34c7 |
| 15b-train/ckpt_91000/__0_0.distcp | Other | 8.0 GB | 467abe540cd6 |
| 15b-train/ckpt_92000/__0_0.distcp | Other | 8.0 GB | b97ed3e937ba |
| 15b-train/ckpt_93000/__0_0.distcp | Other | 8.0 GB | 6f40ad9399e8 |
| 15b-train/ckpt_94000/__0_0.distcp | Other | 8.0 GB | b2038552276f |
| 15b-train/ckpt_95000/__0_0.distcp | Other | 8.0 GB | 7a74d15613d5 |
| 15b-train/ckpt_96000/__0_0.distcp | Other | 8.0 GB | a83fac9e3bb2 |
| 15b-train/ckpt_97000/__0_0.distcp | Other | 8.0 GB | e57fa4dc212f |
| 15b-train/ckpt_98000/__0_0.distcp | Other | 8.0 GB | f4f1e01c1521 |
| 15b-train/ckpt_99000/__0_0.distcp | Other | 8.0 GB | 2e49d8372f65 |
| 15b-train/loss.log | Other | 544.5 KB | — |
| 15b-train/loss.png | Other | 27.4 KB | — |
| 15b/engram-int8.safetensor | Other | 2.9 GB | cc96c5a0fe35 |
| 15b/model-00000-of-00005.safetensor | Other | 5.0 GB | e2f62b6ea66f |
| 15b/model-00001-of-00005.safetensor | Other | 5.0 GB | ac9e4f2d3210 |
| 15b/model-00002-of-00005.safetensor | Other | 5.0 GB | 965eba8388ac |
| 15b/model-00003-of-00005.safetensor | Other | 5.0 GB | a35a7456b06e |
| 15b/model-00004-of-00005.safetensor | Other | 4.4 GB | 69491bbe426e |
| .gitattributes | Repository | 17.2 KB | — |
| 15b-train/ckpt_1000/.metadata | Repository | 213.4 KB | 1bd3c54c66d8 |
| 15b-train/ckpt_10000/.metadata | Repository | 213.4 KB | 65cf748ead47 |
| 15b-train/ckpt_100000/.metadata | Repository | 358.0 KB | edec3bbb3a8e |
| 15b-train/ckpt_101000/.metadata | Repository | 358.0 KB | de88f302dfef |
| 15b-train/ckpt_102000/.metadata | Repository | 358.0 KB | 91a655307453 |
| 15b-train/ckpt_103000/.metadata | Repository | 358.0 KB | 3f882856fd9f |
| 15b-train/ckpt_104000/.metadata | Repository | 358.0 KB | fd5bade41923 |
| 15b-train/ckpt_105000/.metadata | Repository | 358.0 KB | 9a78a1e0848f |
| 15b-train/ckpt_106000/.metadata | Repository | 358.0 KB | d22d51ea46eb |
| 15b-train/ckpt_11000/.metadata | Repository | 213.4 KB | 3e7710e2caa6 |
| 15b-train/ckpt_114000/.metadata | Repository | 358.0 KB | e077b7bf2f2d |
| 15b-train/ckpt_12000/.metadata | Repository | 213.4 KB | 0ca3d68d68cd |
| 15b-train/ckpt_13000/.metadata | Repository | 210.7 KB | 8ad39026a68a |
| 15b-train/ckpt_14000/.metadata | Repository | 304.9 KB | cebd05b1d638 |
| 15b-train/ckpt_15000/.metadata | Repository | 304.9 KB | c5dd75b44974 |
| 15b-train/ckpt_16000/.metadata | Repository | 304.9 KB | e1cc5e21f856 |
| 15b-train/ckpt_17000/.metadata | Repository | 304.9 KB | c7fcdea6c69a |
| 15b-train/ckpt_18000/.metadata | Repository | 304.9 KB | a556d2088edd |
| 15b-train/ckpt_19000/.metadata | Repository | 304.9 KB | 03ec30a853c6 |
| 15b-train/ckpt_2000/.metadata | Repository | 213.4 KB | 78068049bde8 |
| 15b-train/ckpt_20000/.metadata | Repository | 304.9 KB | 9e02ddffb0a2 |
| 15b-train/ckpt_21000/.metadata | Repository | 304.9 KB | b16b4a54dbe4 |
| 15b-train/ckpt_22000/.metadata | Repository | 304.9 KB | 267ff3bcd420 |
| 15b-train/ckpt_23000/.metadata | Repository | 304.9 KB | dc99b502e85a |
| 15b-train/ckpt_24000/.metadata | Repository | 304.9 KB | f0ce0346de7f |
| 15b-train/ckpt_25000/.metadata | Repository | 304.9 KB | 3c5b3a1639d2 |
| 15b-train/ckpt_26000/.metadata | Repository | 304.9 KB | 6403e19dbc86 |
| 15b-train/ckpt_27000/.metadata | Repository | 304.9 KB | 03cad840361e |
| 15b-train/ckpt_28000/.metadata | Repository | 304.9 KB | 68e2f1be585a |
| 15b-train/ckpt_29000/.metadata | Repository | 304.9 KB | 5a30104000dd |
| 15b-train/ckpt_3000/.metadata | Repository | 213.4 KB | 3424e108f199 |
| 15b-train/ckpt_30000/.metadata | Repository | 304.9 KB | 70d681c3473f |
| 15b-train/ckpt_31000/.metadata | Repository | 304.9 KB | 6e9b90f64b66 |
| 15b-train/ckpt_32000/.metadata | Repository | 304.9 KB | 560853de8108 |
| 15b-train/ckpt_33000/.metadata | Repository | 304.9 KB | 402be4a8e2d7 |
| 15b-train/ckpt_34000/.metadata | Repository | 304.9 KB | d8d77a3396d5 |
| 15b-train/ckpt_35000/.metadata | Repository | 304.9 KB | 3e203ae1b7e1 |
| 15b-train/ckpt_36000/.metadata | Repository | 304.9 KB | e75b882cbc5f |
| 15b-train/ckpt_37000/.metadata | Repository | 304.9 KB | 0cb8467d040c |
| 15b-train/ckpt_38000/.metadata | Repository | 304.9 KB | e9fc3a52c253 |
| 15b-train/ckpt_39000/.metadata | Repository | 304.9 KB | 0982d6010c01 |
| 15b-train/ckpt_4000/.metadata | Repository | 213.4 KB | 403f3c9d0cfc |
| 15b-train/ckpt_40000/.metadata | Repository | 304.9 KB | 9af129c1ff0e |
| 15b-train/ckpt_41000/.metadata | Repository | 304.9 KB | a2c44233fb28 |
| 15b-train/ckpt_42000/.metadata | Repository | 304.9 KB | 5c093fc9779b |
| 15b-train/ckpt_43000/.metadata | Repository | 304.9 KB | 54d6a60fc054 |
| 15b-train/ckpt_44000/.metadata | Repository | 304.9 KB | 589d005a43f0 |
| 15b-train/ckpt_45000/.metadata | Repository | 304.9 KB | 41ed9ac48b05 |
| 15b-train/ckpt_46000/.metadata | Repository | 304.9 KB | 0549da385b8c |
| 15b-train/ckpt_47000/.metadata | Repository | 304.9 KB | 897aff58eb44 |
| 15b-train/ckpt_48000/.metadata | Repository | 304.9 KB | 8d17ac702b92 |
| 15b-train/ckpt_49000/.metadata | Repository | 304.9 KB | 0cfe52effa48 |
| 15b-train/ckpt_5000/.metadata | Repository | 213.4 KB | 9034d3321703 |
| 15b-train/ckpt_50000/.metadata | Repository | 304.9 KB | 8d376951bc70 |
| 15b-train/ckpt_51000/.metadata | Repository | 304.9 KB | f1169fc4fa7e |
| 15b-train/ckpt_52000/.metadata | Repository | 304.9 KB | 234e4f764cb6 |
| 15b-train/ckpt_53000/.metadata | Repository | 304.9 KB | 378e130c8887 |
| 15b-train/ckpt_54000/.metadata | Repository | 304.9 KB | 327e14f6c88f |
| 15b-train/ckpt_55000/.metadata | Repository | 304.9 KB | cbd175838eae |
| 15b-train/ckpt_56000/.metadata | Repository | 304.9 KB | 8c4a8f38dd0c |
| 15b-train/ckpt_57000/.metadata | Repository | 304.9 KB | 81e508113c56 |
| 15b-train/ckpt_58000/.metadata | Repository | 304.9 KB | cd5cbe52fa4d |
| 15b-train/ckpt_59000/.metadata | Repository | 304.9 KB | 82e6cd6d2f2b |
| 15b-train/ckpt_6000/.metadata | Repository | 213.4 KB | 9bb785325476 |
| 15b-train/ckpt_60000/.metadata | Repository | 358.0 KB | 14c4fb969045 |
| 15b-train/ckpt_61000/.metadata | Repository | 358.0 KB | a0efcea6bbff |
| 15b-train/ckpt_62000/.metadata | Repository | 358.0 KB | bb5e0fbda1bc |
| 15b-train/ckpt_63000/.metadata | Repository | 358.0 KB | bd916a910b7a |
| 15b-train/ckpt_64000/.metadata | Repository | 358.0 KB | ab9341ddecc8 |
| 15b-train/ckpt_65000/.metadata | Repository | 358.0 KB | c470595321f5 |
| 15b-train/ckpt_66000/.metadata | Repository | 358.0 KB | d52293cb575c |
| 15b-train/ckpt_67000/.metadata | Repository | 358.0 KB | 2a3f321b65d6 |
| 15b-train/ckpt_68000/.metadata | Repository | 358.0 KB | 4f72f1480fcc |
| 15b-train/ckpt_69000/.metadata | Repository | 358.0 KB | 58aac19848a9 |
| 15b-train/ckpt_7000/.metadata | Repository | 213.4 KB | 8ace771f6a51 |
| 15b-train/ckpt_70000/.metadata | Repository | 358.0 KB | 816f709e760d |
| 15b-train/ckpt_71000/.metadata | Repository | 358.0 KB | 415324f28ce4 |
| 15b-train/ckpt_72000/.metadata | Repository | 358.0 KB | 912d83516048 |
| 15b-train/ckpt_73000/.metadata | Repository | 358.0 KB | f903d7cf4dd2 |
| 15b-train/ckpt_74000/.metadata | Repository | 358.0 KB | 3bc2bca2fb93 |
| 15b-train/ckpt_75000/.metadata | Repository | 358.0 KB | a059da783464 |
| 15b-train/ckpt_76000/.metadata | Repository | 358.0 KB | 9e57a7c14fb6 |
| 15b-train/ckpt_77000/.metadata | Repository | 358.0 KB | 05c663c3dc0b |
| 15b-train/ckpt_78000/.metadata | Repository | 358.0 KB | aae1244cfee7 |
| 15b-train/ckpt_79000/.metadata | Repository | 358.0 KB | 3035e2020c6f |
| 15b-train/ckpt_80000/.metadata | Repository | 358.0 KB | 6767236801e0 |
| 15b-train/ckpt_81000/.metadata | Repository | 358.0 KB | f6667e2ae98b |
| 15b-train/ckpt_82000/.metadata | Repository | 358.0 KB | 4c6d0faa5660 |
| 15b-train/ckpt_83000/.metadata | Repository | 358.0 KB | 948e8f6a3e5a |
| 15b-train/ckpt_84000/.metadata | Repository | 358.0 KB | 3b1e5074e1e9 |
| 15b-train/ckpt_85000/.metadata | Repository | 358.0 KB | e82698157ec8 |
| 15b-train/ckpt_86000/.metadata | Repository | 358.0 KB | d9089bd918b7 |
| 15b-train/ckpt_87000/.metadata | Repository | 358.0 KB | 4cd09d52e914 |
| 15b-train/ckpt_88000/.metadata | Repository | 358.0 KB | da8eff7e9346 |
| 15b-train/ckpt_89000/.metadata | Repository | 358.0 KB | 41cce2686eae |
| 15b-train/ckpt_9000/.metadata | Repository | 213.4 KB | dd15927ca3d1 |
| 15b-train/ckpt_90000/.metadata | Repository | 358.0 KB | 1f637c0c0a82 |
| 15b-train/ckpt_91000/.metadata | Repository | 358.0 KB | 3ed1a41b0389 |
| 15b-train/ckpt_92000/.metadata | Repository | 358.0 KB | 79d215454c50 |
| 15b-train/ckpt_93000/.metadata | Repository | 358.0 KB | 0b0b95319f1b |
| 15b-train/ckpt_94000/.metadata | Repository | 358.0 KB | 638c734861b5 |
| 15b-train/ckpt_95000/.metadata | Repository | 358.0 KB | e8d6deb9f0bd |
| 15b-train/ckpt_96000/.metadata | Repository | 358.0 KB | 80dd345c6c22 |
| 15b-train/ckpt_97000/.metadata | Repository | 358.0 KB | 3dd55981ed66 |
| 15b-train/ckpt_98000/.metadata | Repository | 358.0 KB | aa21f5e76c9f |
| 15b-train/ckpt_99000/.metadata | Repository | 358.0 KB | 69e71a5cc275 |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
- Download size
- 2.2 TB
Download from Gugu8
Released by Gugu8 through its official repository on Hugging Face.
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 2.2 TB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.
Questions About L-CED-15B
What is L-CED-15B's context length?
1,048,576 tokens, from the maximum position embeddings in its published configuration.