# Models, Page 162 of 525 Source: https://savrn.com/models/page/162 Markdown alternate of the page above; the site index is https://savrn.com/llms.txt --- SAVRN Model Hub # Open-Weight Models An open-weight model is an AI model whose trained weights are published for anyone to download. The weights are what the model learned in training. With a copy of them you can run the model on hardware you control and train it further on your own data. Open weights are not the same as open source. Many publishers release the weights without the training data or code, and the license sets what you may do with the model. This library puts each model's full card, architecture, files, license and published evaluations on one page. 12,579Models 3,583Datasets 291Papers 7,578Publishers 12,850Sourced relationships Updated 2026-10-23 · [How the library is built](https://savrn.com/model-hub/methodology) ## Filter Models Task - [Text generation1,548](https://savrn.com/models?task=Text+generation) - [Image and text to text577](https://savrn.com/models?task=Image+and+text+to+text) - [Feature extraction398](https://savrn.com/models?task=Feature+extraction) - [Robotics398](https://savrn.com/models?task=Robotics) - [Text classification331](https://savrn.com/models?task=Text+classification) - [Text to image232](https://savrn.com/models?task=Text+to+image) - [Speech recognition187](https://savrn.com/models?task=Speech+recognition) - [Text to speech145](https://savrn.com/models?task=Text+to+speech) - [Image classification139](https://savrn.com/models?task=Image+classification) - [Audio classification130](https://savrn.com/models?task=Audio+classification) - [Sentence similarity103](https://savrn.com/models?task=Sentence+similarity) - [Reinforcement learning100](https://savrn.com/models?task=Reinforcement+learning) - [Token classification100](https://savrn.com/models?task=Token+classification) - [Zero-shot classification94](https://savrn.com/models?task=Zero-shot+classification) - [Image segmentation90](https://savrn.com/models?task=Image+segmentation) - [Object detection86](https://savrn.com/models?task=Object+detection) - [Translation80](https://savrn.com/models?task=Translation) - [Any to any79](https://savrn.com/models?task=Any+to+any) - [Question answering73](https://savrn.com/models?task=Question+answering) - [Fill mask69](https://savrn.com/models?task=Fill+mask) - [Time series forecasting64](https://savrn.com/models?task=Time+series+forecasting) - [Video classification61](https://savrn.com/models?task=Video+classification) - [Image to text60](https://savrn.com/models?task=Image+to+text) - [Text to video55](https://savrn.com/models?task=Text+to+video) Library - [transformers3,001](https://savrn.com/models?library=transformers) - [peft367](https://savrn.com/models?library=peft) - [diffusers206](https://savrn.com/models?library=diffusers) - [pytorch198](https://savrn.com/models?library=pytorch) - [gguf187](https://savrn.com/models?library=gguf) - [mlx169](https://savrn.com/models?library=mlx) - [lerobot152](https://savrn.com/models?library=lerobot) - [sentence-transformers139](https://savrn.com/models?library=sentence-transformers) - [timm49](https://savrn.com/models?library=timm) - [llama.cpp46](https://savrn.com/models?library=llama.cpp) - [transformers.js45](https://savrn.com/models?library=transformers.js) - [flaxspeaker44](https://savrn.com/models?library=flaxspeaker) - [diffusion-single-file40](https://savrn.com/models?library=diffusion-single-file) - [onnx40](https://savrn.com/models?library=onnx) - [vllm40](https://savrn.com/models?library=vllm) - [openpi35](https://savrn.com/models?library=openpi) - [minimax-h328](https://savrn.com/models?library=minimax-h3) - [ultralytics24](https://savrn.com/models?library=ultralytics) - [PaddleOCR22](https://savrn.com/models?library=PaddleOCR) - [coreml22](https://savrn.com/models?library=coreml) - [exllamav322](https://savrn.com/models?library=exllamav3) - [openvino20](https://savrn.com/models?library=openvino) - [litert17](https://savrn.com/models?library=litert) - [litert-lm16](https://savrn.com/models?library=litert-lm) Modality - [Other7,212](https://savrn.com/models?modality=Other) - [Text2,838](https://savrn.com/models?modality=Text) - [Image and text637](https://savrn.com/models?modality=Image+and+text) - [Image598](https://savrn.com/models?modality=Image) - [Control498](https://savrn.com/models?modality=Control) - [Audio481](https://savrn.com/models?modality=Audio) - [Video116](https://savrn.com/models?modality=Video) - [Multimodal79](https://savrn.com/models?modality=Multimodal) - [Time series64](https://savrn.com/models?modality=Time+series) - [Tabular56](https://savrn.com/models?modality=Tabular) License - [apache-2.03,344](https://savrn.com/models?license=apache-2.0) - [mit1,319](https://savrn.com/models?license=mit) - [other796](https://savrn.com/models?license=other) - [cc-by-nc-4.0213](https://savrn.com/models?license=cc-by-nc-4.0) - [cc-by-4.0164](https://savrn.com/models?license=cc-by-4.0) - [bsd-3-clause108](https://savrn.com/models?license=bsd-3-clause) - [gemma63](https://savrn.com/models?license=gemma) - [cc-by-nc-sa-4.055](https://savrn.com/models?license=cc-by-nc-sa-4.0) - [llama3.240](https://savrn.com/models?license=llama3.2) - [unknown33](https://savrn.com/models?license=unknown) - [agpl-3.032](https://savrn.com/models?license=agpl-3.0) - [llama3.128](https://savrn.com/models?license=llama3.1) - [cc-by-sa-4.020](https://savrn.com/models?license=cc-by-sa-4.0) - [gpl-3.020](https://savrn.com/models?license=gpl-3.0) - [openrail++17](https://savrn.com/models?license=openrail%2B%2B) - [creativeml-openrail-m15](https://savrn.com/models?license=creativeml-openrail-m) - [openmdw-1.115](https://savrn.com/models?license=openmdw-1.1) - [cc-by-nc-nd-4.014](https://savrn.com/models?license=cc-by-nc-nd-4.0) - [llama314](https://savrn.com/models?license=llama3) - [openrail14](https://savrn.com/models?license=openrail) - [llama28](https://savrn.com/models?license=llama2) - [afl-3.07](https://savrn.com/models?license=afl-3.0) - [osl-3.06](https://savrn.com/models?license=osl-3.0) - [cc0-1.04](https://savrn.com/models?license=cc0-1.0) Access - [Open weights12,153](https://savrn.com/models?access=open_access) - [Access requested at publisher426](https://savrn.com/models?access=gated) Publisher - [Team Mradermacher328](https://savrn.com/models?publisher=mradermacher) - [Yurun Yuan115](https://savrn.com/models?publisher=ryanyr) - [RunningHub.ai105](https://savrn.com/models?publisher=runninghubai) - [Qwen91](https://savrn.com/models?publisher=qwen) - [Jenny Wilson85](https://savrn.com/models?publisher=jenny08311) - [Jessen Pu77](https://savrn.com/models?publisher=putty77) - [RKNNAI73](https://savrn.com/models?publisher=rknnai) - [AI at Meta72](https://savrn.com/models?publisher=facebook) - [Convergent Intelligence66](https://savrn.com/models?publisher=reaperdoesntknow) - [Yurun Yuan65](https://savrn.com/models?publisher=yurunyyr) - [Google64](https://savrn.com/models?publisher=google) - [Yurun Yuan62](https://savrn.com/models?publisher=yuruny) - [Firza Hadzami61](https://savrn.com/models?publisher=firzahdzm) - [Zeyuan Yang59](https://savrn.com/models?publisher=miiche) - [Yurun Yuan58](https://savrn.com/models?publisher=yyuan244) - [Yanggangu57](https://savrn.com/models?publisher=yanggangu) - [Hongao56](https://savrn.com/models?publisher=cisco1963) - [Christopher Subia-Waud55](https://savrn.com/models?publisher=cwaud) - [Francesca Padovani53](https://savrn.com/models?publisher=francesca9805) - [Khazzz1c53](https://savrn.com/models?publisher=khazic) - [Alfred Smith52](https://savrn.com/models?publisher=alfred8995) - [Szekely52](https://savrn.com/models?publisher=attila115) - [NVIDIA50](https://savrn.com/models?publisher=nvidia) - [Wang49](https://savrn.com/models?publisher=davidwdw) [Most downloaded](https://savrn.com/models?sort=downloads)[Most liked](https://savrn.com/models?sort=likes)[Recently updated](https://savrn.com/models?sort=updated)[Name](https://savrn.com/models?sort=name)[Largest](https://savrn.com/models?sort=params) 12,579 models, sorted by most downloaded. Model · Text generation ### [Gemma-4-Writers-31B](https://savrn.com/models/gemma-4-writers-31b) [Ateron](https://savrn.com/model-publishers/ateron) "Less Gemma - more human" I had a lot of fresh and creative experience with both ConicCat tunes, but they had some instability issues, that I hopefully fixed there. Open weights apache-2.0 31.3B parameters 262,144 tokens [View model](https://savrn.com/models/gemma-4-writers-31b) Model · Image and text to text ### [Gemma-4-Writers-31B-V2-W8A16-FP8](https://savrn.com/models/gemma-4-writers-31b-v2-w8a16-fp8) [Hoborific](https://savrn.com/model-publishers/hoborific) Quantized version of Ateron/Gemma-4-Writers-31B-V2. Offline-quantized W8A16 FP8 in the float-quantized format: weights in float8e4m3fn with per-output-channel symmetric scales, activations kept in bf16/fp16. For each linear layer, every output row gets its own scale starting from amax / 448, refined by an MSE clip search over ~9 clip fractions (0.8–1.0× amax) picking the lowest-error scale per row. Weights are then quantized q = e4m3(w / scale) with round-to-nearest and saturation. This per-channel + clipping scheme gives better SNR than vLLM's online per-tensor --quantization fp8 path. Only 2D linear projection weights are quantized (attention q/k/v/o, MLP gate/up/down). Embeddings, norms… Open weights 31.3B parameters 262,144 tokens transformers [View model](https://savrn.com/models/gemma-4-writers-31b-v2-w8a16-fp8) Model ### [Gemma-4-Writers-31B-V2-i1-GGUF](https://savrn.com/models/gemma-4-writers-31b-v2-i1-gguf) [Team Mradermacher](https://savrn.com/model-publishers/mradermacher) weighted/imatrix quants of https://huggingface.co/Ateron/Gemma-4-Writers-31B-V2 For a convenient overview and download list, visit our model page for this model. static quants are available at https://huggingface.co/mradermacher/Gemma-4-Writers-31B-V2-GGUF This is a vision model - mmproj files (if any) will be in the static repository. If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files. (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) Here is a handy graph by ikawrakow comparing some lower-quality quant And here are Artefact2's thoughts on the… Open weights apache-2.0 transformers [View model](https://savrn.com/models/gemma-4-writers-31b-v2-i1-gguf) Model · Image and text to text ### [Gemma-4-Writers-31B-W8A16-FP8](https://savrn.com/models/gemma-4-writers-31b-w8a16-fp8) [Hoborific](https://savrn.com/model-publishers/hoborific) Quantized version of Ateron/Gemma-4-Writers-31B. Offline-quantized W8A16 FP8 in the float-quantized format: weights in float8e4m3fn with per-output-channel symmetric scales, activations kept in bf16/fp16. For each linear layer, every output row gets its own scale starting from amax / 448, refined by an MSE clip search over ~9 clip fractions (0.8–1.0× amax) picking the lowest-error scale per row. Weights are then quantized q = e4m3(w / scale) with round-to-nearest and saturation. This per-channel + clipping scheme gives better SNR than vLLM's online per-tensor --quantization fp8 path. Only 2D linear projection weights are quantized (attention q/k/v/o, MLP gate/up/down). Embeddings, norms… Open weights 31.3B parameters 262,144 tokens transformers [View model](https://savrn.com/models/gemma-4-writers-31b-w8a16-fp8) Model ### [Gemma-4-Writers-31B-i1-GGUF](https://savrn.com/models/gemma-4-writers-31b-i1-gguf) [Team Mradermacher](https://savrn.com/model-publishers/mradermacher) weighted/imatrix quants of https://huggingface.co/Ateron/Gemma-4-Writers-31B For a convenient overview and download list, visit our model page for this model. static quants are available at https://huggingface.co/mradermacher/Gemma-4-Writers-31B-GGUF This is a vision model - mmproj files (if any) will be in the static repository. If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files. (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) Here is a handy graph by ikawrakow comparing some lower-quality quant And here are Artefact2's thoughts on the… Open weights apache-2.0 transformers [View model](https://savrn.com/models/gemma-4-writers-31b-i1-gguf) Model ### [Gemma4-Writer-26BA4B-i1-GGUF](https://savrn.com/models/gemma4-writer-26ba4b-i1-gguf) [Team Mradermacher](https://savrn.com/model-publishers/mradermacher) weighted/imatrix quants of https://huggingface.co/ConicCat/Gemma4-Writer-26BA4B For a convenient overview and download list, visit our model page for this model. static quants are available at https://huggingface.co/mradermacher/Gemma4-Writer-26BA4B-GGUF This is a vision model - mmproj files (if any) will be in the static repository. If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files. (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) Here is a handy graph by ikawrakow comparing some lower-quality quant And here are Artefact2's thoughts on the… Open weights transformers [View model](https://savrn.com/models/gemma4-writer-26ba4b-i1-gguf) Model ### [Gemma4-Writer-31B-F-i1-GGUF](https://savrn.com/models/gemma4-writer-31b-f-i1-gguf) [Team Mradermacher](https://savrn.com/model-publishers/mradermacher) weighted/imatrix quants of https://huggingface.co/ConicCat/Gemma4-Writer-31B-F For a convenient overview and download list, visit our model page for this model. static quants are available at https://huggingface.co/mradermacher/Gemma4-Writer-31B-F-GGUF This is a vision model - mmproj files (if any) will be in the static repository. If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files. (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) Here is a handy graph by ikawrakow comparing some lower-quality quant And here are Artefact2's thoughts on the… Open weights transformers [View model](https://savrn.com/models/gemma4-writer-31b-f-i1-gguf) Model ### [Gemma4-Writer-31B-G-i1-GGUF](https://savrn.com/models/gemma4-writer-31b-g-i1-gguf) [Team Mradermacher](https://savrn.com/model-publishers/mradermacher) weighted/imatrix quants of https://huggingface.co/ConicCat/Gemma4-Writer-31B-G For a convenient overview and download list, visit our model page for this model. static quants are available at https://huggingface.co/mradermacher/Gemma4-Writer-31B-G-GGUF This is a vision model - mmproj files (if any) will be in the static repository. If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files. (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) Here is a handy graph by ikawrakow comparing some lower-quality quant And here are Artefact2's thoughts on the… Open weights apache-2.0 transformers [View model](https://savrn.com/models/gemma4-writer-31b-g-i1-gguf) Model ### [Gemmasutra-Small-4B-v1-GGUF](https://savrn.com/models/gemmasutra-small-4b-v1-gguf) [Abdullahi idris](https://savrn.com/model-publishers/drizzdahitman) BeaverAI proudly presents... - Thank you to each and everyone who donated and subscribed in Ko-Fi to make our venture a little bit easier. - I'm also recently unemployed. I am a Software Developer with 8 years of experience in Web, API, AI, and adapting to new tech and requirements. If you're hiring, feel free to reach out to me however. An upscaled Gemma 2B tune with modern techniques. Au Revoir, Gemma! Open weights other [View model](https://savrn.com/models/gemmasutra-small-4b-v1-gguf) Model · Reinforcement learning ### [GeoEvidence-Qwen3VL-4B-Thinking-RL](https://savrn.com/models/geoevidence-qwen3vl-4b-thinking-rl) [Zy Wang](https://savrn.com/model-publishers/wangzyuan) This private repository stores checkpoints from the GeoEvidence 4B answer-RL experiments. The vision-only and full-parameter runs start from the same Qwen3-VL-4B-Thinking base model and use separate run names. Checkpoints are uploaded under runs/ /globalstep /. The loadable model for a checkpoint is in its actor/huggingface/ subfolder. The run name, step, and commit ID are also recorded in the training output's GR1HFSYNC.json marker after upload verification. Evaluation uses the frozen Final483 dataset. See the project experiment record for the exact prompt, decoding protocol, dataset identity, and results. Open weights transformers [View model](https://savrn.com/models/geoevidence-qwen3vl-4b-thinking-rl) Model ### [GeoLadder-28M-8B-bs32-lr0.0074-wd0.1-decay0.01](https://savrn.com/models/geoladder-28m-8b-bs32-lr0-0074-wd0-1-decay0-01) [Dill Lab at USC](https://savrn.com/model-publishers/dill-lab) OLMo-style model trained on the deduplicated Pile, one of the 108 models released with (ICML 2026). Disentangling Geometry, Performance, and Training in Language Models Atharva Kulkarni, Jacob Mitchell Springer, Arjun Subramonian, Swabha Swayamdipta ICML 2026 (PMLR 306) · Paper · The paper asks whether the geometry of a language model's unembedding matrix, in particular its effective rank, can estimate downstream performance. Using a suite of 108 OLMo-style models (4M-75M parameters) trained under controlled variations of batch size, weight decay, learning rate, token budget and final LR, it finds that the relationship is inconsistent: high effective rank often accompanies the best models… Open weights [View model](https://savrn.com/models/geoladder-28m-8b-bs32-lr0-0074-wd0-1-decay0-01) Model ### [GeoLadder-28M-8B-bs32-lr0.0074-wd0.1-decay0.1](https://savrn.com/models/geoladder-28m-8b-bs32-lr0-0074-wd0-1-decay0-1) [Dill Lab at USC](https://savrn.com/model-publishers/dill-lab) OLMo-style model trained on the deduplicated Pile, one of the 108 models released with (ICML 2026). Disentangling Geometry, Performance, and Training in Language Models Atharva Kulkarni, Jacob Mitchell Springer, Arjun Subramonian, Swabha Swayamdipta ICML 2026 (PMLR 306) · Paper · The paper asks whether the geometry of a language model's unembedding matrix, in particular its effective rank, can estimate downstream performance. Using a suite of 108 OLMo-style models (4M-75M parameters) trained under controlled variations of batch size, weight decay, learning rate, token budget and final LR, it finds that the relationship is inconsistent: high effective rank often accompanies the best models… Open weights [View model](https://savrn.com/models/geoladder-28m-8b-bs32-lr0-0074-wd0-1-decay0-1) Model ### [GeoLadder-28M-8B-bs32-lr0.074-wd0.1-decay0.01](https://savrn.com/models/geoladder-28m-8b-bs32-lr0-074-wd0-1-decay0-01) [Dill Lab at USC](https://savrn.com/model-publishers/dill-lab) OLMo-style model trained on the deduplicated Pile, one of the 108 models released with (ICML 2026). Disentangling Geometry, Performance, and Training in Language Models Atharva Kulkarni, Jacob Mitchell Springer, Arjun Subramonian, Swabha Swayamdipta ICML 2026 (PMLR 306) · Paper · The paper asks whether the geometry of a language model's unembedding matrix, in particular its effective rank, can estimate downstream performance. Using a suite of 108 OLMo-style models (4M-75M parameters) trained under controlled variations of batch size, weight decay, learning rate, token budget and final LR, it finds that the relationship is inconsistent: high effective rank often accompanies the best models… Open weights [View model](https://savrn.com/models/geoladder-28m-8b-bs32-lr0-074-wd0-1-decay0-01) Model ### [GeoLadder-28M-8B-bs512-lr0.0074-wd0.1-decay0.01](https://savrn.com/models/geoladder-28m-8b-bs512-lr0-0074-wd0-1-decay0-01) [Dill Lab at USC](https://savrn.com/model-publishers/dill-lab) OLMo-style model trained on the deduplicated Pile, one of the 108 models released with (ICML 2026). Disentangling Geometry, Performance, and Training in Language Models Atharva Kulkarni, Jacob Mitchell Springer, Arjun Subramonian, Swabha Swayamdipta ICML 2026 (PMLR 306) · Paper · The paper asks whether the geometry of a language model's unembedding matrix, in particular its effective rank, can estimate downstream performance. Using a suite of 108 OLMo-style models (4M-75M parameters) trained under controlled variations of batch size, weight decay, learning rate, token budget and final LR, it finds that the relationship is inconsistent: high effective rank often accompanies the best models… Open weights [View model](https://savrn.com/models/geoladder-28m-8b-bs512-lr0-0074-wd0-1-decay0-01) Model ### [GeoLadder-28M-8B-bs64-lr0.0074-wd0.1-decay0.01](https://savrn.com/models/geoladder-28m-8b-bs64-lr0-0074-wd0-1-decay0-01) [Dill Lab at USC](https://savrn.com/model-publishers/dill-lab) OLMo-style model trained on the deduplicated Pile, one of the 108 models released with (ICML 2026). Disentangling Geometry, Performance, and Training in Language Models Atharva Kulkarni, Jacob Mitchell Springer, Arjun Subramonian, Swabha Swayamdipta ICML 2026 (PMLR 306) · Paper · The paper asks whether the geometry of a language model's unembedding matrix, in particular its effective rank, can estimate downstream performance. Using a suite of 108 OLMo-style models (4M-75M parameters) trained under controlled variations of batch size, weight decay, learning rate, token budget and final LR, it finds that the relationship is inconsistent: high effective rank often accompanies the best models… Open weights [View model](https://savrn.com/models/geoladder-28m-8b-bs64-lr0-0074-wd0-1-decay0-01) Model ### [GeoLadder-40M-128B-bs512-lr0.0065-wd0.1-decay0.01](https://savrn.com/models/geoladder-40m-128b-bs512-lr0-0065-wd0-1-decay0-01) [Dill Lab at USC](https://savrn.com/model-publishers/dill-lab) OLMo-style model trained on the deduplicated Pile, one of the 108 models released with (ICML 2026). Disentangling Geometry, Performance, and Training in Language Models Atharva Kulkarni, Jacob Mitchell Springer, Arjun Subramonian, Swabha Swayamdipta ICML 2026 (PMLR 306) · Paper · The paper asks whether the geometry of a language model's unembedding matrix, in particular its effective rank, can estimate downstream performance. Using a suite of 108 OLMo-style models (4M-75M parameters) trained under controlled variations of batch size, weight decay, learning rate, token budget and final LR, it finds that the relationship is inconsistent: high effective rank often accompanies the best models… Open weights [View model](https://savrn.com/models/geoladder-40m-128b-bs512-lr0-0065-wd0-1-decay0-01) Model ### [GeoLadder-40M-32B-bs128-lr0.0065-wd0.1-decay0.01](https://savrn.com/models/geoladder-40m-32b-bs128-lr0-0065-wd0-1-decay0-01) [Dill Lab at USC](https://savrn.com/model-publishers/dill-lab) OLMo-style model trained on the deduplicated Pile, one of the 108 models released with (ICML 2026). Disentangling Geometry, Performance, and Training in Language Models Atharva Kulkarni, Jacob Mitchell Springer, Arjun Subramonian, Swabha Swayamdipta ICML 2026 (PMLR 306) · Paper · The paper asks whether the geometry of a language model's unembedding matrix, in particular its effective rank, can estimate downstream performance. Using a suite of 108 OLMo-style models (4M-75M parameters) trained under controlled variations of batch size, weight decay, learning rate, token budget and final LR, it finds that the relationship is inconsistent: high effective rank often accompanies the best models… Open weights [View model](https://savrn.com/models/geoladder-40m-32b-bs128-lr0-0065-wd0-1-decay0-01) Model ### [GeoLadder-40M-32B-bs256-lr0.0065-wd0.1-decay0.01](https://savrn.com/models/geoladder-40m-32b-bs256-lr0-0065-wd0-1-decay0-01) [Dill Lab at USC](https://savrn.com/model-publishers/dill-lab) OLMo-style model trained on the deduplicated Pile, one of the 108 models released with (ICML 2026). Disentangling Geometry, Performance, and Training in Language Models Atharva Kulkarni, Jacob Mitchell Springer, Arjun Subramonian, Swabha Swayamdipta ICML 2026 (PMLR 306) · Paper · The paper asks whether the geometry of a language model's unembedding matrix, in particular its effective rank, can estimate downstream performance. Using a suite of 108 OLMo-style models (4M-75M parameters) trained under controlled variations of batch size, weight decay, learning rate, token budget and final LR, it finds that the relationship is inconsistent: high effective rank often accompanies the best models… Open weights [View model](https://savrn.com/models/geoladder-40m-32b-bs256-lr0-0065-wd0-1-decay0-01) Model ### [GeoLadder-40M-32B-bs32-lr0.0065-wd0.1-decay0.01](https://savrn.com/models/geoladder-40m-32b-bs32-lr0-0065-wd0-1-decay0-01) [Dill Lab at USC](https://savrn.com/model-publishers/dill-lab) OLMo-style model trained on the deduplicated Pile, one of the 108 models released with (ICML 2026). Disentangling Geometry, Performance, and Training in Language Models Atharva Kulkarni, Jacob Mitchell Springer, Arjun Subramonian, Swabha Swayamdipta ICML 2026 (PMLR 306) · Paper · The paper asks whether the geometry of a language model's unembedding matrix, in particular its effective rank, can estimate downstream performance. Using a suite of 108 OLMo-style models (4M-75M parameters) trained under controlled variations of batch size, weight decay, learning rate, token budget and final LR, it finds that the relationship is inconsistent: high effective rank often accompanies the best models… Open weights [View model](https://savrn.com/models/geoladder-40m-32b-bs32-lr0-0065-wd0-1-decay0-01) Model ### [GeoLadder-40M-32B-bs512-lr0.0065-wd0.1-decay0.01](https://savrn.com/models/geoladder-40m-32b-bs512-lr0-0065-wd0-1-decay0-01) [Dill Lab at USC](https://savrn.com/model-publishers/dill-lab) OLMo-style model trained on the deduplicated Pile, one of the 108 models released with (ICML 2026). Disentangling Geometry, Performance, and Training in Language Models Atharva Kulkarni, Jacob Mitchell Springer, Arjun Subramonian, Swabha Swayamdipta ICML 2026 (PMLR 306) · Paper · The paper asks whether the geometry of a language model's unembedding matrix, in particular its effective rank, can estimate downstream performance. Using a suite of 108 OLMo-style models (4M-75M parameters) trained under controlled variations of batch size, weight decay, learning rate, token budget and final LR, it finds that the relationship is inconsistent: high effective rank often accompanies the best models… Open weights [View model](https://savrn.com/models/geoladder-40m-32b-bs512-lr0-0065-wd0-1-decay0-01) Model ### [GeoLadder-40M-32B-bs64-lr0.0065-wd0.1-decay0.01](https://savrn.com/models/geoladder-40m-32b-bs64-lr0-0065-wd0-1-decay0-01) [Dill Lab at USC](https://savrn.com/model-publishers/dill-lab) OLMo-style model trained on the deduplicated Pile, one of the 108 models released with (ICML 2026). Disentangling Geometry, Performance, and Training in Language Models Atharva Kulkarni, Jacob Mitchell Springer, Arjun Subramonian, Swabha Swayamdipta ICML 2026 (PMLR 306) · Paper · The paper asks whether the geometry of a language model's unembedding matrix, in particular its effective rank, can estimate downstream performance. Using a suite of 108 OLMo-style models (4M-75M parameters) trained under controlled variations of batch size, weight decay, learning rate, token budget and final LR, it finds that the relationship is inconsistent: high effective rank often accompanies the best models… Open weights [View model](https://savrn.com/models/geoladder-40m-32b-bs64-lr0-0065-wd0-1-decay0-01) Model ### [GeoLadder-40M-64B-bs256-lr0.0065-wd0.1-decay0.01](https://savrn.com/models/geoladder-40m-64b-bs256-lr0-0065-wd0-1-decay0-01) [Dill Lab at USC](https://savrn.com/model-publishers/dill-lab) OLMo-style model trained on the deduplicated Pile, one of the 108 models released with (ICML 2026). Disentangling Geometry, Performance, and Training in Language Models Atharva Kulkarni, Jacob Mitchell Springer, Arjun Subramonian, Swabha Swayamdipta ICML 2026 (PMLR 306) · Paper · The paper asks whether the geometry of a language model's unembedding matrix, in particular its effective rank, can estimate downstream performance. Using a suite of 108 OLMo-style models (4M-75M parameters) trained under controlled variations of batch size, weight decay, learning rate, token budget and final LR, it finds that the relationship is inconsistent: high effective rank often accompanies the best models… Open weights [View model](https://savrn.com/models/geoladder-40m-64b-bs256-lr0-0065-wd0-1-decay0-01) Model ### [GeoLadder-40M-8B-bs128-lr0.0065-wd0.1-decay0.01](https://savrn.com/models/geoladder-40m-8b-bs128-lr0-0065-wd0-1-decay0-01) [Dill Lab at USC](https://savrn.com/model-publishers/dill-lab) OLMo-style model trained on the deduplicated Pile, one of the 108 models released with (ICML 2026). Disentangling Geometry, Performance, and Training in Language Models Atharva Kulkarni, Jacob Mitchell Springer, Arjun Subramonian, Swabha Swayamdipta ICML 2026 (PMLR 306) · Paper · The paper asks whether the geometry of a language model's unembedding matrix, in particular its effective rank, can estimate downstream performance. Using a suite of 108 OLMo-style models (4M-75M parameters) trained under controlled variations of batch size, weight decay, learning rate, token budget and final LR, it finds that the relationship is inconsistent: high effective rank often accompanies the best models… Open weights [View model](https://savrn.com/models/geoladder-40m-8b-bs128-lr0-0065-wd0-1-decay0-01) Model ### [GeoLadder-40M-8B-bs256-lr0.0065-wd0.1-decay0.01](https://savrn.com/models/geoladder-40m-8b-bs256-lr0-0065-wd0-1-decay0-01) [Dill Lab at USC](https://savrn.com/model-publishers/dill-lab) OLMo-style model trained on the deduplicated Pile, one of the 108 models released with (ICML 2026). Disentangling Geometry, Performance, and Training in Language Models Atharva Kulkarni, Jacob Mitchell Springer, Arjun Subramonian, Swabha Swayamdipta ICML 2026 (PMLR 306) · Paper · The paper asks whether the geometry of a language model's unembedding matrix, in particular its effective rank, can estimate downstream performance. Using a suite of 108 OLMo-style models (4M-75M parameters) trained under controlled variations of batch size, weight decay, learning rate, token budget and final LR, it finds that the relationship is inconsistent: high effective rank often accompanies the best models… Open weights [View model](https://savrn.com/models/geoladder-40m-8b-bs256-lr0-0065-wd0-1-decay0-01) ## Model Collections Hand-picked starting points, each with the reason it exists. Collection · 4 entries ### [Embedding models for retrieval](https://savrn.com/collections/embedding-models-for-retrieval) Sentence and document embedding models used to build retrieval systems. Dimension and sequence length matter more than size here, and both come from the publisher. [View collection](https://savrn.com/collections/embedding-models-for-retrieval) Collection · 4 entries ### [Models that fit on one accelerator](https://savrn.com/collections/models-that-run-on-one-accelerator) Models whose publisher-reported parameter count puts them within reach of a single accelerator at common precisions. Memory needed depends on precision and serving configuration, so treat the parameter count as the starting point, not the answer. [View collection](https://savrn.com/collections/models-that-run-on-one-accelerator) Collection · 6 entries ### [Open-weight text models worth knowing](https://savrn.com/collections/open-weight-text-models-worth-knowing) Widely used open-weight language models, chosen because each one is a distinct family rather than a variant of the one above it. Selection, not a ranking. [View collection](https://savrn.com/collections/open-weight-text-models-worth-knowing) Collection · 3 entries ### [Speech and audio models](https://savrn.com/collections/speech-and-audio) Recognition and synthesis models, grouped so the two directions are easy to compare. [View collection](https://savrn.com/collections/speech-and-audio) ## Open-Weight Models Explained ### What is an open-weight model? An AI model whose trained weights are published for anyone to download, so it can be run, tested and fine-tuned on hardware the user controls. ### Is an open-weight model the same as open source? Not always. Open weights means the trained model can be downloaded. Open source usually also means the training code and data are available and the license allows broad reuse. Many open-weight models release the weights only. ### Can I use an open-weight model commercially? It depends on the license. Apache 2.0 and MIT allow commercial use. Other licenses limit it, for example to non-commercial use or below a set number of users. Every model page here shows its license. ### How much memory does an open-weight model need? About two bytes per parameter at 16-bit precision, so a 7-billion-parameter model needs roughly 14 GB for its weights, plus memory for the context it processes. Each model page lists its parameter count and the size of its files. ## Related SAVRN Research The hub sits beside SAVRN's market data and infrastructure research: what models cost to run, and what it takes to run them. SAVRN Index ### [What open models cost to run](https://savrn.com/ai-index/pricing/open-models) The same open-weight model priced by every host that serves it, per million tokens. Research Hub ### [Data center trackers and maps](https://savrn.com/data-center-research) Moratoriums, permits, power, water and capital behind the facilities that run these models. Method ### [How the Model Hub is built](https://savrn.com/model-hub/methodology) Sources, evidence labels, refresh behaviour, and the limits of every comparison here.