Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

old-wb-l40s-lora-weights

by WMTH-100d2exam WMTH-100d2exam/old-wb-l40s-lora-weights

old-wb-l40s-lora-weights is an open-weight model for text generation from WMTH-100d2exam, released under Apache License 2.0. Its published files total 13.8 GB.

The model weights of the LoRA / QLoRA runs done on the L40S server during the Warsaw Model Trainers Hackathon (25-26.09.2026): PEFT adapters, Trainer checkpoints (with optimizer state), lora.gguf adapters for llama.cpp and trainingargs.bin.

Parameters—
Context—
Weights13.8 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads—

Model Card

By WMTH-100d2exam, published under apache-2.0, revision 7ced4644f53a.

The model weights of the LoRA / QLoRA runs done on the L40S server during the Warsaw Model Trainers Hackathon (25-26.09.2026): PEFT adapters, Trainer checkpoints (with optimizer state), lora.gguf adapters for llama.cpp and trainingargs.bin. These are adapters, not full models. Every run uses the base google/gemma-4-12B-it-qat-q40-unquantized (the local path in adapterconfig.json points to a server copy of it). Layout: l40s-results/ /..., the same paths as oldwb/l40s-results/ in the GitHub repo Endote/WarsawModelTrainersHackathon, which holds the logs, metrics, data statistics and write-ups (README.md, EXPERIMENTS.md, BENCHMARKSRESEARCH.md). Restore into a checkout of that repo: python…

Read WMTH-100d2exam's full model card

old-wb L40S LoRA runs (weights)

The model weights of the LoRA / QLoRA runs done on the L40S server during the Warsaw Model Trainers Hackathon (25-26.09.2026): PEFT adapters, Trainer checkpoints (with optimizer state), lora.gguf adapters for llama.cpp and training_args.bin. These are adapters, not full models. Every run uses the base google/gemma-4-12B-it-qat-q4_0-unquantized (the local path in adapter_config.json points to a server copy of it).

Layout: l40s-results/<run>/..., the same paths as old_wb/l40s-results/ in the GitHub repo Endote/WarsawModelTrainersHackathon, which holds the logs, metrics, data statistics and write-ups (README.md, EXPERIMENTS.md, BENCHMARKS_RESEARCH.md).

Run LoRA rank / alpha Notes
lora-run, lora-smoke, lora-v2/{A,B}, lora-v3/{rft,rft_think}, hf-history-lora 32 / 64 first QLoRA run, pipeline smoke test, SFT variants, RFT variants
lora-v4/tournament/finalists/r8 and matching trial 8 / 16 hyper-parameter tournament
lora-v4/tournament/finalists/r4 and matching trial 4 / 8 hyper-parameter tournament

Restore into a checkout of that repo: python scripts/fetch_old_wb_weights.py. The tokenizer is the base model's; the GitHub repo keeps one copy (old_wb/l40s-results/TOKENIZER.md). The .pt/.bin files are pickles: load them only if you trust the source.

Identity and Version

Repository
WMTH-100d2exam/old-wb-l40s-lora-weights
Publisher
WMTH-100d2exam
Task
Text generation
Modality
Text
Library
peft
Parameters
Not stated by the source
Languages
pl
Revision
7ced4644f53a5a43ad2e751c49a7ad423f03b334
First published
2026-09-29
Last updated
2026-09-30

Files and Weights

106 files, 13.8 GB in total. The weights are 104 files totalling 13.8 GB in bin, gguf, pt, pth, safetensors.

Weights104 files · 13.8 GB
Documentation1 file · 1.6 KB
Repository1 file · 2.6 KB
Every file
FileTypeSizeSHA-256
l40s-results/hf-history-lora/adapter_model.safetensorsWeights524.6 MB a8435e531b3d
l40s-results/hf-history-lora/lora.ggufWeights262.3 MB 44a1a3e14b95
l40s-results/lora-run/run/adapter/adapter_model.safetensorsWeights524.6 MB a8435e531b3d
l40s-results/lora-run/run/adapter/training_args.binWeights5.7 KB 465f54afb9e7
l40s-results/lora-run/run/checkpoints/checkpoint-72/adapter_model.safetensorsWeights262.4 MB e98ecee5f4e4
l40s-results/lora-run/run/checkpoints/checkpoint-72/optimizer.ptWeights267.2 MB db53b7791aba
l40s-results/lora-run/run/checkpoints/checkpoint-72/rng_state.pthWeights14.6 KB e767df60dcc9
l40s-results/lora-run/run/checkpoints/checkpoint-72/scheduler.ptWeights1.5 KB c149e3d6a6ed
l40s-results/lora-run/run/checkpoints/checkpoint-72/training_args.binWeights5.7 KB 465f54afb9e7
l40s-results/lora-run/run/checkpoints/checkpoint-74/adapter_model.safetensorsWeights262.4 MB 818696cdbcf0
l40s-results/lora-run/run/checkpoints/checkpoint-74/optimizer.ptWeights267.2 MB 9de9676968bf
l40s-results/lora-run/run/checkpoints/checkpoint-74/rng_state.pthWeights14.6 KB 0b01e80486d3
l40s-results/lora-run/run/checkpoints/checkpoint-74/scheduler.ptWeights1.5 KB 40061b887beb
l40s-results/lora-run/run/checkpoints/checkpoint-74/training_args.binWeights5.7 KB 465f54afb9e7
l40s-results/lora-run/run/lora.ggufWeights262.3 MB 44a1a3e14b95
l40s-results/lora-smoke/run/adapter/adapter_model.safetensorsWeights524.6 MB 9e4e4a2a59d6
l40s-results/lora-smoke/run/adapter/training_args.binWeights5.7 KB 54bc2eae4959
l40s-results/lora-smoke/run/checkpoints/checkpoint-5/adapter_model.safetensorsWeights262.4 MB 9920b2f6b729
l40s-results/lora-smoke/run/checkpoints/checkpoint-5/optimizer.ptWeights267.2 MB d1e3903f6447
l40s-results/lora-smoke/run/checkpoints/checkpoint-5/rng_state.pthWeights14.6 KB 9d04010c8aa1
l40s-results/lora-smoke/run/checkpoints/checkpoint-5/scheduler.ptWeights1.5 KB 317cbe6c0fb5
l40s-results/lora-smoke/run/checkpoints/checkpoint-5/training_args.binWeights5.7 KB 54bc2eae4959
l40s-results/lora-smoke/run/checkpoints/checkpoint-6/adapter_model.safetensorsWeights262.4 MB d9fd0a7f5055
l40s-results/lora-smoke/run/checkpoints/checkpoint-6/optimizer.ptWeights267.2 MB f3a25a05ac68
l40s-results/lora-smoke/run/checkpoints/checkpoint-6/rng_state.pthWeights14.6 KB c7eea5ce7556
l40s-results/lora-smoke/run/checkpoints/checkpoint-6/scheduler.ptWeights1.5 KB 2c6d28fdd465
l40s-results/lora-smoke/run/checkpoints/checkpoint-6/training_args.binWeights5.7 KB 54bc2eae4959
l40s-results/lora-smoke/run/lora.ggufWeights262.3 MB 78c79b86d300
l40s-results/lora-v2/A/adapter/adapter_model.safetensorsWeights524.6 MB 5fd29d765827
l40s-results/lora-v2/A/adapter/training_args.binWeights5.7 KB 9264cfd3992c
l40s-results/lora-v2/A/checkpoints/checkpoint-40/adapter_model.safetensorsWeights262.4 MB 154066ae8b2c
l40s-results/lora-v2/A/checkpoints/checkpoint-40/optimizer.ptWeights267.2 MB 02ed762334a6
l40s-results/lora-v2/A/checkpoints/checkpoint-40/rng_state.pthWeights14.6 KB 627eb3719918
l40s-results/lora-v2/A/checkpoints/checkpoint-40/scheduler.ptWeights1.5 KB d63dbd506df2
l40s-results/lora-v2/A/checkpoints/checkpoint-40/training_args.binWeights5.7 KB 9264cfd3992c
l40s-results/lora-v2/A/checkpoints/checkpoint-72/adapter_model.safetensorsWeights262.4 MB 936106337175
l40s-results/lora-v2/A/checkpoints/checkpoint-72/optimizer.ptWeights267.2 MB 4d463f797267
l40s-results/lora-v2/A/checkpoints/checkpoint-72/rng_state.pthWeights14.6 KB cbcceb2154b7
l40s-results/lora-v2/A/checkpoints/checkpoint-72/scheduler.ptWeights1.5 KB 0bea121c2765
l40s-results/lora-v2/A/checkpoints/checkpoint-72/training_args.binWeights5.7 KB 9264cfd3992c
l40s-results/lora-v2/A/lora.ggufWeights262.3 MB bb3091538876
l40s-results/lora-v2/B/adapter/adapter_model.safetensorsWeights524.6 MB cc7c0acfadb4
l40s-results/lora-v2/B/adapter/training_args.binWeights5.7 KB b04006754ef7
l40s-results/lora-v2/B/checkpoints/checkpoint-70/adapter_model.safetensorsWeights524.6 MB cc7c0acfadb4
l40s-results/lora-v2/B/checkpoints/checkpoint-70/optimizer.ptWeights267.2 MB e2c2324e2ec0
l40s-results/lora-v2/B/checkpoints/checkpoint-70/rng_state.pthWeights14.6 KB 5decd70c0ed6
l40s-results/lora-v2/B/checkpoints/checkpoint-70/scheduler.ptWeights1.5 KB b9bdb93da99d
l40s-results/lora-v2/B/checkpoints/checkpoint-70/training_args.binWeights5.7 KB b04006754ef7
l40s-results/lora-v2/B/checkpoints/checkpoint-72/adapter_model.safetensorsWeights524.6 MB 0c909ef71dbd
l40s-results/lora-v2/B/checkpoints/checkpoint-72/optimizer.ptWeights267.2 MB 53a01da5e335
l40s-results/lora-v2/B/checkpoints/checkpoint-72/rng_state.pthWeights14.6 KB 06c4dccb3cbc
l40s-results/lora-v2/B/checkpoints/checkpoint-72/scheduler.ptWeights1.5 KB 0bea121c2765
l40s-results/lora-v2/B/checkpoints/checkpoint-72/training_args.binWeights5.7 KB b04006754ef7
l40s-results/lora-v2/B/lora.ggufWeights262.3 MB b03d56e67f8e
l40s-results/lora-v3/rft/run/adapter/adapter_model.safetensorsWeights524.6 MB 0f57579f6936
l40s-results/lora-v3/rft/run/adapter/training_args.binWeights5.7 KB 65ce46348f81
l40s-results/lora-v3/rft/run/checkpoints/checkpoint-10/adapter_model.safetensorsWeights262.4 MB bec6cf824323
l40s-results/lora-v3/rft/run/checkpoints/checkpoint-10/optimizer.ptWeights267.2 MB 54a909d9b197
l40s-results/lora-v3/rft/run/checkpoints/checkpoint-10/rng_state.pthWeights14.6 KB fa505e1f3cde
l40s-results/lora-v3/rft/run/checkpoints/checkpoint-10/scheduler.ptWeights1.5 KB 6bdce871b5fb
l40s-results/lora-v3/rft/run/checkpoints/checkpoint-10/training_args.binWeights5.7 KB 65ce46348f81
l40s-results/lora-v3/rft/run/checkpoints/checkpoint-51/adapter_model.safetensorsWeights262.4 MB 98c0d28e4169
l40s-results/lora-v3/rft/run/checkpoints/checkpoint-51/optimizer.ptWeights267.2 MB d9ebf14c50e2
l40s-results/lora-v3/rft/run/checkpoints/checkpoint-51/rng_state.pthWeights14.6 KB 2d8d297282fc
l40s-results/lora-v3/rft/run/checkpoints/checkpoint-51/scheduler.ptWeights1.5 KB f6c7d68b97a1
l40s-results/lora-v3/rft/run/checkpoints/checkpoint-51/training_args.binWeights5.7 KB 65ce46348f81
l40s-results/lora-v3/rft/run/lora.ggufWeights262.3 MB 4d4b02415f74
l40s-results/lora-v3/rft/run/lora_step51.ggufWeights262.3 MB e7da0c541f79
l40s-results/lora-v3/rft_think/run/adapter/adapter_model.safetensorsWeights524.6 MB 12ba3a5df7db
l40s-results/lora-v3/rft_think/run/adapter/training_args.binWeights5.7 KB b41736726f14
l40s-results/lora-v3/rft_think/run/checkpoints/checkpoint-20/adapter_model.safetensorsWeights262.4 MB 9c75d4b11892
l40s-results/lora-v3/rft_think/run/checkpoints/checkpoint-20/optimizer.ptWeights267.2 MB 1aa17db23674
l40s-results/lora-v3/rft_think/run/checkpoints/checkpoint-20/rng_state.pthWeights14.6 KB 629dfcde3945
l40s-results/lora-v3/rft_think/run/checkpoints/checkpoint-20/scheduler.ptWeights1.5 KB b4b24505ef38
l40s-results/lora-v3/rft_think/run/checkpoints/checkpoint-20/training_args.binWeights5.7 KB b41736726f14
l40s-results/lora-v3/rft_think/run/checkpoints/checkpoint-63/adapter_model.safetensorsWeights262.4 MB 65789d029cee
l40s-results/lora-v3/rft_think/run/checkpoints/checkpoint-63/optimizer.ptWeights267.2 MB 42efe5edd661
l40s-results/lora-v3/rft_think/run/checkpoints/checkpoint-63/rng_state.pthWeights14.6 KB fd1357e0fc8f
l40s-results/lora-v3/rft_think/run/checkpoints/checkpoint-63/scheduler.ptWeights1.5 KB 4b92af6326e9
l40s-results/lora-v3/rft_think/run/checkpoints/checkpoint-63/training_args.binWeights5.7 KB b41736726f14
l40s-results/lora-v3/rft_think/run/lora.ggufWeights262.3 MB 19668ccad01e
l40s-results/lora-v3/rft_think/run/lora_step63.ggufWeights262.3 MB 975f9ae052af
l40s-results/lora-v4/tournament/finalists/r4/adapter/adapter_model.safetensorsWeights65.7 MB b2c8927a3bda
l40s-results/lora-v4/tournament/finalists/r4/adapter/training_args.binWeights5.8 KB 210979b7e608
l40s-results/lora-v4/tournament/finalists/r4/checkpoints/checkpoint-50/adapter_model.safetensorsWeights65.7 MB d450b400fe5d
l40s-results/lora-v4/tournament/finalists/r4/checkpoints/checkpoint-50/optimizer.ptWeights35.8 MB 34472586a199
l40s-results/lora-v4/tournament/finalists/r4/checkpoints/checkpoint-50/rng_state.pthWeights14.6 KB 06bcc98606f1
l40s-results/lora-v4/tournament/finalists/r4/checkpoints/checkpoint-50/scheduler.ptWeights1.5 KB ea1e9d6ac2db
l40s-results/lora-v4/tournament/finalists/r4/checkpoints/checkpoint-50/training_args.binWeights5.8 KB 210979b7e608
l40s-results/lora-v4/tournament/finalists/r4/lora.ggufWeights32.8 MB 6a039e2623b3
l40s-results/lora-v4/tournament/finalists/r8/adapter/adapter_model.safetensorsWeights131.2 MB 418d6067572c
l40s-results/lora-v4/tournament/finalists/r8/adapter/training_args.binWeights5.8 KB f79446f7742f
l40s-results/lora-v4/tournament/finalists/r8/checkpoints/checkpoint-25/adapter_model.safetensorsWeights131.2 MB aef84cf928a4
l40s-results/lora-v4/tournament/finalists/r8/checkpoints/checkpoint-25/optimizer.ptWeights69.1 MB 83b38ca7c522
l40s-results/lora-v4/tournament/finalists/r8/checkpoints/checkpoint-25/rng_state.pthWeights14.6 KB 06bcc98606f1
l40s-results/lora-v4/tournament/finalists/r8/checkpoints/checkpoint-25/scheduler.ptWeights1.5 KB 90d67e7a5765
l40s-results/lora-v4/tournament/finalists/r8/checkpoints/checkpoint-25/training_args.binWeights5.8 KB f79446f7742f
l40s-results/lora-v4/tournament/finalists/r8/lora.ggufWeights65.6 MB 9cc64387562f
l40s-results/lora-v4/tournament/trials/lr0.0001_r4_a2_ga8_do0.05_nt0_cosine_wu0.03/adapter/adapter_model.safetensorsWeights65.7 MB b2c8927a3bda
l40s-results/lora-v4/tournament/trials/lr0.0001_r4_a2_ga8_do0.05_nt0_cosine_wu0.03/adapter/training_args.binWeights5.8 KB 210979b7e608
l40s-results/lora-v4/tournament/trials/lr0.0001_r4_a2_ga8_do0.05_nt0_cosine_wu0.03/lora.ggufWeights32.8 MB 6a039e2623b3
l40s-results/lora-v4/tournament/trials/lr0.0001_r8_a2_ga16_do0.05_nt0_cosine_wu0.03/adapter/adapter_model.safetensorsWeights131.2 MB 418d6067572c
l40s-results/lora-v4/tournament/trials/lr0.0001_r8_a2_ga16_do0.05_nt0_cosine_wu0.03/adapter/training_args.binWeights5.8 KB f79446f7742f
l40s-results/lora-v4/tournament/trials/lr0.0001_r8_a2_ga16_do0.05_nt0_cosine_wu0.03/lora.ggufWeights65.6 MB 9cc64387562f
README.mdDocumentation1.6 KB —
.gitattributesRepository2.6 KB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
13.8 GB
Download from WMTH-100d2exam

Released by WMTH-100d2exam through its official repository on Hugging Face. Read the license.

Built From

  • Adapter of google/gemma-4-12B-it-qat-q4_0-unquantized
  • Derived from google/gemma-4-12B-it-qat-q4_0-unquantized

Memory Requirements

PrecisionWeights in memory
As published13.8 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About old-wb-l40s-lora-weights

Can I use old-wb-l40s-lora-weights commercially?

Yes. old-wb-l40s-lora-weights is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers