mistral-7b-qlora-alpaca-sample-0.5k

Model · Text generation

Mistral-7B-Instruct-v0.2

Mistral AI_

The Mistral-7B-Instruct-v0.2 Large Language Model (LLM) is an instruct fine-tuned version of the Mistral-7B-v0.2. Mistral-7B-v0.2 has the following changes compared to Mistral-7B-v0.1 - 32k context window (vs 8k context in v0.1) - Rope-theta = 1e6 For full details of this model please read our paper and release blog post. In order to leverage instruction fine-tuning, your prompt should be surrounded by [INST] and [/INST] tokens. The very first instruction should begin with a begin of sentence id. The next instructions should not. The assistant generation will be ended by the end-of-sentence token id. This format is available as a chat template via the applychattemplate() method: - If you…

A Mistral-7B-Instruct-v0.2 checkpoint compressed with SVD-LLM to 70.0% of dense parameters, then edited by 10 of 10 rounds of iterative parameter-neutral swap selected by the gapiter rule (up to 0.1% of dense parameters per round; the full run's budget is 1.0%). This is a research artifact from a study of how SVD compression damages safety behaviour and which component-selection rule best repairs it. It is one cell of a grid over selection rules and budgets; it is not a general-purpose chat model. This checkpoint exists to measure safety/utility trade-offs under compression. Several arms in the grid are deliberately safety-degraded relative to Mistral-7B-Instruct-v0.2: compression alone…

Model · Text generation

Vinci-Prova-7B-1.0

SimpleDirect

An experimental post-training transfer study. We applied the Vinci SFT + DPO character recipe to mistralai/Mistral-7B-Instruct-v0.3 to answer one question: does character training developed on a different model lineage transfer to this one? Apache-2.0, 7.25B, drop-in with transformers. This uses a retired base, and we are saying so first. Mistral lists Mistral 7B Instruct v0.3 as retired as of 30 March 2025 (deprecated 30 November 2024), with Ministral 3 8B as the recommended replacement. "Retired" is Mistral's own lifecycle term. The open weights remain downloadable on Hugging Face under Apache-2.0. We selected this base for continuity with our earlier experiments, not because it is…

Standalone merged BF16 model from epoch 3.970178926441352, step 1500. Dataset: CompassioninMachineLearning/urban12738cleaned at ef7c0e742df63ea319e35d02d9f6ba63d6e7c68d. Training: 10,072 distinct documents plus 2,000 repeat exposures per epoch; 200 disjoint validation documents. Merged with Unsloth's native savepretrainedmerged(savemethod="merged16bit"). Weights are validated BF16 and packaged losslessly into eight safetensors shards. No adapter is required to load this model. See runmanifest.json for base revision, document selection hashes, training parameters and export validation. Training does not establish an improvement in compassion; evaluate that separately.

Model · Text generation

pythia-6.9b

EleutherAI

The Pythia Scaling Suite is a collection of models developed to facilitate interpretability research (see paper). It contains two sets of eight models of sizes 70M, 160M, 410M, 1B, 1.4B, 2.8B, 6.9B, and 12B. For each size, there are two models: one trained on the Pile, and one trained on the Pile after the dataset has been globally deduplicated. All 8 model sizes are trained on the exact same data, in the exact same order. We also provide 154 intermediate checkpoints per model, hosted on Hugging Face as branches. The Pythia model suite was deliberately designed to promote scientific research on large language models, especially interpretability research. Despite not centering downstream…