pythia-6.9b

Model · Text generation

granite-4.0-h-tiny-w8a8-llmcompressor

AMD

ZenDNN v6.1.0 - ZenTorch v2.13.0.0 - PyTorch v2.13.0.0 - LLM Compressor v0.13.0 - vLLM v0.29.0 This is a quantized version of granite-4.0-h-tiny created by AMD using LLM Compressor (compressed-tensors) for ZenDNN-optimized CPU inference. The model was quantized from granite-4.0-h-tiny using LLM Compressor via the Round-to-Nearest (RTN) algorithm. This reduces the model weights from 12.9 GiB to 6.6 GiB on disk (~49% reduction). granite-4.0-h-tiny is a hybrid Mamba-MoE model: of its 40 layers, 4 are full-attention blocks and the other 36 are Mamba (linear-attention) blocks, and every layer carries a 64-expert MoE block alongside a shared MLP. The recipe only needs two ignore entries. lmhead…

Model · Text generation

deepseek-coder-7b-instruct-v1.5

DeepSeek

Deepseek-Coder-7B-Instruct-v1.5 is continue pre-trained from Deepseek-LLM 7B on 2T tokens by employing a window size of 4K and next token prediction objective, and then fine-tuned on 2B tokens of instruction data. Here give some examples of how to use our model. This code repository is licensed under the MIT License. The use of DeepSeek Coder models is subject to the Model License. DeepSeek Coder supports commercial use. See the LICENSE-MODEL for more details. If you have any questions, please raise an issue or contact us at [email protected].

Model · Text generation

Mistral-7B-Instruct-v0.2

Mistral AI_

The Mistral-7B-Instruct-v0.2 Large Language Model (LLM) is an instruct fine-tuned version of the Mistral-7B-v0.2. Mistral-7B-v0.2 has the following changes compared to Mistral-7B-v0.1 - 32k context window (vs 8k context in v0.1) - Rope-theta = 1e6 For full details of this model please read our paper and release blog post. In order to leverage instruction fine-tuning, your prompt should be surrounded by [INST] and [/INST] tokens. The very first instruction should begin with a begin of sentence id. The next instructions should not. The assistant generation will be ended by the end-of-sentence token id. This format is available as a chat template via the applychattemplate() method: - If you…

A Mistral-7B-Instruct-v0.2 checkpoint compressed with SVD-LLM to 70.0% of dense parameters, then edited by 10 of 10 rounds of iterative parameter-neutral swap selected by the gapiter rule (up to 0.1% of dense parameters per round; the full run's budget is 1.0%). This is a research artifact from a study of how SVD compression damages safety behaviour and which component-selection rule best repairs it. It is one cell of a grid over selection rules and budgets; it is not a general-purpose chat model. This checkpoint exists to measure safety/utility trade-offs under compression. Several arms in the grid are deliberately safety-degraded relative to Mistral-7B-Instruct-v0.2: compression alone…

This is the model card of a transformers model that has been pushed on the Hub. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model. Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

Model · Text generation

Llama-2-7b-hf

Meta Llama

Llama 2 is a collection of pretrained and fine-tuned generative text models ranging in scale from 7 billion to 70 billion parameters. This is the repository for the 7B pretrained model, converted for the Hugging Face Transformers format. Links to other models can be found in the index at the bottom. Note: Use of this model is governed by the Meta license. In order to download the model weights and tokenizer, please visit the website and accept our License before requesting access here. Meta developed and publicly released the Llama 2 family of large language models (LLMs), a collection of pretrained and fine-tuned generative text models ranging in scale from 7 billion to 70 billion…