ACE-3-F-26B-A4B-260804

Model · Image and text to text

gemma-4-26B-A4B-it

Google

Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages. Featuring both Dense and Mixture-of-Experts (MoE) architectures, Gemma 4 is well-suited for tasks like text generation, coding, and reasoning. The models are available in five distinct sizes: E2B, E4B, 12B, 26B A4B, and 31B. Their diverse sizes make them deployable in environments ranging from…

Model · Image and text to text

gemma-4-26B-A4B-it-AWQ-4bit

Cyankiwi

Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on small models) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages. Featuring both Dense and Mixture-of-Experts (MoE) architectures, Gemma 4 is well-suited for tasks like text generation, coding, and reasoning. The models are available in four distinct sizes: E2B, E4B, 26B A4B, and 31B. Their diverse sizes make them deployable in environments ranging from high-end phones…

Model · Image and text to text

Aura-Prototype-26B-A4B

EldritchLabs

This is a merge of pre-trained language models created using mergekit. This model was merged using the aura merge method. Aura is an experimental method with a live heatmap visualizer. This model took 10 hours to merge using graphv18.py The following models were included in the merge: - TheDrummer/Orion-26B-A4B-v1.1 - Gryphe/Pantheon-Reasoning-26B-A4B-1.1-V2 - electroglyph/gemma4-26b-fiction-bf16 The following YAML configuration was used to produce this model

Model · Image and text to text

gemma-4-26B-A4B-it-FP8-dynamic

Red Hat AI

FP8-dynamic variant of gemma-4-26B-A4B-it.

Model · Image and text to text

Qwen3.8-27B-mlx-6Bit

Vy Thông Nguyễn

The Model nvythong/Qwen3.8-27B-mlx-6Bit was converted to MLX format from Qwen/Qwen3.8-27B using mlx-lm version 0.31.2.

Model · Image and text to text

Qwen3.6-35B-A3B-NVFP4

Unsloth AI

1.56x faster throughput than other NVFP4 quants. This is an Unsloth NVFP4 quantized checkpoint calibrated on a mixture of our Unsloth dataset + UltraChat dataset. Works on a 32GB VRAM GPU. Benchmarks on 1xB200 128 concurrency. Use the 35B NVFP4 Fast version for 1.79x faster at a little less accuracy For accuracy benchmarks, we conducted MMLU-Pro, AIME 2025, GPQA for FP8, BF16, NVIDIA's NVFP4 and our NVFP4s - we show our faster quants do similarly on all: Read all benchmarks in our NVFP4 blog To install vLLM in a separate venv: Then to serve the 35B variant: You must use the below or you will get 2x slower inference! Also do NOT use the Marlin backend since it's 2x slower - use the native…