Model · Text generation
Qwen
Qwen1.5-MoE is a transformer-based MoE decoder-only language model pretrained on a large amount of data. For more details, please refer to our blog post and GitHub repo. Qwen1.5-MoE employs Mixture of Experts (MoE) architecture, where the models are upcycled from dense language models. For instance, Qwen1.5-MoE-A2.7B is upcycled from Qwen-1.8B. It has 14.3B parameters in total and 2.7B activated parameters during runtime, while achieving comparable performance to Qwen1.5-7B, it only requires 25% of the training resources. We also observed that the inference speed is 1.74 times that of Qwen1.5-7B. The code of Qwen1.5-MoE has been in the latest Hugging face transformers and we advise you to…
Open weights
other
14.3B parameters
8,192 tokens
transformers
Model · Text generation
NVIDIA
Gemma 4 26B IT is an open multimodal model built by Google DeepMind that handles text and image inputs, can process video as sequences of frames, and generates text output. It is designed to deliver frontier-level performance for reasoning, agentic workflows, coding, and multimodal understanding on consumer GPUs and workstations, with a 256K-token context window and support for over 140 languages. The model uses a hybrid attention mechanism that interleaves local sliding-window and full global attention, with unified Keys and Values in global layers and Proportional RoPE (p-RoPE) to support long-context performance. The NVIDIA Gemma 4 26B IT NVFP4 model is quantized with NVIDIA Model…
Open weights
apache-2.0
14.4B parameters
262,144 tokens
Model Optimizer
Model · Text generation
Qwen
Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models. Built upon extensive training, Qwen3 delivers groundbreaking advancements in reasoning, instruction-following, agent capabilities, and multilingual support, with the following key features: - Uniquely support of seamless switching between thinking mode (for complex logical reasoning, math, and coding) and non-thinking mode (for efficient, general-purpose dialogue) within single model, ensuring optimal performance across various scenarios. - Significantly enhancement in its reasoning capabilities, surpassing previous QwQ (in thinking mode) and…
Open weights
apache-2.0
14.8B parameters
40,960 tokens
transformers
Model · Text generation
Qwen
Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models. Built upon extensive training, Qwen3 delivers groundbreaking advancements in reasoning, instruction-following, agent capabilities, and multilingual support, with the following key features: - Uniquely support of seamless switching between thinking mode (for complex logical reasoning, math, and coding) and non-thinking mode (for efficient, general-purpose dialogue) within single model, ensuring optimal performance across various scenarios. - Significantly enhancement in its reasoning capabilities, surpassing previous QwQ (in thinking mode) and…
Open weights
apache-2.0
14.8B parameters
40,960 tokens
transformers
Purpose: Full-scale cognitive reasoning model with self-organizing memory and generative symbolic evolution SymbioticLM-14B is a 17.8-billion-parameter symbolic–transformer hybrid that couples high-capacity neural representation with structured symbolic cognition. It supports persistent memory, entropic recall, multi-stage symbolic routing, and self-organizing knowledge structures. This is an experimental research checkpoint — the capability claims below describe architectural intent, not benchmarked results (see Limitations). This model is ideal for advanced reasoning agents, research assistants, and symbolic math/code generation systems. - Long-form symbolic theorem generation and proof…
Open weights
afl-3.0
14.8B parameters
40,960 tokens
transformers
Model · Text generation
Qwen
Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models in these domains. - Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g, tables), and generating structured outputs especially JSON. More resilient to the diversity of system prompts, enhancing role-play implementation and…
Open weights
apache-2.0
14.8B parameters
32,768 tokens
transformers
