SAVRN
Search Contact SAVRN

Organization

Syntropic

syntropic-clx

Building Clyx and Clyx Code — small language models for developer tooling.

Models in Library1
Datasets in Library0
Models on Hugging Face2
Followers1

Models

Model · Text generation

Clyx_0.3-NM-BASE

Syntropic

A new step in the Clyx project: a compact language model planned for training from scratch on Russian, English, and code. Clyx is an independent language-model project built around a custom decoder-only Transformer. The next planned BASE model targets approximately 635.51 million parameters, using Grouped-Query Attention, RoPE, RMSNorm, and SwiGLU. The intended training approach is random initialization and next-token prediction, without importing external pretrained weights. The goal is a Russian–English base model with exposure to programming languages, while keeping the architecture and training process documented. This is a BASE model project, not an instruction-tuned assistant. Any…

Open weights apache-2.0