LuminoLex-1.7B is Bangladesh’s first decoder-only language model pretrained from scratch. Built on a sparse Mixture-of-Experts (MoE) architecture, it contains 1.7 billion total parameters while activating only ~410 million parameters per token. By combining an always-on shared expert with Grouped-Query Attention (GQA), LuminoLex-1.7B delivers fast, memory-efficient inference without sacrificing model capacity. This model is released under the Apache License 2.0.