This model card provides the Gemma 4 E2B model in a way that is ready for deployment on Android, iOS, Desktop, IoT and Web. Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models. This particular Gemma 4 model is small so it is ideal for on-device use cases. By running this model on device, users can have private access to Generative AI technology without even requiring an internet connection. These models are provided in the.litertlm format for use with the LiteRT-LM framework. LiteRT-LM is a specialized orchestration layer built directly on top of LiteRT, Google’s high-performance…
Organization
LiteRT Community (FKA TFLite)
litert-community
AI for Mobile, Web, and Embedded
Models
This model provides a few variants of the embedding model published in the Gecko paper that are ready for deployment on Android or iOS using LiteRT stack or google ai edge RAG SDK. Try out the gecko embedding model in the google ai edge RAG SDK. You can find the SDK on GitHub or follow our android guide to install directly from Maven. We have also published a Use the sentencepiece model as the tokenizer for the Gecko embedding model. Note that all benchmark stats are from a Samsung S23 Ultra. The inference is run on CPU is accelerated via the LiteRT XNNPACK delegate with 4 threads The inference on GPU is accelerated via LiteRT GPU delegate. Benchmark is done assuming XNNPACK cache is…