Best Small Language Models in India
View:
Compare the Top Small Language Models in India as of September 2026
Sort By:
What are Small Language Models in India?
Small Language Models (SLMs) are compact AI models designed to perform natural language understanding and generation tasks while requiring significantly fewer computational resources than large language models (LLMs). These models are optimized for low latency, lower memory usage, on-device inference, and cost-efficient deployment, making them well suited for edge devices, mobile applications, embedded systems, and enterprise workloads with strict performance or privacy requirements. SLMs can power applications such as chatbots, document summarization, code generation, classification, translation, question answering, and AI agents while delivering fast inference and reduced infrastructure costs. Many small language models are available as open-source or commercial offerings and integrate with AI frameworks, inference engines, cloud platforms, and developer tools for flexible deployment. By balancing performance, efficiency, and scalability, small language models help organizations build responsive, cost-effective AI applications across a wide range of environments. Compare and read user reviews of the best Small Language Models in India currently available using the table below. This list is updated regularly.
-
1
Mistral AI
Mistral AI
Mistral AI is a pioneering artificial intelligence startup specializing in open-source generative AI. The company offers a range of customizable, enterprise-grade AI solutions deployable across various platforms, including on-premises, cloud, edge, and devices. Flagship products include "Le Chat," a multilingual AI assistant designed to enhance productivity in both personal and professional contexts, and "La Plateforme," a developer platform that enables the creation and deployment of AI-powered applications. Committed to transparency and innovation, Mistral AI positions itself as a leading independent AI lab, contributing significantly to open-source AI and policy development.Starting Price: Free -
2
Inkling-Small
Thinking Machines Lab
Inkling-Small is an efficient model that offers performance comparable to Inkling at a quarter of its size. It is a Mixture-of-Experts transformer with 276 billion total parameters and 12 billion active parameters, trained on NVIDIA GB300 NVL72 systems. It supports native reasoning across text, images, and audio, variable thinking effort, and context windows of up to one million tokens. Users adjust reasoning effort from minimal to extra high to balance performance and compute. Improved pre-training data, post-training with on-policy distillation from Inkling, and extended agentic coding reinforcement learning helped Inkling-Small surpass its larger counterpart on reasoning and coding benchmarks. It performs well in coding and tool-use harnesses, exceeds 80% on SWE-bench Verified, and combines strong reasoning with efficient output. Its encoder-free multimodal architecture processes audio as dMel spectrograms and images as 40-by-40-pixel patches alongside text tokens.Starting Price: $0.30 per million input tokens -
3
Muse Glimmer
Meta
Muse Glimmer is a 30-billion-parameter open-weights model from Meta Superintelligence Labs, optimized for always-on local agent workflows. Small enough to run on a Mac or PC with a single consumer GPU, it is designed for local agents, function calling, coding, and LLM-as-a-judge evaluation without depending on cloud infrastructure or network access. The model combines long-horizon execution, precise tool calling, multimodal understanding, long-context memory, and instruction following. It can complete end-to-end agentic tasks, sustain multi-step reasoning across extended workflows, recover from failed or unexpected tool calls, and accept interleaved text and images through a dedicated perception encoder for interpreting screenshots, charts, and documents. Muse Glimmer works with OpenClaw and other agentic orchestration patterns, supports controllable reasoning effort, and is trained on data from more than 100 languages.Starting Price: Free -
4
OpenAI o1-mini
OpenAI
OpenAI o1-mini is a new, cost-effective AI model designed for enhanced reasoning, particularly excelling in STEM fields like mathematics and coding. It's part of the o1 series, which focuses on solving complex problems by spending more time "thinking" through solutions. Despite being smaller and 80% cheaper than its sibling, the o1-preview, o1-mini performs competitively in coding tasks and mathematical reasoning, making it an accessible option for developers and enterprises looking for efficient AI solutions. -
5
Gemini 2.0 Flash
Google
The Gemini 2.0 Flash AI model represents the next generation of high-speed, intelligent computing, designed to set new benchmarks in real-time language processing and decision-making. Building on the robust foundation of its predecessor, it incorporates enhanced neural architecture and breakthrough advancements in optimization, enabling even faster and more accurate responses. Gemini 2.0 Flash is designed for applications requiring instantaneous processing and adaptability, such as live virtual assistants, automated trading systems, and real-time analytics. Its lightweight, efficient design ensures seamless deployment across cloud, edge, and hybrid environments, while its improved contextual understanding and multitasking capabilities make it a versatile tool for tackling complex, dynamic workflows with precision and speed. -
6
Gemini Nano
Google
Gemini Nano from Google is a lightweight, energy-efficient AI model designed for high performance in compact, resource-constrained environments. Tailored for edge computing and mobile applications, Gemini Nano combines Google's advanced AI architecture with cutting-edge optimization techniques to deliver seamless performance without compromising speed or accuracy. Despite its compact size, it excels in tasks like voice recognition, natural language processing, real-time translation, and personalized recommendations. With a focus on privacy and efficiency, Gemini Nano processes data locally, minimizing reliance on cloud infrastructure while maintaining robust security. Its adaptability and low power consumption make it an ideal choice for smart devices, IoT ecosystems, and on-the-go AI solutions. -
7
Gemini 1.5 Flash
Google
The Gemini 1.5 Flash AI model is an advanced, high-speed language model engineered for lightning-fast processing and real-time responsiveness. Designed to excel in dynamic and time-sensitive applications, it combines streamlined neural architecture with cutting-edge optimization techniques to deliver exceptional performance without compromising on accuracy. Gemini 1.5 Flash is tailored for scenarios requiring rapid data processing, instant decision-making, and seamless multitasking, making it ideal for chatbots, customer support systems, and interactive applications. Its lightweight yet powerful design ensures it can be deployed efficiently across a range of platforms, from cloud-based environments to edge devices, enabling businesses to scale their operations with unmatched agility. -
8
Mistral 7B
Mistral AI
Mistral 7B is a 7.3-billion-parameter language model that outperforms larger models like Llama 2 13B across various benchmarks. It employs Grouped-Query Attention (GQA) for faster inference and Sliding Window Attention (SWA) to efficiently handle longer sequences. Released under the Apache 2.0 license, Mistral 7B is accessible for deployment across diverse platforms, including local environments and major cloud services. Additionally, a fine-tuned version, Mistral 7B Instruct, demonstrates enhanced performance in instruction-following tasks, surpassing models like Llama 2 13B Chat.Starting Price: Free -
9
Mistral NeMo
Mistral AI
Mistral NeMo, our new best small model. A state-of-the-art 12B model with 128k context length, and released under the Apache 2.0 license. Mistral NeMo is a 12B model built in collaboration with NVIDIA. Mistral NeMo offers a large context window of up to 128k tokens. Its reasoning, world knowledge, and coding accuracy are state-of-the-art in its size category. As it relies on standard architecture, Mistral NeMo is easy to use and a drop-in replacement in any system using Mistral 7B. We have released pre-trained base and instruction-tuned checkpoints under the Apache 2.0 license to promote adoption for researchers and enterprises. Mistral NeMo was trained with quantization awareness, enabling FP8 inference without any performance loss. The model is designed for global, multilingual applications. It is trained on function calling and has a large context window. Compared to Mistral 7B, it is much better at following precise instructions, reasoning, and handling multi-turn conversations.Starting Price: Free -
10
Ministral 3B
Mistral AI
Mistral AI introduced two state-of-the-art models for on-device computing and edge use cases, named "les Ministraux": Ministral 3B and Ministral 8B. These models set a new frontier in knowledge, commonsense reasoning, function-calling, and efficiency in the sub-10B category. They can be used or tuned for various applications, from orchestrating agentic workflows to creating specialist task workers. Both models support up to 128k context length (currently 32k on vLLM), and Ministral 8B features a special interleaved sliding-window attention pattern for faster and memory-efficient inference. These models were built to provide a compute-efficient and low-latency solution for scenarios such as on-device translation, internet-less smart assistants, local analytics, and autonomous robotics. Used in conjunction with larger language models like Mistral Large, les Ministraux also serve as efficient intermediaries for function-calling in multi-step agentic workflows.Starting Price: Free -
11
Ministral 8B
Mistral AI
Mistral AI has introduced two advanced models for on-device computing and edge applications, named "les Ministraux": Ministral 3B and Ministral 8B. These models excel in knowledge, commonsense reasoning, function-calling, and efficiency within the sub-10B parameter range. They support up to 128k context length and are designed for various applications, including on-device translation, offline smart assistants, local analytics, and autonomous robotics. Ministral 8B features an interleaved sliding-window attention pattern for faster and more memory-efficient inference. Both models can function as intermediaries in multi-step agentic workflows, handling tasks like input parsing, task routing, and API calls based on user intent with low latency and cost. Benchmark evaluations indicate that les Ministraux consistently outperforms comparable models across multiple tasks. As of October 16, 2024, both models are available, with Ministral 8B priced at $0.1 per million tokens.Starting Price: Free -
12
Mistral Small
Mistral AI
On September 17, 2024, Mistral AI announced several key updates to enhance the accessibility and performance of their AI offerings. They introduced a free tier on "La Plateforme," their serverless platform for tuning and deploying Mistral models as API endpoints, enabling developers to experiment and prototype at no cost. Additionally, Mistral AI reduced prices across their entire model lineup, with significant cuts such as a 50% reduction for Mistral Nemo and an 80% decrease for Mistral Small and Codestral, making advanced AI more cost-effective for users. The company also unveiled Mistral Small v24.09, a 22-billion-parameter model offering a balance between performance and efficiency, suitable for tasks like translation, summarization, and sentiment analysis. Furthermore, they made Pixtral 12B, a vision-capable model with image understanding capabilities, freely available on "Le Chat," allowing users to analyze and caption images without compromising text-based performance.Starting Price: Free -
13
Mistral Small 3.1
Mistral
Mistral Small 3.1 is a state-of-the-art, multimodal, and multilingual AI model released under the Apache 2.0 license. Building upon Mistral Small 3, this enhanced version offers improved text performance, and advanced multimodal understanding, and supports an expanded context window of up to 128,000 tokens. It outperforms comparable models like Gemma 3 and GPT-4o Mini, delivering inference speeds of 150 tokens per second. Designed for versatility, Mistral Small 3.1 excels in tasks such as instruction following, conversational assistance, image understanding, and function calling, making it suitable for both enterprise and consumer-grade AI applications. Its lightweight architecture allows it to run efficiently on a single RTX 4090 or a Mac with 32GB RAM, facilitating on-device deployments. It is available for download on Hugging Face, accessible via Mistral AI's developer playground, and integrated into platforms likeGemini Enterprise Agent Platform, with availability on NVIDIA NIM.Starting Price: Free -
14
GPT-5 mini
OpenAI
GPT-5 mini is a streamlined, faster, and more affordable variant of OpenAI’s GPT-5, optimized for well-defined tasks and precise prompts. It supports text and image inputs and delivers high-quality text outputs with a 400,000-token context window and up to 128,000 output tokens. This model excels at rapid response times, making it suitable for applications requiring fast, accurate language understanding without the full overhead of GPT-5. Pricing is cost-effective, with input tokens at $0.25 per million and output tokens at $2 per million, providing savings over the flagship model. GPT-5 mini supports advanced features like streaming, function calling, structured outputs, and fine-tuning, but does not support audio input or image generation. It integrates well with various API endpoints including chat completions, responses, and embeddings, making it versatile for many AI-powered tasks.Starting Price: $0.25 per 1M tokens -
15
GPT-5 nano
OpenAI
GPT-5 nano is OpenAI’s fastest and most affordable version of the GPT-5 family, designed for high-speed text processing tasks like summarization and classification. It supports text and image inputs, generating high-quality text outputs with a large 400,000-token context window and up to 128,000 output tokens. GPT-5 nano offers very fast response times, making it ideal for applications requiring quick turnaround without sacrificing quality. Pricing is extremely competitive, with input tokens costing $0.05 per million and output tokens $0.40 per million, making it accessible for budget-conscious projects. The model supports advanced API features such as streaming, function calling, structured outputs, and fine-tuning. While it supports image input, it does not handle audio input or web search, focusing on core text tasks efficiently.Starting Price: $0.05 per 1M tokens -
16
Claude Haiku 4.5
Anthropic
Anthropic has launched Claude Haiku 4.5, its latest small-language model designed to deliver near-frontier performance at significantly lower cost. The model provides similar coding and reasoning quality as the company’s mid-tier Sonnet 4, yet it runs at roughly one-third of the cost and more than twice the speed. In benchmarks cited by Anthropic, Haiku 4.5 meets or exceeds Sonnet 4’s performance in key tasks such as code generation and multi-step “computer use” workflows. It is optimized for real-time, low-latency scenarios such as chat assistants, customer service agents, and pair-programming support. Haiku 4.5 is made available via the Claude API under the identifier “claude-haiku-4-5” and supports large-scale deployments where cost, responsiveness, and near-frontier intelligence matter. Claude Haiku 4.5 is available now on Claude Code and our apps. Its efficiency means you can accomplish more within your usage limits while maintaining premium model performance.Starting Price: $1 per million input tokens -
17
GLM-4.5V-Flash
Z.ai
GLM-4.5V-Flash is an open source vision-language model, designed to bring strong multimodal capabilities into a lightweight, deployable package. It supports image, video, document, and GUI inputs, enabling tasks such as scene understanding, chart and document parsing, screen reading, and multi-image analysis. Compared to larger models in the series, GLM-4.5V-Flash offers a compact footprint while retaining core VLM capabilities like visual reasoning, video understanding, GUI task handling, and complex document parsing. It can serve in “GUI agent” workflows, meaning it can interpret screenshots or desktop captures, recognize icons or UI elements, and assist with automated desktop or web-based tasks. Although it forgoes some of the largest-model performance gains, GLM-4.5V-Flash remains versatile for real-world multimodal tasks where efficiency, lower resource usage, and broad modality support are prioritized.Starting Price: Free -
18
Tiny Aya
Cohere AI
Tiny Aya is a family of open-weight multilingual language models from Cohere Labs designed to deliver powerful, adaptable AI that can run efficiently on local devices, including phones and laptops, without requiring constant cloud connectivity. It focuses on enabling high-quality text understanding and generation across more than 70 languages, including many lower-resource languages that are often underserved by mainstream models. Built with lightweight architectures around 3.35 billion parameters, Tiny Aya is optimized for balanced multilingual representation and realistic compute constraints, making it suitable for edge deployment and offline use. The models support downstream adaptation and instruction tuning, allowing developers to customize behavior for specific applications while maintaining strong cross-lingual performance.Starting Price: Free -
19
Mistral Small 4
Mistral AI
Mistral Small 4 is an advanced open-source AI model developed by Mistral AI that combines reasoning, coding, and multimodal capabilities into a single system. It unifies the strengths of previous models such as Magistral for reasoning, Pixtral for multimodal processing, and Devstral for agentic coding tasks. The model can handle both text and image inputs, allowing it to perform tasks ranging from conversational chat to visual analysis and document understanding. Built with a mixture-of-experts architecture, Mistral Small 4 delivers efficient performance while scaling to complex workloads. It also features a configurable reasoning parameter that allows users to switch between fast responses and deeper analytical outputs. With a large context window and optimized inference performance, the model supports long-form interactions and complex workflows.Starting Price: Free -
20
distil labs
distil labs
distil labs optimizes AI workloads by replacing expensive frontier-model calls with custom small language models tuned to a specific task while maintaining the required quality bar. It observes real production traffic, captures traces from existing LLM requests, and automatically builds an evaluation set to understand how the workload actually behaves. It then generates and validates synthetic training data, matches the data distribution to the target workload, performs supervised fine-tuning and reinforcement learning, quantizes the model, and deploys an optimized endpoint. Results are automatically evaluated against the current model on accuracy, latency, and efficiency before teams choose to scale traffic. The resulting OpenAI-compatible endpoint combines a specialized SLM, prompt optimization, caching, and tuned serving for the use case.Starting Price: $0.04 per 1M tokens -
21
Grok 3 mini
SpaceXAI
Grok-3 Mini, crafted by xAI, is an agile and insightful AI companion tailored for users who need quick, yet thorough answers to their questions. This smaller version maintains the essence of the Grok series, offering an external, often humorous perspective on human affairs with a focus on efficiency. Designed for those on the move or with limited resources, Grok-3 Mini delivers the same level of curiosity and helpfulness in a more compact form. It's adept at handling a broad spectrum of questions, providing succinct insights without compromising on depth or accuracy, making it a perfect tool for fast-paced, modern-day inquiries.Starting Price: Free -
22
Seed2.0 Lite
ByteDance
Seed2.0 Lite is part of ByteDance’s Seed2.0 family of general-purpose multimodal AI agent models designed to handle complex, real-world tasks with a balanced focus on performance and efficiency. It offers enhanced multimodal understanding and instruction-following capabilities compared with earlier Seed models, enabling it to process and reason about text, visual elements, and structured information reliably for production-grade applications. As a mid-sized model in the series, Lite is optimized to deliver good quality outputs with responsive performance at lower cost and faster inference than the Pro variant while surpassing the previous generation’s capabilities, making it suitable for workflows that require stable reasoning, long-context understanding, and multimodal task execution without needing the highest possible raw performance. -
23
Seed2.0 Mini
ByteDance
Seed2.0 Mini is the smallest member of ByteDance’s Seed2.0 series of general-purpose multimodal agent models, designed for high-throughput inference and dense deployment while retaining the core strengths of its larger siblings in multimodal understanding and instruction following. Part of a family that also includes Pro and Lite, the Mini variant is optimized for high-concurrency and batch generation workloads, making it suitable for applications where efficient processing of many requests at scale matters as much as capability. Like other Seed2.0 models, it benefits from systematic enhancements in visual reasoning, motion perception, structured extraction from complex inputs like text and images, and reliable execution of multi-step instructions, but it trades some raw reasoning and output quality for faster, more cost-effective inference and better deployment efficiency. -
24
Gemma 2
Google
A family of state-of-the-art, light-open models created from the same research and technology that were used to create Gemini models. These models incorporate comprehensive security measures and help ensure responsible and reliable AI solutions through selected data sets and rigorous adjustments. Gemma models achieve exceptional comparative results in their 2B, 7B, 9B, and 27B sizes, even outperforming some larger open models. With Keras 3.0, enjoy seamless compatibility with JAX, TensorFlow, and PyTorch, allowing you to effortlessly choose and change frameworks based on task. Redesigned to deliver outstanding performance and unmatched efficiency, Gemma 2 is optimized for incredibly fast inference on various hardware. The Gemma family of models offers different models that are optimized for specific use cases and adapt to your needs. Gemma models are large text-to-text lightweight language models with a decoder, trained in a huge set of text data, code, and mathematical content. -
25
Amazon Nova
Amazon
Amazon Nova is a new generation of state-of-the-art (SOTA) foundation models (FMs) that deliver frontier intelligence and industry leading price-performance, available exclusively on Amazon Bedrock. Amazon Nova Micro, Amazon Nova Lite, and Amazon Nova Pro are understanding models that accept text, image, or video inputs and generate text output. They provide a broad selection of capability, accuracy, speed, and cost operation points. Amazon Nova Micro is a text only model that delivers the lowest latency responses at very low cost. Amazon Nova Lite is a very low-cost multimodal model that is lightning fast for processing image, video, and text inputs. Amazon Nova Pro is a highly capable multimodal model with the best combination of accuracy, speed, and cost for a wide range of tasks. Amazon Nova Pro’s capabilities, coupled with its industry-leading speed and cost efficiency, makes it a compelling model for almost any task, including video summarization, Q&A, math & more. -
26
Phi-4-mini-reasoning
Microsoft
Phi-4-mini-reasoning is a 3.8-billion parameter transformer-based language model optimized for mathematical reasoning and step-by-step problem solving in environments with constrained computing or latency. Fine-tuned with synthetic data generated by the DeepSeek-R1 model, it balances efficiency with advanced reasoning ability. Trained on over one million diverse math problems spanning multiple levels of difficulty from middle school to Ph.D. level, Phi-4-mini-reasoning outperforms its base model on long sentence generation across various evaluations and surpasses larger models like OpenThinker-7B, Llama-3.2-3B-instruct, and DeepSeek-R1. It features a 128K-token context window and supports function calling, enabling integration with external tools and APIs. Phi-4-mini-reasoning can be quantized using Microsoft Olive or Apple MLX Framework for deployment on edge devices such as IoT, laptops, and mobile devices. -
27
Phi-4-mini-flash-reasoning
Microsoft
Phi-4-mini-flash-reasoning is a 3.8 billion‑parameter open model in Microsoft’s Phi family, purpose‑built for edge, mobile, and other resource‑constrained environments where compute, memory, and latency are tightly limited. It introduces the SambaY decoder‑hybrid‑decoder architecture with Gated Memory Units (GMUs) interleaved alongside Mamba state‑space and sliding‑window attention layers, delivering up to 10× higher throughput and a 2–3× reduction in latency compared to its predecessor without sacrificing advanced math and logic reasoning performance. Supporting a 64 K‑token context length and fine‑tuned on high‑quality synthetic data, it excels at long‑context retrieval, reasoning tasks, and real‑time inference, all deployable on a single GPU. Phi-4-mini-flash-reasoning is available today via Azure AI Foundry, NVIDIA API Catalog, and Hugging Face, enabling developers to build fast, scalable, logic‑intensive applications. -
28
Aion 1.0 Instruct
Microsoft
Aion-1.0-Instruct is a pre-release small language model introduced in Microsoft Edge as a developer preview for early testing and feedback. It is designed to power Edge’s on-device Prompt and Writing Assistance APIs, giving web developers a faster, smaller, and more efficient model for AI-powered browser experiences. Microsoft previously used Phi-4-mini for these APIs, but its hardware requirements limited availability across devices. Aion-1.0-Instruct expands support to significantly more devices, including machines with less capable GPUs and, through CPU inference, devices without a GPU, while still delivering strong quality for a wide range of web use cases. The model is available in Edge Canary and Dev channels, allowing developers to evaluate it in real-world web scenarios, test API interoperability, and provide feedback before final optimizations. Aion-1.0-Instruct is meant to help developers build AI features directly into websites and browser extensions. -
29
SubQ 1.1 Small
Subquadratic
SubQ 1.1 Small is a long-context AI model from Subquadratic designed to reason over complete enterprise artifacts such as codebases, document collections, contracts, and financial filings. It uses Subquadratic Sparse Attention, or SSA, to reduce the high compute costs normally associated with processing very large context windows. The model delivers near-perfect long-context retrieval across 1M, 2M, 6M, and 12M token tests while using far less attention compute than dense attention. SubQ 1.1 Small also maintains strong general reasoning, coding, knowledge, and agentic task performance across multiple benchmarks. Its capabilities make it useful for financial analysis, legal review, contract work, software engineering, due diligence, and other workflows where information is spread across large artifacts. SubQ is built for organizations that want to move beyond fragmented retrieval pipelines and enable direct reasoning over massive bodies of information. -
30
Bonsai 27B
PrismML
Bonsai 27B is the new multimodal flagship of the Bonsai family and the first 27B-class model to run on a phone. Based on Qwen3.6 27B, it brings a new capability tier to local devices; multi-step reasoning, structured tool calls, vision tasks, and computer-use agentic loops that stay coherent across many steps. Bonsai 27B comes in two variants. Ternary Bonsai 27B uses ternary weights with FP16 group-wise scaling, giving 1.71 effective bits per weight and a 5.9 GB footprint for the quality-oriented laptop-class version. 1-bit Bonsai 27B uses binary weights with the same group-wise scaling, giving 1.125 effective bits per weight and a 3.9 GB footprint that fits within the memory budget of an iPhone 17 Pro. Both variants run end-to-end across the language network, embeddings, attention, MLPs, and LM head with no higher-precision escape hatches. They are multimodal, with a compact 4-bit vision tower, so on-device workflows can understand screenshots, documents, and camera input.
