Filter by type:
Filter by tags:
lfm2.5-1.2b-instruct
Try LFM • Docs • LEAP • Discord
# LFM2.5-1.2B-Instruct
LFM2.5 is a new family of hybrid models designed for **on-device deployment**. It builds on the LFM2 architecture with extended pre-training and reinforcement learning.
- **Best-in-class performance**: A 1.2B model rivaling much larger models, bringing high-quality AI to your pocket.
- **Fast edge inference**: 239 tok/s decode on AMD CPU, 82 tok/s on mobile NPU. Runs under 1GB of memory with day-one support for llama.cpp, MLX, and vLLM.
- **Scaled training**: Extended pre-training from 10T to 28T tokens and large-scale multi-stage reinforcement learning.
Find more information about LFM2.5 in our blog post.
## 🗒️ Model Details
LFM2.5-1.2B-Instruct is a general-purpose text-only model with the following features:
...
Repository: localaiLicense: other
lfm2.5-230m
LFM2.5-230M is LiquidAI's compact text model for edge and on-device use.
It has 230M parameters, a 128K-token context window, and support for ten
languages. This entry uses the recommended Q4_K_M GGUF quantization from
LiquidAI's official repository.
Repository: localaiLicense: other
lfm2.5-230m-q8
LFM2.5-230M is LiquidAI's compact text model for edge and on-device use.
It has 230M parameters, a 128K-token context window, and support for ten
languages. This entry uses the higher-quality Q8_0 GGUF quantization from
LiquidAI's official repository.
Repository: localaiLicense: other
lfm2.5-2.6b
LFM2.5-2.6B is LiquidAI's compact, text-only reasoning model for on-device
agentic workloads. It has 2.69B parameters, a 128K-token context window,
multilingual support, and post-training for tool use, instruction following,
data extraction, RAG, and multi-step agents. This entry uses the recommended
Q4_K_M GGUF quantization from LiquidAI's official repository.
Repository: localaiLicense: other
lfm2.5-2.6b-q8
LFM2.5-2.6B is LiquidAI's compact, text-only reasoning model for on-device
agentic workloads. It has 2.69B parameters, a 128K-token context window,
multilingual support, and post-training for tool use, instruction following,
data extraction, RAG, and multi-step agents. This entry uses the higher-quality
Q8_0 GGUF quantization from LiquidAI's official repository.
Repository: localaiLicense: other
lfm2.5-8b-a1b
Try LFM •
Docs •
LEAP •
Discord
# LFM2.5-8B-A1B
LFM2.5 is a new family of hybrid models designed for on-device deployment. It builds on the LFM2 architecture with extended pre-training and reinforcement learning.
- **On-device personal assistant**: Designed to power real-life applications, chaining tool calls, and following complex instructions on all devices.
- **Compressed performance**: Competitive with much larger dense and MoE models on instruction following and agentic tasks.
- **Unmatched throughput**: Fastest in its size class on both CPU and GPU inference, with day-one support for llama.cpp, MLX, vLLM, and SGLang.
Find more information about LFM2.5-8B-A1B in our blog post.
**AA-Omniscience Index (higher is better) rewards correct answers and penalizes hallucinations. Scores range from -100 to 100. See more results on Artificial Analysis.*
## 🗒️ Model Details
LFM2.5-8B-A1B is a general-purpose text-only model with the following features:
...
Repository: localaiLicense: other
liquidai.lfm2-2.6b-transcript
This is a large language model (2.6B parameters) designed for text-generation tasks. It is a quantized version of the original model `LiquidAI/LFM2-2.6B-Transcript`, optimized for efficiency while retaining strong performance. The model is built on the foundation of the base model, with additional optimizations for deployment and use cases like transcription or language modeling. It is trained on large-scale text data and supports multiple languages.
Repository: localai
lfm2.5-1.2b-nova-function-calling
The **LFM2.5-1.2B-Nova-Function-Calling-GGUF** is a quantized version of the original model, optimized for efficiency with **Unsloth**. It supports text and multimodal tasks, using different quantization levels (e.g., Q2_K, Q3_K, Q4_K, etc.) to balance performance and memory usage. The model is designed for function calling and is faster than the original version, making it suitable for tasks like code generation, reasoning, and multi-modal input processing.
Repository: localaiLicense: apache-2.0
lfm2.5-audio-1.5b-realtime
LFM2.5-Audio-1.5B is LiquidAI's any-to-any audio foundation model. The
1.2B LFM2.5 backbone plus a FastConformer audio encoder and an LFM2-based
audio detokenizer give real-time speech-to-speech with text + audio output
interleaved at 12.5 Hz / 24 kHz. This entry runs in S2S (speech-to-speech)
mode and is the model the LocalAI realtime API any-to-any path consumes.
Switch to ASR, TTS, or chat by picking the sibling gallery entries.
Repository: localaiLicense: LFM-Open-License-v1.0
lfm2.5-audio-1.5b-chat
LFM2.5-Audio-1.5B in text-only chat mode. The model runs `generate_sequential`
with no audio modality, behaving like a small LFM2 chat model. Pick this
entry for tool-calling experiments without the audio overhead.
Repository: localaiLicense: LFM-Open-License-v1.0
lfm2.5-audio-1.5b-asr
LFM2.5-Audio-1.5B in ASR mode. System prompt `Perform ASR.` is prepended;
output is capitalised and punctuated. Wire this entry as a transcription
model on the /v1/audio/transcriptions endpoint.
Repository: localaiLicense: LFM-Open-License-v1.0
lfm2.5-audio-1.5b-tts
LFM2.5-Audio-1.5B in TTS mode. Four baked voices: us_male, us_female,
uk_male, uk_female — pick the default at load time via `voice:` option,
or override per-request via the OpenAI `/v1/audio/speech` `voice` field.
Repository: localaiLicense: LFM-Open-License-v1.0
lfm2-vl-450m
LFM2‑VL is Liquid AI's first series of multimodal models, designed to process text and images with variable resolutions. Built on the LFM2 backbone, it is optimized for low-latency and edge AI applications.
We're releasing the weights of two post-trained checkpoints with 450M (for highly constrained devices) and 1.6B (more capable yet still lightweight) parameters.
2× faster inference speed on GPUs compared to existing VLMs while maintaining competitive accuracy
Flexible architecture with user-tunable speed-quality tradeoffs at inference time
Native resolution processing up to 512×512 with intelligent patch-based handling for larger images, avoiding upscaling and distortion
Repository: localaiLicense: lfm1.0
lfm2-vl-1.6b
LFM2‑VL is Liquid AI's first series of multimodal models, designed to process text and images with variable resolutions. Built on the LFM2 backbone, it is optimized for low-latency and edge AI applications.
We're releasing the weights of two post-trained checkpoints with 450M (for highly constrained devices) and 1.6B (more capable yet still lightweight) parameters.
2× faster inference speed on GPUs compared to existing VLMs while maintaining competitive accuracy
Flexible architecture with user-tunable speed-quality tradeoffs at inference time
Native resolution processing up to 512×512 with intelligent patch-based handling for larger images, avoiding upscaling and distortion
Repository: localaiLicense: lfm1.0
lfm2.5-vl-1.6b
LFM2.5-VL-1.6B is Liquid AI's compact vision-language model for edge deployment. It improves instruction following, multilingual vision understanding, OCR, high-resolution images, and multi-image input over LFM2-VL-1.6B. This default entry uses the official Q4_K_M GGUF with the F16 vision projector.
License: LFM Open License 1.0.
Repository: localaiLicense: lfm1.0
lfm2.5-vl-1.6b-q8
LFM2.5-VL-1.6B in the higher-fidelity Q8_0 GGUF format with the F16 vision projector.
License: LFM Open License 1.0.
Repository: localaiLicense: lfm1.0
lfm2-1.2b
LFM2-1.2B is a hybrid liquid model designed for edge AI and on-device deployment, offering fast inference and multilingual support across 8 languages. It's optimized for agentic tasks, data extraction, and multi-turn conversations with efficient CPU/GPU/NPU compatibility.
Repository: localaiLicense: lfm1.0
liquidai_lfm2-350m-extract
Based on LFM2-350M, LFM2-350M-Extract is designed to extract important information from a wide variety of unstructured documents (such as articles, transcripts, or reports) into structured outputs like JSON, XML, or YAML.
Use cases:
Extracting invoice details from emails into structured JSON.
Converting regulatory filings into XML for compliance systems.
Transforming customer support tickets into YAML for analytics pipelines.
Populating knowledge graphs with entities and attributes from unstructured reports.
You can find more information about other task-specific models in this blog post.
Repository: localaiLicense: lfm1.0
liquidai_lfm2-1.2b-extract
Based on LFM2-1.2B, LFM2-1.2B-Extract is designed to extract important information from a wide variety of unstructured documents (such as articles, transcripts, or reports) into structured outputs like JSON, XML, or YAML.
Use cases:
Extracting invoice details from emails into structured JSON.
Converting regulatory filings into XML for compliance systems.
Transforming customer support tickets into YAML for analytics pipelines.
Populating knowledge graphs with entities and attributes from unstructured reports.
Repository: localaiLicense: lfm1.0
liquidai_lfm2-1.2b-rag
Based on LFM2-1.2B, LFM2-1.2B-RAG is specialized in answering questions based on provided contextual documents, for use in RAG (Retrieval-Augmented Generation) systems.
Use cases:
Chatbot to ask questions about the documentation of a particular product.
Custom support with an internal knowledge base to provide grounded answers.
Academic research assistant with multi-turn conversations about research papers and course materials.
Repository: localaiLicense: lfm1.0
liquidai_lfm2-1.2b-tool
Based on LFM2-1.2B, LFM2-1.2B-Tool is designed for concise and precise tool calling. The key challenge was designing a non-thinking model that outperforms similarly sized thinking models for tool use.
Use cases:
Mobile and edge devices requiring instant API calls, database queries, or system integrations without cloud dependency.
Real-time assistants in cars, IoT devices, or customer support, where response latency is critical.
Resource-constrained environments like embedded systems or battery-powered devices needing efficient tool execution.
Repository: localaiLicense: lfm1.0
Page 1