Filter by type:
Filter by tags:
muse-glimmer-30b
Muse Glimmer is Meta Superintelligence Labs' Apache-2.0 dense 30B model for
autonomous agentic work, coding, tool use, long-horizon reasoning, and
multimodal understanding. It supports more than 100 languages, interleaved
text and image input through its 1.8B-parameter perception encoder, and a
131K-token context window.
This entry uses the publisher's higher-quality dynamic K-quant GGUF and
official quantized vision projector. Automatic variant selection can use
the smaller 17 GB quantization or a DFlash-accelerated build when it fits.
Repository: localaiLicense: apache-2.0
muse-glimmer-30b-dflash
Muse Glimmer's higher-quality dynamic K-quant GGUF with the official
quantized perception encoder and DFlash drafter. DFlash proposes blocks of
up to 16 tokens for the target to verify in parallel, accelerating output
without changing model quality. Flash attention is enabled for this path.
Repository: localaiLicense: apache-2.0
muse-glimmer-30b-17gb
Muse Glimmer's smaller 17 GB K-quant GGUF with the official quantized
perception encoder. It preserves the model's agentic, coding, tool-use,
multilingual, and image-understanding capabilities for hosts with less
memory than the dynamic quantization requires.
Repository: localaiLicense: apache-2.0
muse-glimmer-30b-17gb-dflash
Muse Glimmer's smaller 17 GB K-quant GGUF with the official quantized
perception encoder and DFlash drafter. This is the lowest-memory published
build that retains image understanding and block-speculative decoding.
Flash attention is enabled for the DFlash path.
Repository: localaiLicense: apache-2.0
parable-granite-4.1-3b-claude-fable-5
# Parable-Granite-4.1-3B-Claude-Fable-5
Granite 4.1 3B fine-tuned on genuine Claude Fable 5 and GPT-5.5 agent
traces (planning, tool use, reasoning from real agent sessions).
Agent-flavored small model: terminal workflows, idiomatic code fixes,
explanations. v2 recipe: completion-masked SFT, replay mix, seed-averaged
weights. Published corpus and eval harness.
Repository: localaiLicense: apache-2.0
north-mini-code-1.0
North Mini Code 1.0 is Cohere Labs' Apache-2.0 sparse mixture-of-experts
coding model with 30B total parameters and 3B active parameters. It targets
code generation, agentic software engineering, terminal tasks, tool use,
and interleaved reasoning with a 256K-token context window. This entry uses
the UD-Q4_K_M GGUF quantization.
Repository: localaiLicense: apache-2.0
north-mini-code-1.0-q8
North Mini Code 1.0 is Cohere Labs' Apache-2.0 sparse mixture-of-experts
coding model with 30B total parameters and 3B active parameters. It targets
code generation, agentic software engineering, terminal tasks, tool use,
and interleaved reasoning with a 256K-token context window. This entry uses
the Q8_0 GGUF quantization.
Repository: localaiLicense: apache-2.0
kat-coder-v2.5-dev
KAT-Coder-V2.5-Dev is an Apache-2.0 agentic coding model from Kwaipilot,
post-trained from Qwen3.6-35B-A3B. It has 35 billion total parameters with
3 billion activated per token, a 262K-token context window, and text-only
weights tuned for repository-level coding and tool use.
This entry offers standard Q4_K_M and Q8_0 GGUF quantizations alongside
APEX mixed-precision variants with quality, balanced, compact, and mini
profiles. The APEX I-profiles use importance-matrix calibration.
Repository: localaiLicense: apache-2.0
kat-coder-v2.5-dev-q8
KAT-Coder-V2.5-Dev is an Apache-2.0 agentic coding model from Kwaipilot,
post-trained from Qwen3.6-35B-A3B. It has 35 billion total parameters with
3 billion activated per token, a 262K-token context window, and text-only
weights tuned for repository-level coding and tool use.
This entry uses the higher-quality Q8_0 GGUF quantization.
Repository: localaiLicense: apache-2.0
kat-coder-v2.5-dev-apex-i-quality
KAT-Coder-V2.5-Dev is an Apache-2.0 agentic coding model from Kwaipilot,
post-trained from Qwen3.6-35B-A3B. It has 35 billion total parameters with
3 billion activated per token, a 262K-token context window, and text-only
weights tuned for repository-level coding and tool use.
This entry offers standard Q4_K_M and Q8_0 GGUF quantizations alongside
APEX mixed-precision variants with quality, balanced, compact, and mini
profiles. The APEX I-profiles use importance-matrix calibration.
Repository: localaiLicense: apache-2.0
kat-coder-v2.5-dev-apex-i-balanced
KAT-Coder-V2.5-Dev is an Apache-2.0 agentic coding model from Kwaipilot,
post-trained from Qwen3.6-35B-A3B. It has 35 billion total parameters with
3 billion activated per token, a 262K-token context window, and text-only
weights tuned for repository-level coding and tool use.
This entry offers standard Q4_K_M and Q8_0 GGUF quantizations alongside
APEX mixed-precision variants with quality, balanced, compact, and mini
profiles. The APEX I-profiles use importance-matrix calibration.
Repository: localaiLicense: apache-2.0
kat-coder-v2.5-dev-apex-i-compact
KAT-Coder-V2.5-Dev is an Apache-2.0 agentic coding model from Kwaipilot,
post-trained from Qwen3.6-35B-A3B. It has 35 billion total parameters with
3 billion activated per token, a 262K-token context window, and text-only
weights tuned for repository-level coding and tool use.
This entry offers standard Q4_K_M and Q8_0 GGUF quantizations alongside
APEX mixed-precision variants with quality, balanced, compact, and mini
profiles. The APEX I-profiles use importance-matrix calibration.
Repository: localaiLicense: apache-2.0
kat-coder-v2.5-dev-apex-i-mini
KAT-Coder-V2.5-Dev is an Apache-2.0 agentic coding model from Kwaipilot,
post-trained from Qwen3.6-35B-A3B. It has 35 billion total parameters with
3 billion activated per token, a 262K-token context window, and text-only
weights tuned for repository-level coding and tool use.
This entry offers standard Q4_K_M and Q8_0 GGUF quantizations alongside
APEX mixed-precision variants with quality, balanced, compact, and mini
profiles. The APEX I-profiles use importance-matrix calibration.
Repository: localaiLicense: apache-2.0
kat-coder-v2.5-dev-apex-quality
KAT-Coder-V2.5-Dev is an Apache-2.0 agentic coding model from Kwaipilot,
post-trained from Qwen3.6-35B-A3B. It has 35 billion total parameters with
3 billion activated per token, a 262K-token context window, and text-only
weights tuned for repository-level coding and tool use.
This entry offers standard Q4_K_M and Q8_0 GGUF quantizations alongside
APEX mixed-precision variants with quality, balanced, compact, and mini
profiles. The APEX I-profiles use importance-matrix calibration.
Repository: localaiLicense: apache-2.0
kat-coder-v2.5-dev-apex-balanced
KAT-Coder-V2.5-Dev is an Apache-2.0 agentic coding model from Kwaipilot,
post-trained from Qwen3.6-35B-A3B. It has 35 billion total parameters with
3 billion activated per token, a 262K-token context window, and text-only
weights tuned for repository-level coding and tool use.
This entry offers standard Q4_K_M and Q8_0 GGUF quantizations alongside
APEX mixed-precision variants with quality, balanced, compact, and mini
profiles. The APEX I-profiles use importance-matrix calibration.
Repository: localaiLicense: apache-2.0
kat-coder-v2.5-dev-apex-compact
KAT-Coder-V2.5-Dev is an Apache-2.0 agentic coding model from Kwaipilot,
post-trained from Qwen3.6-35B-A3B. It has 35 billion total parameters with
3 billion activated per token, a 262K-token context window, and text-only
weights tuned for repository-level coding and tool use.
This entry offers standard Q4_K_M and Q8_0 GGUF quantizations alongside
APEX mixed-precision variants with quality, balanced, compact, and mini
profiles. The APEX I-profiles use importance-matrix calibration.
Repository: localaiLicense: apache-2.0
qwopus3.6-27b-fusion
Qwopus3.6-27B Fusion is an experimental Qwen3.6-27B merge that combines
reasoning and code-execution fine-tunes. It targets agentic coding,
mathematics, tool use, and long-context work while retaining image input.
This default entry uses the Q4_K_M GGUF quantization and the shared Q8_0
vision projector.
Repository: localaiLicense: qwen
qwopus3.6-27b-fusion-q8
Qwopus3.6-27B Fusion is an experimental Qwen3.6-27B reasoning and coding
merge. This entry uses the near-lossless Q8_0 GGUF quantization and the
shared Q8_0 vision projector.
Repository: localaiLicense: qwen
minicpm5-1b-claude-opus-fable5-v2-thinking
# MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking
GGUF quantizations for local deployment: **MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF**
中文说明
**MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking** is a compact 1B **Thinking** language model built on openbmb/MiniCPM5-1B. Compared with V1, this V2 release is further fine-tuned on **Fable 5** data with a stronger focus on **tool calling / function calling**, while also improving **coding** and **instruction-following**. It keeps MiniCPM5's native Thinking chat template and XML tool-call format.
Previous version: **MiniCPM5-1B-Claude-Opus-Fable5-Thinking** (V1)
For llama.cpp / Ollama / LM Studio deployment, see the **GGUF repository**.
## Overview
## Capabilities
- **Tool calling (enhanced in V2)** — more reliable XML / function-calling style tool use on top of MiniCPM5's native format
- **Coding** — code generation, debugging, and software-engineering-style tasks
- **Instruction following** — more reliable adherence to user prompts and structured constraints
- **Thinking mode** — chain-of-thought reasoning via the MiniCPM5 chat template
- **Long context** — up to **128K tokens** (131,072 tokens per `config.json`)
...
Repository: localaiLicense: apache-2.0
hy3
中文 ｜ English
[](#license)
[](https://huggingface.co/tencent/Hy3)
[](https://modelscope.cn/models/Tencent-Hunyuan/Hy3)
[](https://cnb.cool/ai-models/tencent/Hy3)
[](https://ai.gitcode.com/tencent_hunyuan/Hy3)
🖥️ Official Website |
💬 GitHub
## Table of Contents
- Model Introduction
- Stronger Agent Capabilities
- More Reliable Product Experiences
- Benchmark Appendix
- News
- Model Links
- Quickstart
- Deployment
- vLLM
- SGLang
- Finetuning
- RL Post-training
- Quantization
- License
- Contact Us
## Model Introduction
**Hy3** is a 295B-parameter Mixture-of-Experts (MoE) model with 21B active parameters and 3.8B MTP layer parameters, developed by the Tencent Hy Team. Following the Hy3 Preview launch in late April, we gathered feedback from 50+ products and scaled up post-training with higher quality data. Today, we introduce Hy3, which outperforms similar-size models and rivals flagship open-source models with 2-5x parameters. It also shows significant gains in utility across various products and productivity tasks.
## Stronger Agent Capabilities
...
Repository: localaiLicense: apache-2.0
minicpm5-1b-claude-opus-fable5-thinking
# MiniCPM5-1B-Claude-Opus-Fable5-Thinking
GGUF quantizations for local deployment: **MiniCPM5-1B-Claude-Opus-Fable5-Thinking-GGUF**
中文说明
**MiniCPM5-1B-Claude-Opus-Fable5-Thinking** is a compact 1B **Thinking** language model built on openbmb/MiniCPM5-1B. It is further fine-tuned on **Fable 5** data to improve **coding** and **instruction-following** while keeping MiniCPM5's native Thinking chat template and tool-call format.
For llama.cpp / Ollama / LM Studio deployment, see the **GGUF repository**.
## Overview
## Capabilities
- **Coding** — code generation, debugging, and software-engineering-style tasks
- **Instruction following** — more reliable adherence to user prompts and structured constraints
- **Thinking mode** — chain-of-thought reasoning via the MiniCPM5 chat template
- **Tool calling** — inherits MiniCPM5's XML tool-call format
- **Long context** — up to **128K tokens** (131,072 tokens per `config.json`)
## Quick start
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
model_id = "GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-Thinking"
...
Repository: localaiLicense: apache-2.0
Page 1