Filter by type:
Filter by tags:
parable-granite-4.1-3b-claude-fable-5
# Parable-Granite-4.1-3B-Claude-Fable-5
Granite 4.1 3B fine-tuned on genuine Claude Fable 5 and GPT-5.5 agent
traces (planning, tool use, reasoning from real agent sessions).
Agent-flavored small model: terminal workflows, idiomatic code fixes,
explanations. v2 recipe: completion-masked SFT, replay mix, seed-averaged
weights. Published corpus and eval harness.
Repository: localaiLicense: apache-2.0
parable-qwen3-4b-claude-fable-5
# Parable-Qwen3-4B-Claude-Fable-5
Qwen3 4B fine-tuned on genuine Claude Fable 5 agent traces. Thinking-mode
reasoning, agent/terminal task flavor, tool-call formatting.
Repository: localaiLicense: apache-2.0
parable-granite-4.1-8b-claude-fable-5
# Parable-Granite-4.1-8B-Claude-Fable-5
Granite 4.1 8B fine-tuned on genuine Claude Fable 5 and GPT-5.5 agent
traces. Strongest Parable model: multi-step scripts, configs, terminal
workflows, reasoning.
Repository: localaiLicense: apache-2.0
parable-qwen3-8b-claude-fable-5
# Parable-Qwen3-8B-Claude-Fable-5
Qwen3 8B fine-tuned on genuine Claude Fable 5 agent traces. Thinking-mode
reasoning with agent/terminal flavor and tool-call formatting.
Repository: localaiLicense: apache-2.0
minicpm5-1b-claude-opus-fable5-v2-thinking
# MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking
GGUF quantizations for local deployment: **MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF**
中文说明
**MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking** is a compact 1B **Thinking** language model built on openbmb/MiniCPM5-1B. Compared with V1, this V2 release is further fine-tuned on **Fable 5** data with a stronger focus on **tool calling / function calling**, while also improving **coding** and **instruction-following**. It keeps MiniCPM5's native Thinking chat template and XML tool-call format.
Previous version: **MiniCPM5-1B-Claude-Opus-Fable5-Thinking** (V1)
For llama.cpp / Ollama / LM Studio deployment, see the **GGUF repository**.
## Overview
## Capabilities
- **Tool calling (enhanced in V2)** — more reliable XML / function-calling style tool use on top of MiniCPM5's native format
- **Coding** — code generation, debugging, and software-engineering-style tasks
- **Instruction following** — more reliable adherence to user prompts and structured constraints
- **Thinking mode** — chain-of-thought reasoning via the MiniCPM5 chat template
- **Long context** — up to **128K tokens** (131,072 tokens per `config.json`)
...
Repository: localaiLicense: apache-2.0
minicpm5-1b-claude-opus-fable5-thinking
# MiniCPM5-1B-Claude-Opus-Fable5-Thinking
GGUF quantizations for local deployment: **MiniCPM5-1B-Claude-Opus-Fable5-Thinking-GGUF**
中文说明
**MiniCPM5-1B-Claude-Opus-Fable5-Thinking** is a compact 1B **Thinking** language model built on openbmb/MiniCPM5-1B. It is further fine-tuned on **Fable 5** data to improve **coding** and **instruction-following** while keeping MiniCPM5's native Thinking chat template and tool-call format.
For llama.cpp / Ollama / LM Studio deployment, see the **GGUF repository**.
## Overview
## Capabilities
- **Coding** — code generation, debugging, and software-engineering-style tasks
- **Instruction following** — more reliable adherence to user prompts and structured constraints
- **Thinking mode** — chain-of-thought reasoning via the MiniCPM5 chat template
- **Tool calling** — inherits MiniCPM5's XML tool-call format
- **Long context** — up to **128K tokens** (131,072 tokens per `config.json`)
## Quick start
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
model_id = "GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-Thinking"
...
Repository: localaiLicense: apache-2.0
qwopus3.6-35b-a3b-coder-mtp
# 🌟 Qwopus3.6-35B-A3B-v1
## 💡 Base Model Overview
**Qwen3.6-35B-A3B** is an advanced hybrid sparse MoE (Mixture-of-Experts) model developed by Alibaba Cloud. It features 35B total parameters with only 3B active parameters per token, ensuring high inference efficiency. Architecturally, it combines Gated DeltaNet linear attention with standard gated attention layers, routing tokens across **256 experts**. It natively supports a massive **262k context window** and is specifically designed for high-performance agentic coding, deep reasoning, and multimodal tasks.
## 🚀 Model Refinement & Logic Tuning （Qwopus3.6-35B-A3B-v1）
🪐**Qwopus3.6-35B-A3B-v1** is a reasoning-enhanced MoE (Mixture of Experts) model fine-tuned on top of **Qwen3.6-35B-A3B**.
### 🛠 Training Strategy
The fine-tuning process for this model is structured into **three distinct stages of distributed SFT (Supervised Fine-Tuning)**, progressively scaling reasoning complexity and data diversity. This systematic approach ensures the model inherits the base MoE capabilities while sharpening its logic-handling depth.
...
Repository: localaiLicense: apache-2.0
gemmable-4-12b-mtp
## Gemmable 4 12B
Gemmable 4 12B is a GGUF export of Gemma 4 12B fine-tuned on Fable-5 style
reasoning and assistant traces.
## Highlights
- Base model: `google/gemma-4-12B`
- Format: GGUF
- Training style: Fable-5 style reasoning and assistant traces
- Distribution: fp16 GGUF plus matching assistant GGUFs for each quant
- Intended use: local inference, coding, reasoning, and assistant workflows
## How to use
### llama.cpp
Standard load:
```bash
llama-server -m "gemmable-4-12b-fp16.gguf"
```
Speculative / draft-MTP load:
```bash
llama-server -m "gemmable-4-12b-Q4_K_M.gguf" \
--spec-draft-model "gemmable-4-12b-Q4_K_M-mtp.gguf" \
--spec-type draft-mtp \
--spec-draft-n-max 4
```
Use the matching fp16 or quantized main file with its `-mtp` companion.
### LM Studio
1. Search this repo, download target + mtp file.
2. Load target.
3. Load settings → Speculative Decoding → select mtp file file.
(Requires a llama.cpp runtime with Gemma 4 MTP support from ggml-org/llama.cpp#23398. LocalAI's pinned llama.cpp backend already carries it, so this entry runs draft-mtp out of the box.)
## GGUF / local inference notes
...
Repository: localai
bigbang-v1-q4-k-m
BigBang-v1 is an Apache-2.0 multimodal reasoning model fine-tuned from
Qwen3.6-35B-A3B for scientific research, coding, long-horizon search, and
tool use. It supports image input, a 262K native context window, and
built-in multi-token prediction. This entry uses the recommended Q4_K_M
GGUF quantization and the F16 vision projector.
Repository: localaiLicense: apache-2.0
bigbang-v1-q6-k
BigBang-v1 is an Apache-2.0 multimodal reasoning model fine-tuned from
Qwen3.6-35B-A3B for scientific research, coding, long-horizon search, and
tool use. It supports image input, a 262K native context window, and
built-in multi-token prediction. This entry uses the higher-quality Q6_K
GGUF quantization and the F16 vision projector.
Repository: localaiLicense: apache-2.0
qwopus3.6-27b-v2-mtp-nvfp4
🪐 Qwopus3.6-27B-v2-MTP
MTP Release
Multi-Token Prediction reasoning model fine-tuned from Qwen3.6-27B
🧬 Trace Inversion & Negentropy
🧠 27B Parameters
⚡ Speculative Decoding
🛠️ Coding / DevOps / Math
💡 What is Qwopus3.6-27B-v2-MTP?
🪐 Qwopus3.6-27B-v2-MTP is a speed-oriented reasoning release built on top of Qwen3.6-27B. It keeps the Qwopus line's focus on reconstructed reasoning traces, coding discipline, DevOps procedures, and mathematical derivations, while adding Multi-Token Prediction for faster generation. The goal is simple: preserve the depth and structure of a 27B reasoning model while making real interactive use noticeably faster.
⚡ MTP DecodingAuxiliary future-token prediction improves throughput on long reasoning, code, math, and strict-format prompts.
🧩 Structured ReasoningInherits the Qwopus training recipe built around reconstructed step-by-step reasoning trajectories.
🧪 GB10 TestedValidated on a 30-question local benchmark across Logic, Coding, DevOps, Math, and Edge tasks.
🚀 Practical SpeedDesigned for workflows where strong answers matter, but waiting several extra minutes per task does not.
...
Repository: localai
qwopus3.6-27b-v2-mtp
🪐 Qwopus3.6-27B-v2-MTP
MTP Release
Multi-Token Prediction reasoning model fine-tuned from Qwen3.6-27B
🧬 Trace Inversion & Negentropy
🧠 27B Parameters
⚡ Speculative Decoding
🛠️ Coding / DevOps / Math
💡 What is Qwopus3.6-27B-v2-MTP?
🪐 Qwopus3.6-27B-v2-MTP is a speed-oriented reasoning release built on top of Qwen3.6-27B. It keeps the Qwopus line's focus on reconstructed reasoning traces, coding discipline, DevOps procedures, and mathematical derivations, while adding Multi-Token Prediction for faster generation. The goal is simple: preserve the depth and structure of a 27B reasoning model while making real interactive use noticeably faster.
⚡ MTP DecodingAuxiliary future-token prediction improves throughput on long reasoning, code, math, and strict-format prompts.
🧩 Structured ReasoningInherits the Qwopus training recipe built around reconstructed step-by-step reasoning trajectories.
🧪 GB10 TestedValidated on a 30-question local benchmark across Logic, Coding, DevOps, Math, and Edge tasks.
🚀 Practical SpeedDesigned for workflows where strong answers matter, but waiting several extra minutes per task does not.
...
Repository: localaiLicense: apache-2.0
arex-turbo
AREX-Turbo is BAAI's compact 4B deep-research agent, fine-tuned from
Qwen3.5-4B for long-horizon search, evidence aggregation, constraint
verification, and tool-assisted reasoning. It supports text and image
input with a 262K-token context window. This entry uses the recommended
Q4_K_M GGUF quantization.
Repository: localaiLicense: apache-2.0
arex-turbo-q8
AREX-Turbo is BAAI's compact 4B deep-research agent, fine-tuned from
Qwen3.5-4B for long-horizon search, evidence aggregation, constraint
verification, and tool-assisted reasoning. It supports text and image
input with a 262K-token context window. This entry uses the higher-quality
Q8_0 GGUF quantization.
Repository: localaiLicense: apache-2.0
ui-mate-9b
UI-Mate-9B is Tencent's 9B-parameter multimodal computer-use agent,
fine-tuned from Qwen3.5-9B. It accepts task instructions, screenshots,
and interaction history, then emits reasoning and structured mouse and
keyboard actions for long-running desktop tasks. The model requires an
external runtime to execute its actions and should run with human
confirmation for sensitive operations. This entry uses the recommended
Q4_K_M GGUF quantization.
Repository: localaiLicense: apache-2.0
ui-mate-9b-q8
UI-Mate-9B is Tencent's 9B-parameter multimodal computer-use agent,
fine-tuned from Qwen3.5-9B. It accepts task instructions, screenshots,
and interaction history, then emits reasoning and structured mouse and
keyboard actions for long-running desktop tasks. The model requires an
external runtime to execute its actions and should run with human
confirmation for sensitive operations. This entry uses the higher-quality
Q8_0 GGUF quantization.
Repository: localaiLicense: apache-2.0
fara1.5-4b
Fara1.5-4B is Microsoft's 4B-parameter multimodal computer-use agent for web browsers, fine-tuned from Qwen3.5-4B. It accepts screenshots and text, emits structured browser actions, supports a 262K-token context, and should be deployed with appropriate sandboxing and user-confirmation controls. This entry uses the recommended Q4_K_M GGUF quantization.
Repository: localaiLicense: mit
fara1.5-4b-q8
Fara1.5-4B is Microsoft's 4B-parameter multimodal computer-use agent for web browsers, fine-tuned from Qwen3.5-4B. It accepts screenshots and text, emits structured browser actions, supports a 262K-token context, and should be deployed with appropriate sandboxing and user-confirmation controls. This entry uses the higher-quality Q8_0 GGUF quantization.
Repository: localaiLicense: mit
fara1.5-9b
Fara1.5-9B is Microsoft's 9B-parameter multimodal computer-use agent for web browsers, fine-tuned from Qwen3.5-9B. It accepts screenshots and text, emits structured browser actions, supports a 262K-token context, and should be deployed with appropriate sandboxing and user-confirmation controls. This entry uses the recommended Q4_K_M GGUF quantization.
Repository: localaiLicense: mit
fara1.5-9b-q8
Fara1.5-9B is Microsoft's 9B-parameter multimodal computer-use agent for web browsers, fine-tuned from Qwen3.5-9B. It accepts screenshots and text, emits structured browser actions, supports a 262K-token context, and should be deployed with appropriate sandboxing and user-confirmation controls. This entry uses the higher-quality Q8_0 GGUF quantization.
Repository: localaiLicense: mit
fara1.5-27b
Fara1.5-27B is Microsoft's 27B-parameter multimodal computer-use agent for web browsers, fine-tuned from Qwen3.5-27B. It accepts screenshots and text, emits structured browser actions, supports a 262K-token context, and should be deployed with appropriate sandboxing and user-confirmation controls. This entry uses the Q4_K_M GGUF quantization.
Repository: localaiLicense: mit
Page 1