Filter by type:
Filter by tags:
huihui-qwen3.8-27b-abliterated
# Qwen3.8-27B
> [!Note]
> This repository contains model weights and configuration files for the post-trained model in the Hugging Face Transformers format.
>
> These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, TokenSpeed, etc.
> [!Tip]
> For users seeking managed, scalable inference without infrastructure maintenance, the official Qwen API service is provided by Qwen Cloud.
> In particular, **Qwen3.8-27B** will be available as a hosted version with more production features, e.g., 1M context length by default, official built-in tools. For more information, please refer to the Qwen3.8-27B Overview. The service is coming soon. Stay tuned for updates.
Following the widespread community adoption of the Qwen3.5 and Qwen3.6 series, we are pleased to introduce Qwen3.8, the most capable generation in the Qwen open-model family to date.
...
Repository: localaiLicense: apache-2.0
ling-3.0-flash-iq1
Ling-3.0-flash is InclusionAI's MIT-licensed hybrid reasoning MoE model
with 124B total parameters and 5.5B active parameters per token. It targets
coding, deep research, instruction following, and agentic workflows with a
native 256K-token context window.
This default entry uses the 36.5 GB AD-IQ1_M GGUF. A higher-quality
44.7 GB AD-IQ2_XS model is available as a variant.
Repository: localaiLicense: mit
ling-3.0-flash-iq2
Ling-3.0-flash in the higher-quality 44.7 GB AD-IQ2_XS GGUF format. This
variant preserves more model fidelity for hosts with enough memory.
Repository: localaiLicense: mit
qwen3.8-27b-heretic-abliterated-uncensored
# Qwen3.8-27B
> [!Note]
> This repository contains model weights and configuration files for the post-trained model in the Hugging Face Transformers format.
>
> These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, TokenSpeed, etc.
> [!Tip]
> For users seeking managed, scalable inference without infrastructure maintenance, the official Qwen API service is provided by Qwen Cloud.
> In particular, **Qwen3.8-27B** will be available as a hosted version with more production features, e.g., 1M context length by default, official built-in tools. For more information, please refer to the Qwen3.8-27B Overview. The service is coming soon. Stay tuned for updates.
Following the widespread community adoption of the Qwen3.5 and Qwen3.6 series, we are pleased to introduce Qwen3.8, the most capable generation in the Qwen open-model family to date.
...
Repository: localaiLicense: apache-2.0
ornith-1.0-9b-q4
Ornith-1.0-9B is an MIT-licensed Qwen3.5 model from Ornith AI for
agentic coding, reasoning, repository-level software tasks, and tool use.
It supports text and image input with a context window of 262K tokens.
This default entry uses the Q4_K_M GGUF and F16 vision projector. A
higher-quality Q8_0 model is available as a variant.
Repository: localaiLicense: mit
ornith-1.0-9b-q8
Ornith-1.0-9B in the higher-quality Q8_0 GGUF format, with the shared F16
vision projector for multimodal prompts.
Repository: localaiLicense: mit
ornith-1.5-9b-q4
Ornith-1.5-9B is an MIT-licensed Qwen3.5 model from Ornith AI for
agentic coding, reasoning, repository-level software tasks, and tool use.
It supports text and image input with a context window of 262K tokens.
This default entry uses the Q4_K_M GGUF and BF16 vision projector. A
higher-quality Q8_0 model is available as a variant.
Repository: localaiLicense: mit
ornith-1.5-9b-q8
Ornith-1.5-9B in the higher-quality Q8_0 GGUF format, with the shared BF16
vision projector for multimodal prompts.
Repository: localaiLicense: mit
qwen3.8-27b-q4
Qwen3.8-27B is Qwen's dense 27B vision-language model for reasoning,
coding, tool use, and long-running agent tasks. It accepts text, images,
and video, and it supports a native context window of 262K tokens.
This default entry uses the official Q4_K_M GGUF and Q8_0 vision
projector. The linked variants add MTP speculative decoding or use the
higher-quality Q8_0 model.
Repository: localaiLicense: apache-2.0
qwen3.8-27b-q4-mtp
Qwen3.8-27B with the official Q4_K_M model and Q4_0 MTP draft model.
MTP speculative decoding can increase generation speed by proposing
multiple tokens for the target model to verify.
Repository: localaiLicense: apache-2.0
qwen3.8-27b-q8
Qwen3.8-27B in the official Q8_0 GGUF format. This variant provides higher
model fidelity for hosts with enough memory.
Repository: localaiLicense: apache-2.0
qwen3.8-27b-ridge
Qwen3.8-27B Ridge is a 3.69-bit mixed quantization that keeps the
Gated-DeltaNet state path at Q8_0 and preserves the embedded MTP head.
It reduces the model weights to 12.59 GB while retaining multimodal,
reasoning, coding, tool-use, and long-context capabilities.
Repository: localaiLicense: apache-2.0
qwen3.8-9b-q4
Qwen3.8-9B is Empero AI's full-parameter distillation of Qwen3.8 2.4T
A95B into the dense Qwen3.5-9B architecture. It targets reasoning,
mathematics, coding, instruction following, and tool use, and supports a
native 262K-token context window. This default entry uses Q4_K_M weights;
a higher-quality Q8_0 build is available as a variant.
Repository: localaiLicense: apache-2.0
qwen3.8-9b-q8
Qwen3.8-9B in the higher-quality Q8_0 GGUF format. This variant preserves
more model fidelity for hosts with enough memory.
Repository: localaiLicense: apache-2.0
qwen3.8-4b-q4
Qwen3.8-4B is Empero AI's full-parameter distillation of Qwen3.8 2.4T
A95B into the Qwen3.5-4B architecture. It targets mathematics, reasoning,
instruction following, and tool use with a native 262K-token context
window. This default entry uses Q4_K_M weights; a higher-quality Q8_0
build is available as a variant.
Repository: localaiLicense: apache-2.0
qwen3.8-4b-q8
Qwen3.8-4B in the higher-quality Q8_0 GGUF format. This variant preserves
more model fidelity for hosts with enough memory.
Repository: localaiLicense: apache-2.0
qwen3.8-2b-q4
Qwen3.8-2B is Empero AI's smallest Qwen3.8 reasoning distillation. It uses
the Qwen3.5-2B architecture and targets mathematics, instruction
following, tool use, and edge deployment with a native 262K-token context
window. This default entry uses Q4_K_M weights; a higher-quality Q8_0
build is available as a variant.
Repository: localaiLicense: apache-2.0
qwen3.8-2b-q8
Qwen3.8-2B in the higher-quality Q8_0 GGUF format. This variant preserves
more model fidelity while remaining suitable for compact hosts.
Repository: localaiLicense: apache-2.0
nemotron-3.5-lightning-30b-a3b-q4
NVIDIA Nemotron 3.5 Lightning is a text-only hybrid Mamba-2, attention, and
mixture-of-experts model with 30B total parameters and 3B active parameters.
It targets reasoning, coding, tool use, multilingual chat, and long-context
agent workflows, with a context window of up to one million tokens.
This entry uses the official Q4_K_M GGUF. Automatic variant selection can
choose the smaller NVFP4 build or the higher-quality Q8_0 build when it fits.
Repository: localaiLicense: openmdw-1.1
nemotron-3.5-lightning-30b-a3b-nvfp4
NVIDIA Nemotron 3.5 Lightning 30B-A3B in the official NVFP4 GGUF format.
This is the smallest linked build and retains the model's reasoning, coding,
tool-use, multilingual, and long-context capabilities.
Repository: localaiLicense: openmdw-1.1
nemotron-3.5-lightning-30b-a3b-q8
NVIDIA Nemotron 3.5 Lightning 30B-A3B in the official high-quality Q8_0
GGUF format for hosts with enough memory.
Repository: localaiLicense: openmdw-1.1
Page 1