Filter by type:
Filter by tags:
huihui-qwen3.8-27b-abliterated
# Qwen3.8-27B
> [!Note]
> This repository contains model weights and configuration files for the post-trained model in the Hugging Face Transformers format.
>
> These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, TokenSpeed, etc.
> [!Tip]
> For users seeking managed, scalable inference without infrastructure maintenance, the official Qwen API service is provided by Qwen Cloud.
> In particular, **Qwen3.8-27B** will be available as a hosted version with more production features, e.g., 1M context length by default, official built-in tools. For more information, please refer to the Qwen3.8-27B Overview. The service is coming soon. Stay tuned for updates.
Following the widespread community adoption of the Qwen3.5 and Qwen3.6 series, we are pleased to introduce Qwen3.8, the most capable generation in the Qwen open-model family to date.
...
Repository: localaiLicense: apache-2.0
hy-mt2-1.8b-q4
Hy-MT2-1.8B is Tencent's compact multilingual translation model. It
follows translation instructions across 33 languages and supports tasks
such as terminology control, style transfer, and structure-preserving
translation.
This default entry uses the 1.1 GB Q4_K_M GGUF. A higher-quality Q8_0
model is available as a variant.
Repository: localaiLicense: apache-2.0
ling-3.0-flash-iq1
Ling-3.0-flash is InclusionAI's MIT-licensed hybrid reasoning MoE model
with 124B total parameters and 5.5B active parameters per token. It targets
coding, deep research, instruction following, and agentic workflows with a
native 256K-token context window.
This default entry uses the 36.5 GB AD-IQ1_M GGUF. A higher-quality
44.7 GB AD-IQ2_XS model is available as a variant.
Repository: localaiLicense: mit
qwen3.8-27b-heretic-abliterated-uncensored
# Qwen3.8-27B
> [!Note]
> This repository contains model weights and configuration files for the post-trained model in the Hugging Face Transformers format.
>
> These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, TokenSpeed, etc.
> [!Tip]
> For users seeking managed, scalable inference without infrastructure maintenance, the official Qwen API service is provided by Qwen Cloud.
> In particular, **Qwen3.8-27B** will be available as a hosted version with more production features, e.g., 1M context length by default, official built-in tools. For more information, please refer to the Qwen3.8-27B Overview. The service is coming soon. Stay tuned for updates.
Following the widespread community adoption of the Qwen3.5 and Qwen3.6 series, we are pleased to introduce Qwen3.8, the most capable generation in the Qwen open-model family to date.
...
Repository: localaiLicense: apache-2.0
carbon-3b-q4
Carbon-3B is Hugging Face's 3B-parameter genomic foundation model for DNA
and RNA sequence generation, recovery, variant-effect prediction, and
motif-perturbation analysis. It supports 32,768 tokens natively and uses a
hybrid tokenizer with 6-mer DNA tokens.
This default entry uses the Q4_K_M GGUF. A higher-quality Q8_0 build is
available as a variant. Prefix DNA sequences with `` and use uppercase
A, C, G, and T characters in groups of six.
Repository: localaiLicense: apache-2.0
carbon-8b-q4
Carbon-8B is the largest model in Hugging Face's Carbon family of genomic
foundation models. It targets DNA and RNA sequence generation, recovery,
variant-effect prediction, and motif-perturbation analysis with a native
context length of 32,768 hybrid 6-mer DNA tokens.
This default entry uses the Q4_K_M GGUF. A higher-quality Q8_0 build is
available as a variant. Prefix DNA sequences with `` and use uppercase
A, C, G, and T characters in groups of six.
Repository: localaiLicense: apache-2.0
ornith-1.0-9b-q4
Ornith-1.0-9B is an MIT-licensed Qwen3.5 model from Ornith AI for
agentic coding, reasoning, repository-level software tasks, and tool use.
It supports text and image input with a context window of 262K tokens.
This default entry uses the Q4_K_M GGUF and F16 vision projector. A
higher-quality Q8_0 model is available as a variant.
Repository: localaiLicense: mit
ornith-1.5-9b-q4
Ornith-1.5-9B is an MIT-licensed Qwen3.5 model from Ornith AI for
agentic coding, reasoning, repository-level software tasks, and tool use.
It supports text and image input with a context window of 262K tokens.
This default entry uses the Q4_K_M GGUF and BF16 vision projector. A
higher-quality Q8_0 model is available as a variant.
Repository: localaiLicense: mit
qwen3.8-27b-q4
Qwen3.8-27B is Qwen's dense 27B vision-language model for reasoning,
coding, tool use, and long-running agent tasks. It accepts text, images,
and video, and it supports a native context window of 262K tokens.
This default entry uses the official Q4_K_M GGUF and Q8_0 vision
projector. The linked variants add MTP speculative decoding or use the
higher-quality Q8_0 model.
Repository: localaiLicense: apache-2.0
qwen3.8-9b-q4
Qwen3.8-9B is Empero AI's full-parameter distillation of Qwen3.8 2.4T
A95B into the dense Qwen3.5-9B architecture. It targets reasoning,
mathematics, coding, instruction following, and tool use, and supports a
native 262K-token context window. This default entry uses Q4_K_M weights;
a higher-quality Q8_0 build is available as a variant.
Repository: localaiLicense: apache-2.0
qwen3.8-4b-q4
Qwen3.8-4B is Empero AI's full-parameter distillation of Qwen3.8 2.4T
A95B into the Qwen3.5-4B architecture. It targets mathematics, reasoning,
instruction following, and tool use with a native 262K-token context
window. This default entry uses Q4_K_M weights; a higher-quality Q8_0
build is available as a variant.
Repository: localaiLicense: apache-2.0
qwen3.8-2b-q4
Qwen3.8-2B is Empero AI's smallest Qwen3.8 reasoning distillation. It uses
the Qwen3.5-2B architecture and targets mathematics, instruction
following, tool use, and edge deployment with a native 262K-token context
window. This default entry uses Q4_K_M weights; a higher-quality Q8_0
build is available as a variant.
Repository: localaiLicense: apache-2.0
twil-lm3-q4
TwIL-LM3 is a 3B SmolLM3-based reasoning model specialized for formal
logic, entailment, semantic parsing, and Lean formalization. This default
entry uses the publisher's recommended Q4_K_M GGUF and supports a 65K-token
context window. A higher-quality Q8_0 build is available as a variant.
Repository: localaiLicense: webai-non-commercial-license-ver.-1.0
qwen3.5-9b-defiant-fable-mtp
Qwen3.5 9B Defiant Fable is an Apache-2.0 multimodal fine-tune for
reasoning, coding, creative writing, and roleplay. It retains the 256K
context window and vision support of Qwen3.5 while reducing refusals.
This default entry uses the NEO-imatrix Q4_K_M build with multi-token
prediction enabled for faster generation.
Repository: localaiLicense: apache-2.0
qwopus3.6-27b-fusion
Qwopus3.6-27B Fusion is an experimental Qwen3.6-27B merge that combines
reasoning and code-execution fine-tunes. It targets agentic coding,
mathematics, tool use, and long-context work while retaining image input.
This default entry uses the Q4_K_M GGUF quantization and the shared Q8_0
vision projector.
Repository: localaiLicense: qwen
tess-4-27b
Tess-4-27B is an Apache-2.0 agentic and reasoning model built on
Qwen3.6-27B. It scales its thinking depth to the task and supports tool
use, long-context work, and image input. This default entry uses the
Q4_K_M GGUF quantization and the shared F16 vision projector.
Repository: localaiLicense: apache-2.0
qwen3.6-14b-a3b-fablevibes
Qwen3.6-14B-A3B-FableVibes is an Apache-2.0 mixture-of-experts reasoning
model distilled from Fable 5 and Claude Opus traces, with additional tool
calling and coding data. It retains Qwen 3.6 vision support while pruning
the 35B-A3B base to a 14B consumer-oriented footprint. This default entry
uses the recommended Q4_K_M GGUF quantization and its Q8_0 multimodal
projector.
Repository: localaiLicense: apache-2.0
laguna-xs-2.1
Laguna XS 2.1 is Poolside's 33B-parameter, 3B-active Mixture-of-Experts model for agentic coding and long-horizon work on local machines. It supports tool use, interleaved reasoning, and a native 262K-token context window. This default entry uses the official 20.3 GB Q4_K_M GGUF.
License: OpenMDW 1.1.
Repository: localaiLicense: other
laguna-s-2.1
Laguna S 2.1 is Poolside's 118B-parameter, 8B-active Mixture-of-Experts model for agentic software engineering. It supports tool use and a native one-million-token context window; the official GGUF recommends 256K context for best output quality. This default entry uses the current 96 GB Q4_K_M artifact, with imatrix-quantized routed experts and a Q8_0 signal path.
License: OpenMDW 1.1.
Repository: localaiLicense: other
secret-filter
A pattern-based PII detector for high-entropy, highly-regular secrets —
API keys, tokens, and private-key blocks — that the NER tier cannot catch
(it has no credential class, so it fragments a key and may leave the secret
part exposed). Detection is bounded restricted-regex compiled to RE2
(linear time, no backtracking); it runs entirely in-process with no model
download, no backend, and zero VRAM.
Install it, then reference it under another model's pii.detectors (or set it
as the instance-wide default detector on the Middleware page) to block leaks
of known credential formats out of the box. Add your own patterns under
pii_detection.patterns in a restricted regex subset (e.g. "tok-\\w{32,}");
each must carry a fixed literal anchor of at least 3 characters, so open-
ended shapes like email addresses are rejected and left to the NER tier.
Repository: localaiLicense: apache-2.0
qwen3.5-27b-claude-4.6-opus-reasoning-distilled-heretic-i1
Repository: localaiLicense: apache-2.0
Page 1