This quantization was uploaded on 2026-05-21 and replaces a previous version. If you downloaded this model before this date, please re-download for the updated weights.

Qwen3.6-27B-oQ6-fp16-mtp

This model was quantized using oQ (oMLX v0.3.9rc1) mixed-precision quantization.

Quantization details

  • Model type: qwen3_5
  • Bits: 6
  • Group size: 64
  • Format: MLX safetensors

系統提示詞 (System prompt)

第一行必須是: (The first line must be:)

你是一個專業的助手,請以繁體中文思考,繁體中文回覆。
(You are a professional assistant. Please think and reply in Traditional Chinese.)

沒有它,這個模型表現會不佳。您可以在此行之後添加任何內容。 (The model underperforms without it. Append anything after that line.)


建議設定

image image


Downloads last month
2,286
Safetensors
Model size
7B params
Tensor type
F16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

6-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for gn00029914/Qwen3.6-27B-oQ6-fp16-mtp

Base model

Qwen/Qwen3.6-27B
Quantized
(392)
this model