DeepSeek-R1-Distill-Qwen-14B Q4_K_M GGUF for Docker Model Runner (chat)
25
DeepSeek-R1 reasoning distilled into Qwen2.5-14B. It thinks before answering, so first replies are slow.
docker model pull baransels/deepseek-r1-distill-qwen-14b:Q4_K_M
docker model run baransels/deepseek-r1-distill-qwen-14b:Q4_K_M "How many prime numbers are there below 50?"
| Original model | GGUF | Licence |
|---|---|---|
| deepseek-ai/DeepSeek-R1-Distill-Qwen-14Bโ | unsloth/DeepSeek-R1-Distill-Qwen-14B-GGUFโ | MIT (base model Qwen2.5-14B is Apache-2.0) |
Not an official artifact. Packaged by Baransel Sagindaโ .
Content type
Model
Digest
sha256:ff6cff3e0โฆ
Size
8.4 GB
Last updated
about 15 hours ago
docker model pull baransels/deepseek-r1-distill-qwen-14b:Q4_K_M