Sign inSign up

baransels/deepseek-r1-distill-qwen-32b

By baransels

•Updated 1 day ago

DeepSeek-R1-Distill-Qwen-32B Q4_K_M GGUF for Docker Model Runner (chat)

Model
0

48

baransels/deepseek-r1-distill-qwen-32b repository overview

⁠DeepSeek-R1-Distill-Qwen-32B · Q4_K_M

DeepSeek-R1 reasoning distilled into Qwen2.5-32B. It thinks before answering, so first replies are slow.

docker model pull baransels/deepseek-r1-distill-qwen-32b:Q4_K_M
docker model run baransels/deepseek-r1-distill-qwen-32b:Q4_K_M "How many prime numbers are there below 50?"
Original modelGGUFLicence
deepseek-ai/DeepSeek-R1-Distill-Qwen-32B⁠unsloth/DeepSeek-R1-Distill-Qwen-32B-GGUF⁠MIT (base model Qwen2.5-32B is Apache-2.0)

Not an official artifact. Packaged by Baransel Saginda⁠.

Tag summary

Content type

Model

Digest

sha256:2022cd331…

Size

18.5 GB

Last updated

1 day ago

docker model pull baransels/deepseek-r1-distill-qwen-32b:Q4_K_M