Qwen2.5-72B-Instruct Q4_K_M GGUF for Docker Model Runner (chat)
34
Alibaba Cloud's 72B instruction model, from the Qwen team's own Q4_K_M GGUF.
docker model pull baransels/qwen2.5-72b-instruct:Q4_K_M
docker model run baransels/qwen2.5-72b-instruct:Q4_K_M "Explain containers to a new developer in three sentences."
| Original model | GGUF | Licence |
|---|---|---|
| Qwen/Qwen2.5-72B-Instruct | Qwen/Qwen2.5-72B-Instruct-GGUF | Qwen License (free below 100M monthly active users) |
Not an official artifact. Packaged by Baransel Saginda.
Content type
Model
Digest
sha256:eb64f6c69…
Size
41 GB
Last updated
3 days ago
docker model pull baransels/qwen2.5-72b-instruct:Q4_K_M