Modèles et recommandations
GGUF Bridge aide à choisir un fichier GGUF adapté à votre PC. L’application télécharge ensuite le fichier directement depuis Hugging Face.
Aucun fichier GGUF n’est hébergé par GGUF Bridge.
Comprendre Q4, Q5, Q6
Q4
Plus léger et plus rapide. Bon choix pour tester un modèle ou pour une machine modeste.
Q5
Équilibre recommandé entre qualité, vitesse et mémoire.
Q6 / Q8
Meilleure qualité, mais plus gourmand en RAM ou VRAM.
Recommandations par type de PC
PC faibleQ3_K_M ou Q4_0 sur modèles légers 1B-3B
PC sans GPUQ4_K_M si RAM suffisante, sinon Q3_K_M
GPU 8 GoQ4_K_M ou Q5_K_M sur modèles 7B-8B
GPU 12 GoQ5_K_M recommandé, Q6_K possible selon taille
GPU 16 Go+Q6_K ou Q8_0 pour privilégier la qualité
Rédaction françaiseMistral, Gemma ou Qwen instruct en Q4_K_M/Q5_K_M
CodeQwen Coder, StarCoder ou CodeLlama en Q4_K_M/Q5_K_M
Modèles légers1B-4B en Q4_K_M pour démarrage rapide
Exemples de fichiers GGUF
| Repo | Fichier | Quantization | Taille | Famille |
|---|---|---|---|---|
| huihui-ai/Huihui-GLM-5.2-abliterated-GGUF | UD-IQ1_M/GLM-5.2-UD-IQ1_M-00005-of-00006.gguf | IQ1_M | 47.15 Go | |
| huihui-ai/Huihui-GLM-5.2-abliterated-GGUF | UD-IQ1_M/GLM-5.2-UD-IQ1_M-00003-of-00006.gguf | IQ1_M | 46.23 Go | |
| huihui-ai/Huihui-GLM-5.2-abliterated-GGUF | UD-IQ1_M/GLM-5.2-UD-IQ1_M-00002-of-00006.gguf | IQ1_M | 46.18 Go | |
| huihui-ai/Huihui-GLM-5.2-abliterated-GGUF | UD-IQ1_M/GLM-5.2-UD-IQ1_M-00004-of-00006.gguf | IQ1_M | 46.14 Go | |
| huihui-ai/Huihui-GLM-5.2-abliterated-GGUF | UD-IQ1_M/GLM-5.2-UD-IQ1_M-00006-of-00006.gguf | IQ1_M | 29.64 Go | |
| huihui-ai/Huihui-GLM-5.2-abliterated-GGUF | UD-IQ1_M/GLM-5.2-UD-IQ1_M-00001-of-00006.gguf | IQ1_M | 0.01 Go | |
| hotdogs/andrevp_Ornith-1.0-9B-Heretic-Uncensored_GGUF | Ornith-1.0-9B-Heretic-Uncensored-Q4_K_M.gguf | Q4_K_M | 5.24 Go | 9B |
| zaakirio/Ornith-1.0-9B-uncensored-GGUF | ornith-1.0-9b-uncensored-f16.gguf | F16 | 16.69 Go | 9B |
| zaakirio/Ornith-1.0-9B-uncensored-GGUF | ornith-1.0-9b-uncensored-Q8_0.gguf | Q8_0 | 8.87 Go | 9B |
| zaakirio/Ornith-1.0-9B-uncensored-GGUF | ornith-1.0-9b-uncensored-Q6_K.gguf | Q6_K | 6.85 Go | 9B |
| zaakirio/Ornith-1.0-9B-uncensored-GGUF | ornith-1.0-9b-uncensored-Q4_K_M.gguf | Q4_K_M | 5.24 Go | 9B |
| QuantStack/Wan2.2-TI2V-5B-GGUF | Wan2.2-TI2V-5B-Q2_K.gguf | Q2_K | 1.73 Go | 5B |
| QuantStack/Wan2.2-TI2V-5B-GGUF | Wan2.2-TI2V-5B-Q5_1.gguf | Q5_1 | 3.6 Go | 5B |
| QuantStack/Wan2.2-TI2V-5B-GGUF | Wan2.2-TI2V-5B-Q5_0.gguf | Q5_0 | 3.39 Go | 5B |
| QuantStack/Wan2.2-TI2V-5B-GGUF | Wan2.2-TI2V-5B-Q4_1.gguf | Q4_1 | 3.03 Go | 5B |
| QuantStack/Wan2.2-TI2V-5B-GGUF | Wan2.2-TI2V-5B-Q4_0.gguf | Q4_0 | 2.82 Go | 5B |
| QuantStack/Wan2.2-TI2V-5B-GGUF | Wan2.2-TI2V-5B-Q3_K_S.gguf | Q3_K_S | 2.14 Go | 5B |
| QuantStack/Wan2.2-TI2V-5B-GGUF | Wan2.2-TI2V-5B-Q8_0.gguf | Q8_0 | 5.03 Go | 5B |
| QuantStack/Wan2.2-TI2V-5B-GGUF | Wan2.2-TI2V-5B-Q3_K_M.gguf | Q3_K_M | 2.37 Go | 5B |
| QuantStack/Wan2.2-TI2V-5B-GGUF | Wan2.2-TI2V-5B-Q6_K.gguf | Q6_K | 3.92 Go | 5B |
| QuantStack/Wan2.2-TI2V-5B-GGUF | Wan2.2-TI2V-5B-Q5_K_S.gguf | Q5_K_S | 3.32 Go | 5B |
| QuantStack/Wan2.2-TI2V-5B-GGUF | Wan2.2-TI2V-5B-Q4_K_S.gguf | Q4_K_S | 2.9 Go | 5B |
| QuantStack/Wan2.2-TI2V-5B-GGUF | Wan2.2-TI2V-5B-Q5_K_M.gguf | Q5_K_M | 3.55 Go | 5B |
| QuantStack/Wan2.2-TI2V-5B-GGUF | Wan2.2-TI2V-5B-Q4_K_M.gguf | Q4_K_M | 3.2 Go | 5B |
| PaddlePaddle/PaddleOCR-VL-1.6-GGUF | PaddleOCR-VL-1.6-GGUF-mmproj.gguf | UNKNOWN | 0.0 Go | |
| PaddlePaddle/PaddleOCR-VL-1.6-GGUF | PaddleOCR-VL-1.6-GGUF.gguf | UNKNOWN | 0.87 Go | |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-Q2_K_L.gguf | Q2_K | 0.08 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-Q2_K.gguf | Q2_K | 0.08 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-f16.gguf | F16 | 0.25 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-Q5_K_L.gguf | Q5_K_L | 0.1 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-Q4_K_L.gguf | Q4_K_L | 0.1 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-Q4_0_8_8.gguf | Q4_0 | 0.09 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-Q4_0_4_8.gguf | Q4_0 | 0.09 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-Q4_0_4_4.gguf | Q4_0 | 0.09 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-Q4_0.gguf | Q4_0 | 0.09 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-Q3_K_XL.gguf | Q3_K_XL | 0.09 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-Q3_K_L.gguf | Q3_K_L | 0.09 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-Q3_K_S.gguf | Q3_K_S | 0.08 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-IQ4_XS.gguf | IQ4_XS | 0.08 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-IQ3_XS.gguf | IQ3_XS | 0.08 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-IQ3_M.gguf | IQ3_M | 0.08 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-Q8_0.gguf | Q8_0 | 0.13 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-Q3_K_M.gguf | Q3_K_M | 0.09 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-Q6_K_L.gguf | Q6_K | 0.13 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-Q6_K.gguf | Q6_K | 0.13 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-Q5_K_S.gguf | Q5_K_S | 0.1 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-Q4_K_S.gguf | Q4_K_S | 0.1 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-Q5_K_M.gguf | Q5_K_M | 0.1 Go | 135M |
| bartowski/SmolLM2-135M-Instruct-GGUF | SmolLM2-135M-Instruct-Q4_K_M.gguf | Q4_K_M | 0.1 Go | 135M |