TinyLlama is a compact model with only 1.1B parameters. This compactness allows it to cater to a multitude of applications demanding a restricted computation and memory footprint.
tinyllama
The TinyLlama project is an open endeavor to train a compact 1.1B Llama model on 3 trillion tokens.
1.1b
Hızlı Kurulum (Ollama kuruluysa)
ollama run tinyllama
Ollama kurulu değil mi? ollama.com/download — Windows, macOS ve Linux için ücretsiz. İlk çalıştırmada model indirilir, sonrası tamamen çevrimdışıdır.
Varyantlar
Boyut büyüdükçe kalite artar, donanım ihtiyacı yükselir. Başlangıç için küçük varyantı deneyin.
| Etiket | Boyut | Bağlam | Girdi | Komut |
|---|---|---|---|---|
| latest | 638MB | 2K | Text |
ollama run tinyllama:latest
|
| chat | 638MB | 2K | Text |
ollama run tinyllama:chat
|
| v0.6 | 638MB | 2K | Text |
ollama run tinyllama:v0.6
|
| v1 | 638MB | 2K | Text |
ollama run tinyllama:v1
|
| 1.1b | 638MB | 2K | Text |
ollama run tinyllama:1.1b
|
| 1.1b-chat | 638MB | 2K | Text |
ollama run tinyllama:1.1b-chat
|
| 1.1b-chat-v0.6-q2_K | 483MB | 2K | Text |
ollama run tinyllama:1.1b-chat-v0.6-q2_K
|
| 1.1b-chat-v0.6-q3_K_S | 500MB | 2K | Text |
ollama run tinyllama:1.1b-chat-v0.6-q3_K_S
|
| 1.1b-chat-v0.6-q3_K_M | 551MB | 2K | Text |
ollama run tinyllama:1.1b-chat-v0.6-q3_K_M
|
| 1.1b-chat-v0.6-q3_K_L | 593MB | 2K | Text |
ollama run tinyllama:1.1b-chat-v0.6-q3_K_L
|
| 1.1b-chat-v0.6-q4_0 | 638MB | 2K | Text |
ollama run tinyllama:1.1b-chat-v0.6-q4_0
|
| 1.1b-chat-v0.6-q4_1 | 702MB | 2K | Text |
ollama run tinyllama:1.1b-chat-v0.6-q4_1
|
| 1.1b-chat-v0.6-q4_K_S | 644MB | 2K | Text |
ollama run tinyllama:1.1b-chat-v0.6-q4_K_S
|
| 1.1b-chat-v0.6-q4_K_M | 669MB | 2K | Text |
ollama run tinyllama:1.1b-chat-v0.6-q4_K_M
|
| 1.1b-chat-v0.6-q5_0 | 767MB | 2K | Text |
ollama run tinyllama:1.1b-chat-v0.6-q5_0
|
| 1.1b-chat-v0.6-q5_1 | 832MB | 2K | Text |
ollama run tinyllama:1.1b-chat-v0.6-q5_1
|
| 1.1b-chat-v0.6-q5_K_S | 767MB | 2K | Text |
ollama run tinyllama:1.1b-chat-v0.6-q5_K_S
|
| 1.1b-chat-v0.6-q5_K_M | 783MB | 2K | Text |
ollama run tinyllama:1.1b-chat-v0.6-q5_K_M
|
| 1.1b-chat-v0.6-q6_K | 904MB | 2K | Text |
ollama run tinyllama:1.1b-chat-v0.6-q6_K
|
| 1.1b-chat-v0.6-q8_0 | 1.2GB | 2K | Text |
ollama run tinyllama:1.1b-chat-v0.6-q8_0
|
| 1.1b-chat-v0.6-fp16 | 2.2GB | 2K | Text |
ollama run tinyllama:1.1b-chat-v0.6-fp16
|
| 1.1b-chat-v1-q2_K | 483MB | 2K | Text |
ollama run tinyllama:1.1b-chat-v1-q2_K
|
| 1.1b-chat-v1-q3_K_S | 500MB | 2K | Text |
ollama run tinyllama:1.1b-chat-v1-q3_K_S
|
| 1.1b-chat-v1-q3_K_M | 551MB | 2K | Text |
ollama run tinyllama:1.1b-chat-v1-q3_K_M
|
| 1.1b-chat-v1-q3_K_L | 593MB | 2K | Text |
ollama run tinyllama:1.1b-chat-v1-q3_K_L
|
11 varyant daha var — tümü için ollama.com.