Yz

solar

A compact, yet powerful 10.7B large language model designed for single-turn conversation.

10.7b
Hızlı Kurulum (Ollama kuruluysa) 
ollama run solar

Ollama kurulu değil mi? ollama.com/download — Windows, macOS ve Linux için ücretsiz. İlk çalıştırmada model indirilir, sonrası tamamen çevrimdışıdır.

Varyantlar

Boyut büyüdükçe kalite artar, donanım ihtiyacı yükselir. Başlangıç için küçük varyantı deneyin.

EtiketBoyutBağlamGirdiKomut
latest 6.1GB 4K Text ollama run solar:latest
10.7b 6.1GB 4K Text ollama run solar:10.7b
10.7b-instruct-v1-q2_K 4.5GB 4K Text ollama run solar:10.7b-instruct-v1-q2_K
10.7b-instruct-v1-q3_K_S 4.7GB 4K Text ollama run solar:10.7b-instruct-v1-q3_K_S
10.7b-instruct-v1-q3_K_M 5.2GB 4K Text ollama run solar:10.7b-instruct-v1-q3_K_M
10.7b-instruct-v1-q3_K_L 5.7GB 4K Text ollama run solar:10.7b-instruct-v1-q3_K_L
10.7b-instruct-v1-q4_0 6.1GB 4K Text ollama run solar:10.7b-instruct-v1-q4_0
10.7b-instruct-v1-q4_1 6.7GB 4K Text ollama run solar:10.7b-instruct-v1-q4_1
10.7b-instruct-v1-q4_K_S 6.1GB 4K Text ollama run solar:10.7b-instruct-v1-q4_K_S
10.7b-instruct-v1-q4_K_M 6.5GB 4K Text ollama run solar:10.7b-instruct-v1-q4_K_M
10.7b-instruct-v1-q5_0 7.4GB 4K Text ollama run solar:10.7b-instruct-v1-q5_0
10.7b-instruct-v1-q5_1 8.1GB 4K Text ollama run solar:10.7b-instruct-v1-q5_1
10.7b-instruct-v1-q5_K_S 7.4GB 4K Text ollama run solar:10.7b-instruct-v1-q5_K_S
10.7b-instruct-v1-q5_K_M 7.6GB 4K Text ollama run solar:10.7b-instruct-v1-q5_K_M
10.7b-instruct-v1-q6_K 8.8GB 4K Text ollama run solar:10.7b-instruct-v1-q6_K
10.7b-instruct-v1-q8_0 11GB 4K Text ollama run solar:10.7b-instruct-v1-q8_0
10.7b-instruct-v1-fp16 21GB 4K Text ollama run solar:10.7b-instruct-v1-fp16
10.7b-text-v1-q2_K 4.5GB 4K Text ollama run solar:10.7b-text-v1-q2_K
10.7b-text-v1-q3_K_S 4.7GB 4K Text ollama run solar:10.7b-text-v1-q3_K_S
10.7b-text-v1-q3_K_M 5.2GB 4K Text ollama run solar:10.7b-text-v1-q3_K_M
10.7b-text-v1-q3_K_L 5.7GB 4K Text ollama run solar:10.7b-text-v1-q3_K_L
10.7b-text-v1-q4_0 6.1GB 4K Text ollama run solar:10.7b-text-v1-q4_0
10.7b-text-v1-q4_1 6.7GB 4K Text ollama run solar:10.7b-text-v1-q4_1
10.7b-text-v1-q4_K_S 6.1GB 4K Text ollama run solar:10.7b-text-v1-q4_K_S
10.7b-text-v1-q4_K_M 6.5GB 4K Text ollama run solar:10.7b-text-v1-q4_K_M

7 varyant daha var — tümü için ollama.com.

Model Detayları ve Benchmarklar (kaynak: ollama.com)

Solar is the first open-source 10.7 billion parameter language model. It’s compact, yet remarkably powerful, and demonstrates state-of-the-art performance in models with parameters under 30B.

This model leverages the Llama 2 architecture and employs the Depth Up-Scaling technique, integrating Mistral 7B weights into upscaled layers.

On the H6 benchmark, this model outperforms models with up to 30B parameters, even the Mixtral 8X7B model.

References

HuggingFace

Upstage AI