zephyr

Zephyr is a series of fine-tuned versions of the Mistral and Mixtral models that are trained to act as helpful assistants.

7b 141b
Hızlı Kurulum (Ollama kuruluysa)
ollama run zephyr

Ollama kurulu değil mi? ollama.com/download — Windows, macOS ve Linux için ücretsiz. İlk çalıştırmada model indirilir, sonrası tamamen çevrimdışıdır.

Varyantlar

Boyut büyüdükçe kalite artar, donanım ihtiyacı yükselir. Başlangıç için küçük varyantı deneyin.

EtiketBoyutBağlamGirdiKomut
latest 4.1GB 32K Text ollama run zephyr:latest
7b 4.1GB 32K Text ollama run zephyr:7b
141b 80GB 64K Text ollama run zephyr:141b
7b-alpha 4.1GB 32K Text ollama run zephyr:7b-alpha
7b-alpha-q2_K 3.1GB 32K Text ollama run zephyr:7b-alpha-q2_K
7b-alpha-q3_K_S 3.2GB 32K Text ollama run zephyr:7b-alpha-q3_K_S
7b-alpha-q3_K_M 3.5GB 32K Text ollama run zephyr:7b-alpha-q3_K_M
7b-alpha-q3_K_L 3.8GB 32K Text ollama run zephyr:7b-alpha-q3_K_L
7b-alpha-q4_0 4.1GB 32K Text ollama run zephyr:7b-alpha-q4_0
7b-alpha-q4_1 4.6GB 32K Text ollama run zephyr:7b-alpha-q4_1
7b-alpha-q4_K_S 4.1GB 32K Text ollama run zephyr:7b-alpha-q4_K_S
7b-alpha-q4_K_M 4.4GB 32K Text ollama run zephyr:7b-alpha-q4_K_M
7b-alpha-q5_0 5.0GB 32K Text ollama run zephyr:7b-alpha-q5_0
7b-alpha-q5_1 5.4GB 32K Text ollama run zephyr:7b-alpha-q5_1
7b-alpha-q5_K_S 5.0GB 32K Text ollama run zephyr:7b-alpha-q5_K_S
7b-alpha-q5_K_M 5.1GB 32K Text ollama run zephyr:7b-alpha-q5_K_M
7b-alpha-q6_K 5.9GB 32K Text ollama run zephyr:7b-alpha-q6_K
7b-alpha-q8_0 7.7GB 32K Text ollama run zephyr:7b-alpha-q8_0
7b-alpha-fp16 14GB 32K Text ollama run zephyr:7b-alpha-fp16
7b-beta 4.1GB 32K Text ollama run zephyr:7b-beta
7b-beta-q2_K 3.1GB 32K Text ollama run zephyr:7b-beta-q2_K
7b-beta-q3_K_S 3.2GB 32K Text ollama run zephyr:7b-beta-q3_K_S
7b-beta-q3_K_M 3.5GB 32K Text ollama run zephyr:7b-beta-q3_K_M
7b-beta-q3_K_L 3.8GB 32K Text ollama run zephyr:7b-beta-q3_K_L
7b-beta-q4_0 4.1GB 32K Text ollama run zephyr:7b-beta-q4_0

15 varyant daha var — tümü için ollama.com.

Model Detayları ve Benchmarklar (kaynak: ollama.com)

Zephyr is a series of language models that are trained to act as helpful assistants. Zephyr 141B-A35B is the latest model in the series, and is a fine-tuned version of Mixtral 8x22b.

Sizes

  • zephyr:141b: A Mixture of Experts (MoE) model with 141B total parameters and 35B active parameters.
  • zephyr:7b: The original Zephyr model

Source: