llama3-groq-tool-use

A series of models from Groq that represent a significant advancement in open-source AI capabilities for tool use/function calling.

Araç Kullanımı 8b 70b
Hızlı Kurulum (Ollama kuruluysa)
ollama run llama3-groq-tool-use

Ollama kurulu değil mi? ollama.com/download — Windows, macOS ve Linux için ücretsiz. İlk çalıştırmada model indirilir, sonrası tamamen çevrimdışıdır.

Varyantlar

Boyut büyüdükçe kalite artar, donanım ihtiyacı yükselir. Başlangıç için küçük varyantı deneyin.

EtiketBoyutBağlamGirdiKomut
latest 4.7GB 8K Text ollama run llama3-groq-tool-use:latest
8b 4.7GB 8K Text ollama run llama3-groq-tool-use:8b
70b 40GB 8K Text ollama run llama3-groq-tool-use:70b
8b-q2_K 3.2GB 8K Text ollama run llama3-groq-tool-use:8b-q2_K
8b-q3_K_S 3.7GB 8K Text ollama run llama3-groq-tool-use:8b-q3_K_S
8b-q3_K_M 4.0GB 8K Text ollama run llama3-groq-tool-use:8b-q3_K_M
8b-q3_K_L 4.3GB 8K Text ollama run llama3-groq-tool-use:8b-q3_K_L
8b-q4_0 4.7GB 8K Text ollama run llama3-groq-tool-use:8b-q4_0
8b-q4_1 5.1GB 8K Text ollama run llama3-groq-tool-use:8b-q4_1
8b-q4_K_S 4.7GB 8K Text ollama run llama3-groq-tool-use:8b-q4_K_S
8b-q4_K_M 4.9GB 8K Text ollama run llama3-groq-tool-use:8b-q4_K_M
8b-q5_0 5.6GB 8K Text ollama run llama3-groq-tool-use:8b-q5_0
8b-q5_1 6.1GB 8K Text ollama run llama3-groq-tool-use:8b-q5_1
8b-q5_K_S 5.6GB 8K Text ollama run llama3-groq-tool-use:8b-q5_K_S
8b-q5_K_M 5.7GB 8K Text ollama run llama3-groq-tool-use:8b-q5_K_M
8b-q6_K 6.6GB 8K Text ollama run llama3-groq-tool-use:8b-q6_K
8b-q8_0 8.5GB 8K Text ollama run llama3-groq-tool-use:8b-q8_0
8b-fp16 16GB 8K Text ollama run llama3-groq-tool-use:8b-fp16
70b-q2_K 26GB 8K Text ollama run llama3-groq-tool-use:70b-q2_K
70b-q3_K_S 31GB 8K Text ollama run llama3-groq-tool-use:70b-q3_K_S
70b-q3_K_M 34GB 8K Text ollama run llama3-groq-tool-use:70b-q3_K_M
70b-q3_K_L 37GB 8K Text ollama run llama3-groq-tool-use:70b-q3_K_L
70b-q4_0 40GB 8K Text ollama run llama3-groq-tool-use:70b-q4_0
70b-q4_1 44GB 8K Text ollama run llama3-groq-tool-use:70b-q4_1
70b-q4_K_S 40GB 8K Text ollama run llama3-groq-tool-use:70b-q4_K_S

8 varyant daha var — tümü için ollama.com.

Model Detayları ve Benchmarklar (kaynak: ollama.com)

These models, developed in collaboration with Glaive, represent a significant advancement in open-source AI capabilities for tool use/function calling.

Benchmark Results

These models have achieved remarkable results, setting new benchmarks for Large Language Models with tool use capabilities:

  • Llama-3-Groq-70B-Tool-Use: 90.76% overall accuracy (#1 on BFCL at the time of publishing - July 2024)
  • Llama-3-Groq-8B-Tool-Use: 89.06% overall accuracy (#3 on BFCL at the time of publishing - July 2024)

References

Hugging Face

Blog