llama3.2-vision

Llama 3.2 Vision is a collection of instruction-tuned image reasoning generative models in 11B and 90B sizes.

Görüntü 11b 90b
Hızlı Kurulum (Ollama kuruluysa)
ollama run llama3.2-vision

Ollama kurulu değil mi? ollama.com/download — Windows, macOS ve Linux için ücretsiz. İlk çalıştırmada model indirilir, sonrası tamamen çevrimdışıdır.

Varyantlar

Boyut büyüdükçe kalite artar, donanım ihtiyacı yükselir. Başlangıç için küçük varyantı deneyin.

EtiketBoyutBağlamGirdiKomut
latest 7.8GB 128K Text, Image ollama run llama3.2-vision:latest
11b 7.8GB 128K Text, Image ollama run llama3.2-vision:11b
90b 55GB 128K Text, Image ollama run llama3.2-vision:90b
11b-instruct-q4_K_M 7.8GB 128K Text, Image ollama run llama3.2-vision:11b-instruct-q4_K_M
11b-instruct-q8_0 12GB 128K Text, Image ollama run llama3.2-vision:11b-instruct-q8_0
11b-instruct-fp16 21GB 128K Text, Image ollama run llama3.2-vision:11b-instruct-fp16
90b-instruct-q4_K_M 55GB 128K Text, Image ollama run llama3.2-vision:90b-instruct-q4_K_M
90b-instruct-q8_0 95GB 128K Text, Image ollama run llama3.2-vision:90b-instruct-q8_0
90b-instruct-fp16 177GB 128K Text, Image ollama run llama3.2-vision:90b-instruct-fp16

Model Detayları ve Benchmarklar (kaynak: ollama.com)

The Llama 3.2-Vision collection of multimodal large language models (LLMs) is a collection of instruction-tuned image reasoning generative models in 11B and 90B sizes (text + images in / text out). The Llama 3.2-Vision instruction-tuned models are optimized for visual recognition, image reasoning, captioning, and answering general questions about an image. The models outperform many of the available open source and closed multimodal models on common industry benchmarks.

Supported Languages: For text only tasks, English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai are officially supported. Llama 3.2 has been trained on a broader collection of languages than these 8 supported languages. Note for image+text applications, English is the only language supported.

Usage

First, pull the model:

ollama pull llama3.2-vision

Python Library

To use Llama 3.2 Vision with the Ollama Python library:

import ollama

response = ollama.chat(
    model='llama3.2-vision',
    messages=[{
        'role': 'user',
        'content': 'What is in this image?',
        'images': ['image.jpg']
    }]
)

print(response)

JavaScript Library

To use Llama 3.2 Vision with the Ollama JavaScript library:

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'llama3.2-vision',
  messages: [{
    role: 'user',
    content: 'What is in this image?',
    images: ['image.jpg']
  }]
})

console.log(response)

cURL

curl http://localhost:11434/api/chat -d '{
  "model": "llama3.2-vision",
  "messages": [
    {
      "role": "user",
      "content": "what is in this image?",
      "images": ["<base64-encoded image data>"]
    }
  ]
}'

References

GitHub

HuggingFace