granite3.2

Granite-3.2 is a family of long-context AI models from IBM Granite fine-tuned for thinking capabilities.

Araç Kullanımı 2b 8b
Hızlı Kurulum (Ollama kuruluysa)
ollama run granite3.2

Ollama kurulu değil mi? ollama.com/download — Windows, macOS ve Linux için ücretsiz. İlk çalıştırmada model indirilir, sonrası tamamen çevrimdışıdır.

Varyantlar

Boyut büyüdükçe kalite artar, donanım ihtiyacı yükselir. Başlangıç için küçük varyantı deneyin.

EtiketBoyutBağlamGirdiKomut
latest 4.9GB 128K Text ollama run granite3.2:latest
2b 1.5GB 128K Text ollama run granite3.2:2b
8b 4.9GB 128K Text ollama run granite3.2:8b
2b-instruct-q4_K_M 1.5GB 128K Text ollama run granite3.2:2b-instruct-q4_K_M
2b-instruct-q8_0 2.7GB 128K Text ollama run granite3.2:2b-instruct-q8_0
2b-instruct-fp16 5.1GB 128K Text ollama run granite3.2:2b-instruct-fp16
8b-instruct-q4_K_M 4.9GB 128K Text ollama run granite3.2:8b-instruct-q4_K_M
8b-instruct-q8_0 8.7GB 128K Text ollama run granite3.2:8b-instruct-q8_0
8b-instruct-fp16 16GB 128K Text ollama run granite3.2:8b-instruct-fp16

Model Detayları ve Benchmarklar (kaynak: ollama.com)

Granite-3.2 is a family of long-context AI models fine-tuned for thinking capabilities. Built on top of Granite-3.1, it has been trained using a mix of permissively licensed open-source datasets and internally generated synthetic data designed for reasoning tasks. The models allow controllability of its thinking capability, ensuring it is applied only when required.

Sizes

The models are available in two parameter sizes, 2B and 8B:

ollama run granite3.2:2b
ollama run granite3.2:8b

Supported Languages: English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese. However, users may finetune this Granite model for languages beyond these 12 languages.

Intended Use: These models are designed to handle general instruction-following tasks and can be integrated into AI assistants across various domains, including business applications.

Capabilities

  • Thinking
  • Summarization
  • Text classification
  • Text extraction
  • Question-answering
  • Retrieval Augmented Generation (RAG)
  • Code related tasks
  • Function-calling tasks
  • Multilingual dialog use cases
  • Long-context tasks including long document/meeting summarization, long document QA, etc.

Thinking

To enable thinking, add a message with "role": "control" and set "content" to "thinking". For example:

{
    "messages": [
        {"role": "control", "content": "thinking"},
        {"role": "user", "content": "How do I get to the airport if my car won't start?"}
    ]
}

References

Website