Yz

granite4

Granite 4 features improved instruction following (IF) and tool-calling capabilities, making them more effective in enterprise applications.

Araç Kullanımı 350m 1b 3b
Hızlı Kurulum (Ollama kuruluysa) 
ollama run granite4

Ollama kurulu değil mi? ollama.com/download — Windows, macOS ve Linux için ücretsiz. İlk çalıştırmada model indirilir, sonrası tamamen çevrimdışıdır.

Varyantlar

Boyut büyüdükçe kalite artar, donanım ihtiyacı yükselir. Başlangıç için küçük varyantı deneyin.

EtiketBoyutBağlamGirdiKomut
latest 2.1GB 128K Text ollama run granite4:latest
micro 2.1GB 128K Text ollama run granite4:micro
350m 708MB 32K Text ollama run granite4:350m
1b 3.3GB 128K Text ollama run granite4:1b
3b 2.1GB 128K Text ollama run granite4:3b
350m-h 366MB 1M Text ollama run granite4:350m-h
350m-h-q8_0 366MB 1M Text ollama run granite4:350m-h-q8_0
350m-bf16 708MB 32K Text ollama run granite4:350m-bf16
1b-h 1.6GB 1M Text ollama run granite4:1b-h
1b-h-q8_0 1.6GB 1M Text ollama run granite4:1b-h-q8_0
1b-bf16 3.3GB 128K Text ollama run granite4:1b-bf16
3b-h 1.9GB 1M Text ollama run granite4:3b-h
7b-a1b-h 4.2GB 1M Text ollama run granite4:7b-a1b-h
32b-a9b-h 19GB 1M Text ollama run granite4:32b-a9b-h
micro-h 1.9GB 1M Text ollama run granite4:micro-h
small-h 19GB 1M Text ollama run granite4:small-h
tiny-h 4.2GB 1M Text ollama run granite4:tiny-h

Model Detayları ve Benchmarklar (kaynak: ollama.com)

Granite 4.0 models

Granite 4.0 models are finetuned from their base models using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets. They feature improved instruction following (IF) and tool-calling capabilities, making them more effective in enterprise applications.

Please Note: the 3b, 1b, and 350m model sizes are alternative options for users when mamba-2 support is not yet optimized. Models denoted -h use the hybrid mamba-2 architecture.

Parameter Sizes

350m

ollama run granite4:350m

350m-h

ollama run granite4:350m-h

1b

ollama run granite4:1b

1b-h

ollama run granite4:1b-h

3b (micro)

ollama run granite4:3b
ollama run granite4:micro

3b-h (micro-h)

ollama run granite4:3b-h
ollama run granite4:micro-h

7b-a1b-h (tiny-h)

ollama run granite4:7b-a1b-h
ollama run granite4:tiny-h

32b-a9b-h (small-h)

ollama run granite4:32b-a9b-h
ollama run granite4:small-h

Supported Languages

English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese. Users may finetune Granite 4.0 models for languages beyond these languages.

Intended Use

This model is designed to handle general instruction-following tasks and can be integrated into AI assistants across various domains, including business applications.

Capabilities

  • Summarization
  • Text classification
  • Text extraction
  • Question-answering
  • Retrieval Augmented Generation (RAG)
  • Code related tasks
  • Function-calling tasks
  • Multilingual dialog use cases
  • Fill-In-the-Middle (FIM) code completions

Learn more