Orca 2 models are built by Microsoft Research. They are fine-tuned on Meta’s Llama 2 using a synthetic dataset that was created to enhance the small model’s reasoning abilities. All synthetic training data was moderated using Microsoft Azure content filters.
Use case
Orca 2 is a helpful assistant, and provides an answer in tasks such as reasoning over your given data, reading comprehension, math problem solving and text summarization.
The model is designed to excel particularly in reasoning.
Microsoft Research’s intended purpose for this model is to encourage further research on the development, evaluation, and alignment of smaller language models.
CLI
7 billion parameter model:
ollama run orca2
13 billion parameter model:
ollama run orca2:13b
API
Example:
curl -X POST http://localhost:11434/api/generate -d '{
"model": "orca2",
"prompt":"Why is the sky blue?"
}'
References
Microsoft Research published paper, Orca 2: Teaching Small Language Models How to Reason