llama2-uncensored

Uncensored Llama 2 model by George Sung and Jarrad Hope.

7b 70b
Hızlı Kurulum (Ollama kuruluysa)
ollama run llama2-uncensored

Ollama kurulu değil mi? ollama.com/download — Windows, macOS ve Linux için ücretsiz. İlk çalıştırmada model indirilir, sonrası tamamen çevrimdışıdır.

Varyantlar

Boyut büyüdükçe kalite artar, donanım ihtiyacı yükselir. Başlangıç için küçük varyantı deneyin.

EtiketBoyutBağlamGirdiKomut
latest 3.8GB 2K Text ollama run llama2-uncensored:latest
7b 3.8GB 2K Text ollama run llama2-uncensored:7b
70b 39GB 2K Text ollama run llama2-uncensored:70b
7b-chat 3.8GB 2K Text ollama run llama2-uncensored:7b-chat
7b-chat-q2_K 2.8GB 2K Text ollama run llama2-uncensored:7b-chat-q2_K
7b-chat-q3_K_S 2.9GB 2K Text ollama run llama2-uncensored:7b-chat-q3_K_S
7b-chat-q3_K_M 3.3GB 2K Text ollama run llama2-uncensored:7b-chat-q3_K_M
7b-chat-q3_K_L 3.6GB 2K Text ollama run llama2-uncensored:7b-chat-q3_K_L
7b-chat-q4_0 3.8GB 2K Text ollama run llama2-uncensored:7b-chat-q4_0
7b-chat-q4_1 4.2GB 2K Text ollama run llama2-uncensored:7b-chat-q4_1
7b-chat-q4_K_S 3.9GB 2K Text ollama run llama2-uncensored:7b-chat-q4_K_S
7b-chat-q4_K_M 4.1GB 2K Text ollama run llama2-uncensored:7b-chat-q4_K_M
7b-chat-q5_0 4.7GB 2K Text ollama run llama2-uncensored:7b-chat-q5_0
7b-chat-q5_1 5.1GB 2K Text ollama run llama2-uncensored:7b-chat-q5_1
7b-chat-q5_K_S 4.7GB 2K Text ollama run llama2-uncensored:7b-chat-q5_K_S
7b-chat-q5_K_M 4.8GB 2K Text ollama run llama2-uncensored:7b-chat-q5_K_M
7b-chat-q6_K 5.5GB 2K Text ollama run llama2-uncensored:7b-chat-q6_K
7b-chat-q8_0 7.2GB 2K Text ollama run llama2-uncensored:7b-chat-q8_0
7b-chat-fp16 13GB 2K Text ollama run llama2-uncensored:7b-chat-fp16
70b-chat 39GB 2K Text ollama run llama2-uncensored:70b-chat
70b-chat-q2_K 29GB 2K Text ollama run llama2-uncensored:70b-chat-q2_K
70b-chat-q3_K_S 30GB 2K Text ollama run llama2-uncensored:70b-chat-q3_K_S
70b-chat-q3_K_M 33GB 2K Text ollama run llama2-uncensored:70b-chat-q3_K_M
70b-chat-q3_K_L 36GB 2K Text ollama run llama2-uncensored:70b-chat-q3_K_L
70b-chat-q4_0 39GB 2K Text ollama run llama2-uncensored:70b-chat-q4_0

9 varyant daha var — tümü için ollama.com.

Model Detayları ve Benchmarklar (kaynak: ollama.com)

Llama 2 Uncensored is based on Meta’s Llama 2 model, and was created by George Sung and Jarrad Hope using the process defined by Eric Hartford in his blog post.

CLI

Open the terminal and run ollama run llama2-uncensored

API

Example:

curl -X POST http://localhost:11434/api/generate -d '{
  "model": "llama2-uncensored",
  "prompt":"Write a recipe for dangerously spicy mayo."
 }'

API documentation

Memory requirements

  • 7b models generally require at least 8GB of RAM
  • 70b models generally require at least 64GB of RAM

References

https://erichartford.com/uncensored-models

7b parameters original source: George Sung

70b parameters original source: George Sung