nemotron-3.5-lightning

NVIDIA Nemotron 3.5 Lightning is an open 30B mixture-of-experts (MoE) model with 3B active parameters built for always-on agents.

Araç Kullanımı Akıl Yürütme 30b
Hızlı Kurulum (Ollama kuruluysa)
ollama run nemotron-3.5-lightning

Ollama kurulu değil mi? ollama.com/download — Windows, macOS ve Linux için ücretsiz. İlk çalıştırmada model indirilir, sonrası tamamen çevrimdışıdır.

Varyantlar

Boyut büyüdükçe kalite artar, donanım ihtiyacı yükselir. Başlangıç için küçük varyantı deneyin.

EtiketBoyutBağlamGirdiKomut
latest 25GB 1M Text ollama run nemotron-3.5-lightning:latest
30b 25GB 1M Text ollama run nemotron-3.5-lightning:30b
30b-a3b 25GB 1M Text ollama run nemotron-3.5-lightning:30b-a3b
30b-a3b-mlx 23GB 256K Text ollama run nemotron-3.5-lightning:30b-a3b-mlx
30b-a3b-mlx-bf16 66GB 256K Text ollama run nemotron-3.5-lightning:30b-a3b-mlx-bf16
30b-a3b-mxfp8 34GB 256K Text ollama run nemotron-3.5-lightning:30b-a3b-mxfp8
30b-a3b-nvfp4 23GB 256K Text ollama run nemotron-3.5-lightning:30b-a3b-nvfp4
30b-a3b-q4_K_M 25GB 1M Text ollama run nemotron-3.5-lightning:30b-a3b-q4_K_M
30b-a3b-q8_0 35GB 1M Text ollama run nemotron-3.5-lightning:30b-a3b-q8_0
30b-a3b-bf16 66GB 1M Text ollama run nemotron-3.5-lightning:30b-a3b-bf16
30b-mlx 23GB 256K Text ollama run nemotron-3.5-lightning:30b-mlx

Model Detayları ve Benchmarklar (kaynak: ollama.com)

NVIDIA Nemotron 3.5 Lightning is an open 30B mixture-of-experts (MoE) model with 3B active parameters built for the execution layer of always-on agents. It is designed for harnesses like OpenClaw and Hermes Agent—all supported by the NVIDIA NemoClaw open source security and management stack for running always-on AI agents.

Nemotron 3.5 Lightning offers 4x higher throughput and 30% lower task completion time compared to other leading open models of similar size

Use cases

  • Personal agents: Power long-running personal assistants for everyday tasks, like managing your email, calendar, projects and bookings. Run these agents locally on your PC to leverage contextualized intel.
  • Financial services workflows: Power special agents for specialized financial services tasks, such as extracting data from documents, checking policy rules, monitoring risk signals, and preparing structured summaries.
  • Cybersecurity operations: Power special agents for specialized security tasks, such as enriching alerts, classifying incidents, querying logs, validating controls, correlating indicators, and preparing structured findings for analysts.
  • Telecom: Power special agents for autonomous networks and proactive customer care, such as triaging network alarms, optimizing network configurations, and answering billing questions.
  • Retail: Power special agents for enriching product catalogs, resolving inventory and fulfillment exceptions, assisting product discovery, and answering order, return, or loyalty questions

Benchmarks

image.png