What is IBM Granite?
IBM's third generation of AI language models, fit for purpose and open sourced, these enterprise-ready models are built to deliver exceptional performance against safety benchmarks and across a wide range of enterprise tasks from cybersecurity to RAG.
Released in the open under an Apache 2.0 license, Granite 3.1 models support a context length of 128K and provide a better way to handle RAG and function-calling tasks. Granite 3.1 instruction models are finetuned from Granite-3.1 base models using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets tailored for solving long context problems. The Granite 3.1 language model family includes:
- Granite Dense - Powerful “workhorse” models designed for enterprise AI
- Granite MoE - Inference-efficient Mixture of Experts (MoE) models ideal for on device applications or CPU-based deployments
- Granite Accelerator - Speculative decoding companion model for increased inference speed and lower latency
Categories & Use Cases
Videos
Technical Details
| Mobile Application | No |
|---|
FAQs
What is IBM Granite?
IBM's third generation of AI language models, fit for purpose and open sourced, these enterprise-ready models are built to deliver exceptional performance against safety benchmarks and across a wide range of enterprise tasks from cybersecurity to RAG.
How much does IBM Granite cost?
IBM Granite starts at $0.