_CORE
AI & Agentic Systems Core Information Systems Cloud & Platform Engineering Data Platform & Integration Security & Compliance QA, Testing & Observability IoT, Automation & Robotics Mobile & Digital Banking & Finance Insurance Public Administration Defense & Security Healthcare Energy & Utilities Telco & Media Manufacturing Logistics & E-commerce Retail & Loyalty
References Technologies Blog Know-how Tools
About Collaboration Careers
CS EN
Let's talk

Llama 2 and the Open-Source LLM Revolution — The End of OpenAI's Monopoly?

02. 08. 2023 1 min read CORE SYSTEMSai
Llama 2 and the Open-Source LLM Revolution — The End of OpenAI's Monopoly?

Meta made a bold move — Llama 2 is an open-source, commercially usable LLM. For enterprise: finally an alternative to vendor lock-in with OpenAI.

Llama 2 — What’s New

Three sizes: 7B, 13B, and 70B parameters. Chat versions fine-tuned with RLHF. The license allows commercial use.

Our Benchmarks

  • Summarization: 85% of GPT-3.5 quality. Usable.
  • Code generation: Java/Python solid, niche languages weaker.
  • Czech language: Significantly worse than GPT-3.5.
  • Reasoning: The 70B version is surprisingly good.

Self-Hosting

The 70B model needs ~140GB VRAM. Quantized versions run on consumer hardware — 13B on an RTX 4090. Data never leaves your infrastructure.

Enterprise Strategy

Open-source LLMs change the equation. For high-volume use cases, self-hosting can be more economical. Plus: no vendor lock-in, full control, data sovereignty.

Open-Source AI Is a Legitimate Enterprise Choice

We recommend a hybrid strategy — GPT-4 for complex reasoning, open-source for high-volume, privacy-sensitive tasks.

llama 2open sourcellmmeta
Share:

CORE SYSTEMS

Stavíme core systémy a AI agenty, které drží provoz. 15 let zkušeností s enterprise IT.

Need help with implementation?

Our experts can help with design, implementation, and operations. From architecture to production.

Contact us