MegaNova AI Blog
  • Home
  • About
Sign in Subscribe

LLM Infrastructure

A collection of 2 posts
Kimi K3 at Scale: Inside Our Serving Stack
LLM Infrastructure

Kimi K3 at Scale: Inside Our Serving Stack

Moonshot AI shipped Kimi K3's weights on July 27, and the numbers alone explain why serving it well is a genuinely different engineering problem than serving most models that came before it: 2.8 trillion total parameters, with only 104 billion active on any given token. That sparsity
12 Oct 2026 6 min read
Self-Hosted LLM Infrastructure: How to Run AI On-Premise Without Sacrificing Performance
LLM Infrastructure

Self-Hosted LLM Infrastructure: How to Run AI On-Premise Without Sacrificing Performance

Running an LLM on your own infrastructure gives you control over the hardware, model serving environment, and data path. For organizations handling sensitive information or operating predictable AI workloads, self-hosted inference can be an attractive alternative to relying entirely on public APIs. But owning GPUs does not automatically mean
18 Sep 2026 5 min read
Page 1 of 1
MegaNova AI Blog © 2026
  • Sign up
Powered by Ghost