Grok 4 vs Yi-Lightning
A complete head-to-head: pricing, context window, benchmarks, modality coverage, and openness, with a programmatic verdict synthesized from the underlying data.
Updated
Grok 4 specs · Yi-Lightning specs- PriceYi-Lightning
Yi-Lightning is roughly 107.1× cheaper on output tokens ($0.14 vs $15.00 per 1M).
- Context windowGrok 4
Grok 4 accepts 256K tokens vs 16K, 16.0× the room for long documents and codebases.
- BenchmarksTie
No directly comparable public benchmarks are available for both models, check the spec sheets for individual scores.
- ModalitiesGrok 4
Grok 4 supports 2 modalities (text, vision) vs 1 for Yi-Lightning.
- OpennessTie
Both are closed-weight, API-only.
On balance Grok 4 edges ahead, winning 2 of 5 categories against Yi-Lightning's 1. Yi-Lightning is roughly 107.1× cheaper on output tokens ($0.14 vs $15.00 per 1M). Grok 4 accepts 256K tokens vs 16K, 16.0× the room for long documents and codebases.
No directly comparable public benchmarks are available for both models, check the spec sheets for individual scores. They differ in modality coverage, Grok 4 handles text, vision while Yi-Lightning handles text, which can be the deciding factor before you even look at benchmarks. Both are closed-weight, API-only.
Grok 4 is the newer of the two, released 9 months after Yi-Lightning, which usually means a more recent knowledge cutoff and updated safety post-training. Grok 4 is usually picked for reasoning and research agent workloads, while Yi-Lightning sees more deployments in chinese llm and cheapest llm. If pricing matters more than every last benchmark point, run the numbers in the calculator below before committing.
Side-by-side specs
| Spec | Grok 4 | Yi-Lightning |
|---|---|---|
| Provider | xAI | Other |
| Released | Jul 2025 | Oct 2024 |
| Modalities | text, vision | text |
| Context window | 256K tokens | 16K tokens |
| Max output | , | , |
| Input · 1M | $3.00 / 1M tokens | $0.14 / 1M tokens |
| Output · 1M | $15.00 / 1M tokens | $0.14 / 1M tokens |
| Knowledge cutoff | 2024-11 | , |
| Open weights | No | No |
| API available | Yes | Yes |
Pricing at scale
What you'd actually pay at typical workloads. Numbers come from each model's published per-million-token rates.
- Light usage, 100k in / 50k out per day$31.50 vs $0.630
- Heavy usage, 1M in / 500k out per day$315 vs $6.30
- RAG workload, 5M in / 200k out per day$540 vs $21.84
Light usage, 100k in / 50k out per day: $31.50 vs $0.630 per month, model B comes out ahead. Heavy usage, 1M in / 500k out per day: $315 vs $6.30 per month, model B comes out ahead. RAG workload, 5M in / 200k out per day: $540 vs $21.84 per month, model B comes out ahead.
Estimated spend for the listed models at your usage. Numbers are derived from each model's published per-million-token rates.
- Grok 4$1.05
- Yi-Lightning$0.021
Benchmarks compared
Only sourced numbers. Where a benchmark is missing for one model we show the available value rather than fabricating the other.
- GPQA87.5
Grok 4 fits when…
- Real-time X data access
- Strong on benchmarks at launch
- Less restrictive content policy than peers
- Long-context tasks, handles 256K tokens vs 16K for Yi-Lightning.
- Multimodal needs covering vision.
Yi-Lightning fits when…
- Cheap
- Strong Chinese
- Fast
- Cost-sensitive workloads, 107.1× cheaper than Grok 4 on output tokens.
Consider Grok 3
xAI's first frontier-tier release, established the company's Colossus-trained model line.
Frequently asked
Is Grok 4 or Yi-Lightning cheaper?
Yi-Lightning is cheaper at $0.14 / 1M tokens per million output tokens, vs $15.00 / 1M tokens for Grok 4.Which has the larger context window?
Grok 4 accepts 256K tokens vs 16K for Yi-Lightning.Is Grok 4 or Yi-Lightning better for coding?
Both Grok 4 and Yi-Lightning are competitive on coding benchmarks. See each model's individual spec page for HumanEval and SWE-bench scores where published. For an opinionated pick, consult our Best LLM for Coding ranking.Are either of these models open source?
Neither model ships open weights, both are accessible only via their respective providers' APIs.When were Grok 4 and Yi-Lightning released?
Grok 4 was released by xAI on 2025-07-09. Yi-Lightning was released by Other on 2024-10-16.
The week's AI launches, in your inbox.
One short email every Friday, new models, leaks, and quietly-shipped APIs you missed.