Subquadratic
#20 v Reasoning modelySubquadratic · 2× · naposledy 08. 9. 2026
22
Momentum
Subquadratic is a Miami-based startup founded in 2026 that has developed "SubQ," a language model based on a novel "Subquadratic Sparse Attention" (SSA) architecture. The architecture scales linearly rather than quadratically with context length and enables context windows of up to 12 million Token with near-perfect retrieval accuracy, according to the official product page (subq.ai). The current model "SubQ 1.1 Small" is currently being tested in preview operation with select design partners; the weights are not openly available. Independent Benchmarks were verified by the company Appen.
Vývoj momenta
13.06.11.09.
Vlastnosti
| Key Benchmark (%) | RULER: 99.12% at 128K tokens; Needle-in-a-Haystack: 100% at 1M/2M, 98% at 6M/12M tokens |
| Context Window (Tokens) | Up to 12,000,000 tokens (research model); production API currently 1,000,000 tokens |
| License | Closed-weights, not open source; no publicly available model weights |
| Multimodality | Currently text-based (text and code generation); no published multimodal benchmarks |
| Platform | OpenAI-compatible API (subq.ai), currently private preview/beta with select design partners |
| Release Date | June 16, 2026 (SubQ 1.1 Small model card & technical report) |