Unslop scored 12,750 arXiv papers from 2021-2026, calibrating their detector to a 0.4% false-positive rate on pre-ChatGPT papers to build a rigorous baseline. Machine-written flags rose in two waves to ~32% in the most recent complete quarter, peaking near 39% in early 2026. Computer science leads at ~65%; mathematics is lowest at 0.7% (though that may reflect detector sensitivity to notation-heavy prose rather than true low adoption). The methodology is unusually careful about confounds and worth reading for practitioners who run or evaluate AI-assisted research pipelines.
Thinking Machines Lab released Inkling, a 975B-total / 41B-active MoE that natively handles text, image, and audio inputs. Architecture: 66-layer decoder-only transformer, 6/256+2 shared expert routing, hybrid local/global attention, hierarchical patch encoder for images, discrete token encoding for audio. Benchmarks place it competitively on AIME 2026 (97.1%), GPQA Diamond (87.2%), SWEBench Verified (77.6%), MCP Atlas (74.1%), and IFBench (79.8%). Eval comparisons run against Kimi K2.5/K2.6, GLM 5.2, DeepSeek V4 Pro, Gemini 3.1 Pro, Claude Fable 5, and GPT-5.6 Sol. Available via SGLang, vLLM, and HuggingChat; 882 HF likes and 7,870 downloads in its first 24 hours suggests meaningful adoption interest.
🟧 Hacker News 2w ago
⭐ Editor's Pick
Moonshot AI launched Kimi K3 on July 16 — a 2.8T-parameter MoE (16/896 experts active, 1M-token context) now live on API, with full weights promised by July 27. Architectural highlights: Kimi Delta Attention (6.3x faster decoding at 1M context), Attention Residuals, LatentMoE, MXFP4/MXFP8 quantization. Artificial Analysis scores it 57 on Intelligence Index (near Claude Opus 4.8, behind Fable 5/GPT-5.6 Sol); debuts #1 on LMArena Frontend Code Arena at 1679 Elo. Priced at $3/Mtok input, $15/Mtok output — well below Western frontier pricing. Community reaction is strong (399 activity score on Latent Space), with caveats: local inference is impractical for most consumer setups, and unverified distillation-from-Claude chatter is circulating.
Proposes a competition for distinguishing robust from spurious reasoning in frontier mathematical LLMs using internal model mechanisms rather than final-answer accuracy. Motivated by the gap between strong benchmark scores and unreliable internal reasoning: a model can get the right answer for the wrong reasons. Focuses on math olympiad-level problems (AI Mathematical Olympiad context), providing a structured interpretability challenge tied to an existing competition with real stakes.
Framework for stress-testing multi-step search agents under poor-quality evidence conditions — a failure mode that is rare in standard benchmarks but catastrophic in production. DeepStress controls the frequency and severity of misleading/noisy evidence in retrieved documents and measures agent robustness, exposing brittleness invisible to standard QA metrics. Relevant for any practitioner deploying RAG-based or web-search agents in adversarial or noisy environments.
Hume AI published Real World VoiceEQ, a benchmark covering 40+ proprietary and open-source voice models across 15+ evaluation dimensions and 60+ metrics spanning ASR, TTS, Speech-to-Speech, and Speech Understanding — grounded in 1M+ human ratings (785k TTS, 48k STS). Key finding: no single model ranked in the top five across all eight TTS capability groups; speech models have become better at speaking than listening, often ignoring paralinguistic cues like tone, hesitation, and emphasis that humans rely on. The benchmark also found that LLM-based auto-evaluation degrades significantly for subjective voice quality judgments, suggesting SLMs can't yet replace human raters for open-ended voice assessment.
InternScience released Agents-A1, a 35B MoE model trained with a three-stage paradigm: full-domain SFT, domain-level teacher model training, then multi-teacher multi-domain on-policy distillation with heterogeneity-aware optimization. Claims SOTA on Seal-0 (56.4), HiPhO (46.4), FrontierScience-Olympiad (79%), FrontierScience-Research (40%), IFBench (80.6%), and GAIA (96%). Targets long-horizon search, engineering, scientific research, instruction following, and tool-calling simultaneously. The headline claim — 35B reaching 1T-class performance — is supported by benchmarks vs. GPT-5.5, Kimi K2.6, and DeepSeek-V4-pro, though the model is not yet deployed by any inference provider. Apache 2.0.
🟧 Hacker News 3w ago
⭐ Editor's Pick ★ High Signal
OpenAI launches GPT-5.6 as a three-tier family: Sol (flagship, $5/$30 per 1M tokens), Terra ($2.50/$15), and Luna ($1/$6). Sol scores 53.6 on Agents' Last Exam — 13.1 points above Claude Fable 5 — and hits 80 on the Artificial Analysis Coding Agent Index, just above Fable 5, while using less than half the output tokens. Key new API primitives: Programmatic Tool Calling (in-memory programs that coordinate tools without round-tripping) and a multi-agent beta enabling `ultra` mode (4 parallel agents by default). Prompt caching now has explicit breakpoints and a 30-minute guaranteed minimum cache lifetime; cache writes are billed at 1.25x uncached input rate. 1319 HN points.
OpenAI publishes an analysis of SWE-Bench Pro raising questions about the benchmark's reliability and accuracy for evaluating coding AI models. The post identifies specific issues in how SWE-Bench Pro tasks are constructed or scored that may affect the signal practitioners extract from results — notable given that SWE-Bench Pro is the benchmark where Claude Mythos 5 leads with 80.3% vs GPT-5.6 Sol's 64.6% in the concurrent model release. Practitioners using SWE-Bench Pro results to guide model selection should review the analysis before drawing conclusions.
A dense 25-minute reference post on neural scaling laws, tracing the lineage from Amari (1992) and Hestness (2017) through Kaplan et al. (2020) and Chinchilla (2022), explaining why the two papers disagree on compute-optimal allocation, and extending into data-constrained regimes with Muennighoff et al. (2023) and Lovelace et al. (2026). Includes toy simulation widgets and careful derivations of the parametric loss fitting. Particularly useful as a practitioner reference on how fitting choices—parameter rounding, loss normalization, fit region—cause large divergences in extrapolation.
OpenAI released LifeSciBench, a 750-task benchmark spanning 7 life-science workflows (evidence handling, analysis, design/optimization, reasoning, validation, translation, communication) authored by 173 PhD-level scientists with industry experience and reviewed by 453 experts. Tasks average 25 rubric criteria each (19,020 total), 79% require multi-step reasoning, and 53% require artifact interpretation (figures, PDFs, genomic sequences, structure files). GPT-Rosalind, a purpose-built life-sciences model, achieves 36.1% overall exact pass rate vs. 25.7% for GPT-5.5, with the largest gains in Translation (57.7% vs 36.8%) and Scientific Communication (71.1% vs 56.3%). Artifact-heavy tasks remain a clear gap: pass rates drop from ~45% (text-only) to 28% (artifact tasks) for GPT-Rosalind.
Pairing Qwen3.6-35B with the 'little-coder' agent scaffold achieves 78.7% on the Polyglot coding benchmark, landing in the public top 10 and competitive with leading cloud models. The same scaffold previously lifted a 9B Qwen model from 19.11% to 45.56%, suggesting a significant portion of the local-vs-cloud performance gap is attributable to scaffold/harness mismatch rather than model capability alone.
Identifies 'preference leakage': when the same LLM generates synthetic training data and serves as the judge, it systematically inflates scores for outputs matching its own generation style, biasing leaderboard rankings even when models perform similarly. Demonstrated empirically across several evaluation pipelines. A concrete warning against self-referential LLM-as-a-judge setups.
Alibaba's Qwen3.6-27B dropped on r/LocalLLaMA (1,707 upvotes) with a 262,144-token context window and support for SGLang speculative decoding (NEXTN) and vLLM ≥0.19.0. The 27B dense model immediately drew community comparisons to Qwen's larger MoE variants; an r/LocalLLaMA thread questioning why the 27B outperforms the 397B MoE on some tasks reached 1,154 upvotes, surfacing discussion about MoE expert-utilization efficiency. A quantization shootout post (660 upvotes) showed Q4_K_M achieves 62.41% avg accuracy vs Q8_0's 63.67% and BF16's 63.78% across HumanEval, HellaSwag, and BFCL benchmarks—a near-negligible gap that makes Q4_K_M the practical default for 24 GB cards.
SkillLearnBench is the first benchmark for continual skill learning in LLM agents, covering 20 verified tasks across 15 sub-domains with evaluation at three levels: skill quality, execution trajectory, and task outcome. Tested methods include one-shot learning, self/teacher feedback, and skill-creator approaches; all improve over the no-skill baseline but none achieves consistent gains across domains. Highlights that automatic skill acquisition for agents remains an unsolved problem despite recent progress.
💬 Reddit Apr 16
⭐ Editor's Pick
User benchmarks show Claude Opus 4.7 scoring 59.2% vs Opus 4.6's 91.9% on the MRCR v2 8-needle 256K context benchmark — a sharp context retention regression. Compounding the issue, a tokenizer change reportedly causes Opus 4.7 to consume ~1.35x more tokens than Opus 4.6 and ~2x more than competing proprietary models, effectively raising costs ~50% for equivalent workloads. If the benchmark numbers hold, this is a meaningful quality-cost tradeoff moving in the wrong direction.
🔶 Anthropic Apr 16
⭐ Editor's Pick
Anthropic's official Claude Opus 4.7 GA post confirms same pricing as 4.6, image resolution raised to 2,576px long edge (~3.75 MP, 3× prior), and a new xhigh effort tier. Coding benchmarks: +13% task resolution on internal 93-task harness, 70% on CursorBench (vs. 58%), 98.5% on XBOW visual-acuity (vs. 54.5%). First model shipped with real-time cyber safeguards derived from the restricted Mythos Preview testbed.
GPT-Rosalind is OpenAI's first domain-specific vertical model, tuned for biology, drug discovery, and genomics. It scores 0.751 pass@1 on BixBench vs. GPT-5.4's 0.732 and leads on 6 of 11 LABBench2 task families. Available only to US enterprise partners (Amgen, Moderna, Allen Institute, UCSF, Thermo Fisher) and ships with a Codex plugin connecting to 50+ scientific tools.
April 2026 r/LocalLLaMA community consensus (143+ posts) names Qwen 3.5 as the most broadly recommended local model family, with Qwen3-Coder-Next as the near-unanimous pick for coding. MiniMax M2.5/M2.7 surface as the go-to for agentic/tool-heavy workloads; Gemma 4 gains traction for general local use; GLM-5/4.7 enters the best-overall conversation.
Architecture survey comparing 10 open-weight LLM releases from January–February 2026, with fact sheets and diagrams covering attention design, MoE structure, context length, and post-training approaches. Useful index for base model selection decisions going into Q1 2026 fine-tuning or deployment work.
A 668-point HN post documents that swapping the evaluation harness — without changing any model — improved measured coding performance across 15 LLMs in an afternoon. Directly implicates harness sensitivity as a major confounder in coding benchmark results. High-signal for anyone designing or interpreting code evals.