🏃 Keep Up
← All topics
Datasets 6 items

Everything Datasets

🟧 Hacker News 1w ago

~32% of new arXiv papers now flag as machine-written — unslop.run methodology and field breakdown

Unslop scored 12,750 arXiv papers from 2021-2026, calibrating their detector to a 0.4% false-positive rate on pre-ChatGPT papers to build a rigorous baseline. Machine-written flags rose in two waves to ~32% in the most recent complete quarter, peaking near 39% in early 2026. Computer science leads at ~65%; mathematics is lowest at 0.7% (though that may reflect detector sensitivity to notation-heavy prose rather than true low adoption). The methodology is unusually careful about confounds and worth reading for practitioners who run or evaluate AI-assisted research pipelines.

🤗 HF Blog 2w ago

Real World VoiceEQ: Hume AI's 40-model, 1M-rating voice AI benchmark

Hume AI published Real World VoiceEQ, a benchmark covering 40+ proprietary and open-source voice models across 15+ evaluation dimensions and 60+ metrics spanning ASR, TTS, Speech-to-Speech, and Speech Understanding — grounded in 1M+ human ratings (785k TTS, 48k STS). Key finding: no single model ranked in the top five across all eight TTS capability groups; speech models have become better at speaking than listening, often ignoring paralinguistic cues like tone, hesitation, and emphasis that humans rely on. The benchmark also found that LLM-based auto-evaluation degrades significantly for subjective voice quality judgments, suggesting SLMs can't yet replace human raters for open-ended voice assessment.

🤗 Hugging Face 2w ago

MOSS-Transcribe-Diarize: open ASR+diarization model from OpenMOSS, 83K downloads in first days

OpenMOSS-Team's MOSS-Transcribe-Diarize is trending on HuggingFace as an audio-text-to-text model combining speech transcription and speaker diarization in a single Transformer-based model. 83,160 downloads and 242 likes in its first days suggest genuine demand for an open, integrated ASR+diarization pipeline — a category previously dominated by proprietary APIs or awkward two-step open setups (Whisper + pyannote). Worth tracking as a practitioner alternative for meeting transcription and voice agent memory pipelines.

📝 Blog 2w ago

SAP Acquires Prior Labs, Plans $1.18B Frontier AI Lab for Tabular Foundation Models

SAP agreed to acquire Freiburg-based startup Prior Labs — developers of tabular foundation models (TFMs) — and committed over $1.18B over four years to transform it into a frontier AI lab specializing in structured business data prediction. The acquisition signals enterprise incumbents moving to build in-house AI capabilities distinct from LLMs: TFMs are trained on structured tables rather than language corpora, targeting prediction tasks across SAP's customer base.

🟢 OpenAI Jun 17

LifeSciBench: 750-task expert-authored benchmark for AI in life science research

OpenAI released LifeSciBench, a 750-task benchmark spanning 7 life-science workflows (evidence handling, analysis, design/optimization, reasoning, validation, translation, communication) authored by 173 PhD-level scientists with industry experience and reviewed by 453 experts. Tasks average 25 rubric criteria each (19,020 total), 79% require multi-step reasoning, and 53% require artifact interpretation (figures, PDFs, genomic sequences, structure files). GPT-Rosalind, a purpose-built life-sciences model, achieves 36.1% overall exact pass rate vs. 25.7% for GPT-5.5, with the largest gains in Translation (57.7% vs 36.8%) and Scientific Communication (71.1% vs 56.3%). Artifact-heavy tasks remain a clear gap: pass rates drop from ~45% (text-only) to 28% (artifact tasks) for GPT-Rosalind.

💬 Reddit Apr 28

Talkie: 13B LLM Trained Exclusively on Pre-1931 Text

Alec Radford (GPT, CLIP, Whisper), Nick Levine, and David Duvenaud released Talkie, a 13B model trained only on text published before 1931. The model's worldview is frozen at December 31, 1930: it doesn't know about World War II or the internet. Claude Sonnet was used to help test and judge the model's output. The r/ClaudeAI post (786 upvotes) drew discussion about what the model reveals about the common ancestor problem — every major LLM today shares overlapping training data, making true behavioral diversity impossible without deliberate data partitioning. Notable for the eval methodology: using a modern LLM to judge a historically-constrained one.