- vLLM adds Hy4-preview and PLaMo3 speculative decoding support; SGLang enables Qwen 3.8 Flash ngram lookup offloading to SSD
- NVIDIA Vera Rubin NVL72 hits 30x higher throughput per megawatt via AgentX; Samsung integrates MAC units into LPDDR5X-9600 memory
- SKILL.state replaces conversational history with mutable execution state; CritICL uses small model failures for inference-time reasoning scaling
- Lambda secures $1B debt for Nvidia chip inventory; OpenAI ends model access for Cursor following SpaceX acquisition
- Conduct provides runtime governance for MCP tools; only-cli reduces web-browsing token usage by 142x compared to raw HTML
OpenAI will terminate its partnership with Cursor on November 12 following the editor's acquisition by SpaceX. This move will end Cursor's direct access to OpenAI models.
CritICL improves reasoning performance by using failure modes from smaller models in a family as in-context guidance for larger models. This approach enables inference-time scaling without the heavy computational overhead of repeated generation or external verification.
The vLLM inference engine now supports the Hy4-preview model. This integration enables high-throughput serving of the architecture within the existing vLLM ecosystem.
Nvidia is moving beyond pure GPU compute to improve data center efficiency through smarter traffic control mechanisms. This approach prioritizes optimized data movement and system-level orchestration over simply increasing processor cycles.
New research introduces an information processing gap metric to measure how much LLM belief updates deviate from ideal Bayesian updates. The method treats LLMs as information processing rules to evaluate their ability to rationally update probabilistic beliefs when presented with new evidence.
SKILL.state improves long-horizon agent performance by using a structured, mutable execution state instead of an ever-growing conversation history. This approach discards intermediate reasoning after state updates, reducing cumulative token consumption and preventing context poisoning.
The Debian Project has voted to allow the use of large language models for development, maintenance, and documentation. Contributors remain fully responsible for ensuring all AI-assisted code meets existing quality, correctness, and legal compliance standards.
SGLang supports offloading Qwen 3.8 Flash Next ngram lookup tables to SSD with streaming capabilities. This technique aims to reduce memory overhead during inference with minimal performance degradation.
NVIDIA's Vera Rubin NVL72 architecture demonstrates up to 30x better throughput per megawatt compared to GB300 NVL72 when running the SemiAnalysis AgentX workload. This benchmark focuses on energy-efficient throughput specifically for agentic workflows rather than traditional training metrics.
Luce uses a voxelized multimodal Gaussian cloud to unify geometry and PBR materials like albedo and surface normals. A rectified-flow transformer generates a material-aware latent space from a single image, enabling integration into standard rendering pipelines.
The vLLM inference runtime now supports the speculative decoding method for the PLaMo3 model. This integration allows for faster token generation by using a smaller draft model to predict sequences.
Lambda secured $1B in private debt to acquire additional Nvidia AI chips for leasing to Microsoft. This capital injection highlights the increasing reliance on debt financing to meet the massive hardware requirements of the AI infrastructure boom.
The Open Automatic Speech Recognition (ASR) Leaderboard has added its first language from the Global South. This expansion improves benchmarking visibility for speech models in previously underrepresented linguistic regions.
An evaluation of AI-generated summaries for cancer patients identified risks regarding clinical accuracy and omissions. Researchers used a combination of oncology clinician assessments and LLM-as-a-judge to iteratively improve prompt grounding and safety guardrails.
Conduct offers a policy engine and LLM proxy to enforce block, warn, audit, or inject actions across AI agents and shell tools. It distinguishes itself from observability tools by providing fail-closed runtime governance with signed configurations and SHA-256 hash-chained audit logs.
Jean-Claude is a Node.js MITM proxy designed to intercept Claude Code requests for enterprise-managed settings. It allows users to bypass administrative restrictions, such as disabled auto-mode or mandatory tool permissions, by serving custom configurations during the session.
Google is extending the Co-Scientist framework using Gemini to automate workflows in materials science, biology, and computer science. The system aims to bridge existing gaps in autonomous AI scientific reasoning through human-AI collaboration across diverse research domains.
UrbanGround provides a 3D geospatial sandbox based on Hong Kong to test how MLLM agents translate local street-view perception into long-term spatial navigation. The framework enables closed-loop, first-person interaction within a physically constrained digital twin.
Recent findings suggest AI systems are outperforming human doctors in specific diagnostic and clinical tasks. The rising efficacy of these models poses significant professional challenges to the medical community.
LLM guardrails in self-adaptive systems suffer from verdict staleness, with error rates reaching 48.4% after just eight simulator steps. The Freshness-Bounded Shield (FBS) estimates the validity horizon of an approval based on feature volatility to prevent unsafe executions.
Samsung implements MAC units directly within LPDDR5X-9600 memory banks to exploit high internal bandwidth and reduce DRAM-to-core latency. The architecture maintains compatibility with standard memory controllers while enabling in-memory computation across 16 banks.
The only-cli tool converts websites into compact, agent-ready formats, consuming 142x fewer tokens than raw HTML. It claims to be significantly cheaper than Claude Code's WebSearch and successfully unblocks sites like Reddit and LinkedIn.
OpenAI research suggests agentic systems could automate 80% of US GDP, yet deployment remains constrained by hardware bottlenecks. Discussion focuses on the transition from model development to domain-specific agent labs and the impact of chip and memory shortages.
Capital flows into open-weight AI companies are driving a trend of acquisitions by larger industry players. This shift highlights a market strategy focused on acquiring high-quality model weights and talent through the open-source ecosystem.
A training-free, plug-in length predictor treats end-of-sequence token selection as a discrete-time survival problem. This method accelerates inference by up to 7x across reasoning and code benchmarks while maintaining task accuracy.