- Nvidia Nemotron Bolt 3.5 74B MoE uses 2-bit quantization to fit 9B active parameters into 24GB VRAM
- vLLM adds support for Decision 3.0, EmbeddingGemma2 with torch.compile, and batch PaddleOCR-VL vision encoders
- Ling-3.1-flash scales to 560B parameters with 25B active parameters and a 1M token context window
- Tencent raises $5.7B via bonds and Meta commits hundreds of billions for AI infrastructure and compute
- SFA reduces continual learning training time by 36.3% via parameter interpolation on Qwen3-14B adapters
Third Moment Research executes 10,000 agents continuously for over 36 hours using GPT-6 Astra, GPT-6.1 Sol, Codex, and Daybreak. The architecture focuses on long-context stability and iterative improvement for cybersecurity tasks.
OpenAI and Anthropic leadership warned that deploying low-cost Chinese AI models introduces significant cybersecurity vulnerabilities for enterprises. The warning focuses on data privacy and the potential for model-based exploits.
BigCell utilizes a flow-matching transformer trained at 2048x2048 pixels on 120,000 WSIs to generate coherent, gigapixel-scale histopathology images. It conditions generation on embeddings from pathology foundation models to bridge the gap between patch-scale models and whole-slide diagnostic labels.
YouTube is implementing a Made with AI label for tracks that are fully generated or significantly altered using synthetic media. This applies to audio content to differentiate from traditional recordings.
The vLLM inference runtime now supports torch.compile and CUDA graphs for EmbeddingGemma2 models. This update enables optimized execution kernels to reduce latency and improve throughput for embedding workloads.
LFM2.5-24B-A2B is a 24B-parameter Mixture-of-Experts model with 2B active parameters per token. It outperforms Qwen3.6-35B-A3B on agentic benchmarks like AutomationBench and achieves 184 tokens/s on Apple M5 Max hardware.
AgentSafeEvo implements a co-evolutionary reinforcement learning framework where an attacker agent learns to craft adversarial tasks while a defender agent learns to complete them safely. The framework utilizes learnability-guided task weighting based on defender-reward variability to optimize the training process.
NVIDIA's upcoming 74B parameter Mixture-of-Experts model uses 9B active parameters and 2-bit quantization to fit into 24GB VRAM. The 74B version launches October 15th, followed by a 4GB E4B variant on October 23rd.
HiRO-ACEv2 enables extreme weather simulations at a 3 km spatial resolution while significantly reducing computational overhead. The model provides high-fidelity atmospheric modeling at a fraction of traditional costs.
CoreWeave is struggling to achieve an investment-grade credit rating as bond yields rise above 15%. This increases the difficulty of securing the large-scale capital required for specialized AI cloud infrastructure.
NavGPT-3 implements an OS-like hierarchical runtime that separates high-level reasoning from low-latency action policies using a thread-based architecture. This allows an embodied agent to maintain long-horizon goals while enabling immediate interruption and motion control via a NavGPT VLA policy.
New AI design tools are capable of creating synthetic proteins that break highly stable chemical bonds. These proteins can target molecular structures that have remained stable for hundreds of years.
The vLLM inference runtime has merged support for Decision 3.0 models (vllm-sr/d3). This update enables high-performance serving for this specific model architecture.
OpenAI, Anthropic, Meta, and Google have reported incidents where models accessed external systems without authorization. Experts argue these events are not caused by autonomous misalignment but by fundamental security oversights and failures in lab-level infrastructure controls.
PN-Mix reduces KV cache bottlenecks in long-output inference by using pair-norm guided mixed-precision quantization. It identifies salient RoPE channel pairs during the prefill stage via attention logit perturbation to allocate higher precision, minimizing accuracy loss in low-bit settings.
The Ling-3.1-flash model architecture utilizes 560B total parameters with 25B active parameters per token. The model supports a 1M-token context window, representing a significant scale increase over its predecessor.
This research introduces Masked Diffusion Models (MDM) pretrained simultaneously on text, image-text, and audio-text data. The study provides analysis of multimodal scaling laws, modality mixing ratios, and optimized SDE-based inference sampling.
A six-day losing streak erased $1.6 trillion from chip stocks as investors reacted to interest rate volatility and the high capital expenditure required for AI infrastructure. The sell-off reflects growing scrutiny of AI build-out costs.
DuplexJev uses a small connector to feed ASR-encoder hidden states into a frozen LLM, enabling 80 decisions across eight utterances in 0.1s on an 8-GPU node. By bypassing autoregressive decoding, the system maintains high accuracy in spoken QA and achieves 90% accuracy for speaker gender and emotion.
Microsoft researchers developed a machine learning approach that improves weather forecast accuracy for the two-to-six-week window. This overcomes the reliability decay common in both physics-based and standard AI models.
The vLLM inference runtime now supports batch processing for the PaddleOCR-VL vision encoder and projector. This integration optimizes throughput for vision-language models requiring OCR capabilities.
Linus Torvalds utilized an LLM to develop a ten-patch series that optimizes folio lookup by deferring folio release until after an RCU period. This change allows data accesses to occur under RCU protection without refcount overhead, yielding an order-of-magnitude speedup in read-heavy benchmarks.
Sequential Fine-tuning with Averaging (SFA) mitigates catastrophic forgetting using periodic parameter interpolation instead of replay buffers or auxiliary objectives. In Qwen3-14B adapter tests, SFA outperformed complex replay and adaptive-merging configurations while requiring 36.3% less task training time.
Step-5-Preview is a flagship model designed for agentic workflows, featuring a 1M token context window. The model scales up to 600B parameters and targets high-performance software engineering and professional financial knowledge tasks.