Fully open medical AI framework lets anyone audit how clinical LLMs are built

Medical large language models (LLMs) are increasingly being used in clinical settings. For example, AI is helping doctors in ...
C&ENOpinion

The AI Chemist: To be trustworthy, LLMs need to show their work

Good scientists reveal how they do their experiments and report their results; so should any machine-driven research ...
Tech Xplore

Making LLMs faster and more efficient across multiple languages

Large language models (LLMs), which are the artificial intelligence (AI) systems behind modern chatbots, translation tools, ...
Hackaday

An LLM From “Scratch”

Reading a book about bowling is not the same as actually bowling. If that resonates with you and you want to learn more about large language models, check out the LLM From Scratch project. The ...
IEEE

Low Bit-Width LLM Acceleration via Symmetric Lookup Format and Compute-in-Decoding Paradigm

Abstract: Recent large language models (LLMs), driven by the scaling law, have demonstrated remarkable performance in various machine learning tasks by significantly increasing model size. However, ...
Semiconductor Engineering

Microarchitecture Tailored to 3D-Stacked Near-Memory Processing LLM Decoding (U. of Edinburgh, Peking U., Cambridge et al.)

A new technical paper, “Rethinking Compute Substrates for 3D-Stacked Near-Memory LLM Decoding: Microarchitecture-Scheduling Co-Design,” was published by researchers at University of Edinburgh, Peking ...
InfoWorld

Multi-token prediction technique triples LLM inference speed without auxiliary draft models

With reported 3x speed gains and limited degradation in output quality, the method targets one of the biggest pain points in production AI systems: latency at scale. High inference latency and ...
VentureBeat

Researchers baked 3x inference speedups directly into LLM weights — without speculative decoding

As agentic AI workflows multiply the cost and latency of long reasoning chains, a team from the University of Maryland, Lawrence Livermore National Labs, Columbia University and TogetherAI has found a ...
The New York Times

Decoding the A.I. Beliefs of Anthropic and Its C.E.O., Dario Amodei

The company is at odds with the Pentagon over how its A.I. will be used. The conflict has its roots in the foundational plan for Anthropic. By Cade Metz Reporting from San Francisco The Defense ...
GitHub

Steganographic data encoding in natural language using LLM logit-rank steering

subtext-codec is a proof-of-concept codec that hides arbitrary binary data inside seemingly normal LLM-generated text. It steers a language model's next-token choices using the rank of each token in ...