VentureBeat

New LLM optimization technique slashes memory costs up to 75%

Researchers at the Tokyo-based startup Sakana AI have developed a new technique that enables language models to use memory more efficiently, helping enterprises cut the costs of building applications ...
InfoQ

Meta Open-Sources Byte Latent Transformer LLM with Improved Scalability

Meta open-sourced Byte Latent Transformer (BLT), an LLM architecture that uses a learned dynamic scheme for processing patches of bytes instead of a tokenizer. This allows BLT models to match the ...
VentureBeat

Microsoft’s Differential Transformer cancels attention noise in LLMs

Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders. Subscribe Now Improving the capabilities of large ...

PrismML debuts energy-sipping 1-bit LLM in bid to free AI from the cloud

PrismML's approach is based on work done by Caltech electrical engineering professor Babak Hassibi and colleagues. The ...
College of Computing - Georgia Tech

Transformer Explainer Shows How AI is More Math than Human

A transformer is a neural network architecture that changes data input sequence into an output. Text, audio, and images are ...
InfoQ

Google DeepMind Announces LLM-Based Robot Controller RT-2

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Soroosh Khodami discusses why we aren't ready ...