Category: AI – This Quote

Günter Klambauer and colleagues’s words on self-normalizing neural networks explain a pivotal AI idea and why its evidence, limits, and responsible use still matter today.

Kihyuk Sohn and colleagues’s words on FixMatch semi-supervised learning explain a pivotal AI idea and why its evidence, limits, and responsible use still matter today.

Yann N. Dauphin and colleagues’s words on gated convolutional language models explain a pivotal AI idea and why its evidence, limits, and responsible use still matter today.

Prajit Ramachandran and colleagues’s words on automated activation-function search explain a pivotal AI idea and why its evidence, limits, and responsible use still matter today.

Biao Zhang and Rico Sennrich’s words on root mean square normalization explain a pivotal AI idea and why its evidence, limits, and responsible use still matter today.

Joshua Ainslie and colleagues’s words on grouped-query attention explain a pivotal AI idea and why its evidence, limits, and responsible use still matter today.

Ofir Press and colleagues’s words on ALiBi positional bias explain a pivotal AI idea and why its evidence, limits, and responsible use still matter today.

Noam Shazeer’s words on multi-query attention explain a pivotal AI idea and why its evidence, limits, and responsible use still matter today.

Samyam Rajbhandari and colleagues’s words on ZeRO distributed training explain a pivotal AI idea and why its evidence, limits, and responsible use still matter today.

Mohammad Shoeybi and colleagues’s words on Megatron model parallelism explain a pivotal AI idea and why its evidence, limits, and responsible use still matter today.

Elias Frantar and colleagues’s words on GPTQ model quantization explain a pivotal AI idea and why its evidence, limits, and responsible use still matter today.

Guangxuan Xiao and colleagues’s words on SmoothQuant explain a pivotal AI idea and why its evidence, limits, and responsible use still matter today.