Sign Bit is Enough: A Learning Synchronization Framework for Multi-hop All-reduce with Ultimate Compression

Feijie Wu, Shiqi He, Song Guo, Zhihao Qu, Haozhao Wang, Weihua Zhuang, Jie Zhang
July 2022
Type
Conference paper
Publication
In The 59th Design Automation Conference (DAC) (CCF-A)
Feijie Wu
Feijie Wu
PhD Student in Purdue University
Song Guo
Song Guo
Professor
Jie Zhang
Jie Zhang
Post-doctoral Fellow