OTAS: An Elastic Transformer Serving System via Token Adaptation
Type
Publication
IEEE International Conference on Computer Communications (INFOCOM) (CCF-A)
Jinyu Chen
PhD Student
Wenchao Xu
Research Assistant Professor
Zicong Hong
PhD Student
Song Guo
Professor
