OPT-Tree: Speculative Decoding with Adaptive Draft Tree Structure

Jikai Wang | Yi Su | Juntao Li | Qingrong Xia | Zi Ye | Xinyu Duan | Zhefeng Wang | Min Zhang |