EAGLE3 is an encoder-decoder speculative decoding method in which the draft or helper model is conditioned on intermediate features from the target model. EAGLE3 is considered a state-of-the-art approach in speculative decoding.

Zdroje (3)