Decoding Game: On Minimax Optimality of Heuristic Text Generation Strategies
Abstract: Decoding strategies play a pivotal role in text generation for modern language models, yet a perplexing gap persists between theory and practice. Surprisingly, strategies…