fix(_internals): use n_tokens0 offset when enabling last-token logits in add_sequence - #2205

fix(_internals): use n_tokens0 offset when enabling last-token logits in add_sequence#2205

abetlen merged 3 commits into

abetlen:mainabetlen/llama-cpp-python:mainfrom

Anai-Guo:fix-add-sequence-logits-indexAnai-Guo/llama-cpp-python:fix-add-sequence-logits-indexCopy head branch name to clipboard