Skip to content

Error with embed when passing a List #2199

Closed
#2205
Closed
Error with embed when passing a List#2199
#2205

Description

@davidmezzetti
davidmezzetti
opened on May 2, 2026
from llama_cpp import Llama

# This works
llm = Llama(model_path="/tmp/all-MiniLM-L6-v2-Q8_0.gguf", embedding=True)
print(llm.embed(["test"]))

# This also works
import numpy as np
print(np.array([llm.embed(x) for x in ["test", "test"]]))

# This fails
llm = Llama(model_path="/tmp/all-MiniLM-L6-v2-Q8_0.gguf", embedding=True)
print(llm.embed(["test", "test"]))

Activity

  1. abetlen
    closed this as completedin #2205on May 4, 2026
  2. abetlen
    added a commit that references this issue on May 4, 2026

    fix(_internals): use n_tokens0 offset when enabling last-token logits…

    90e8df9

  3. mlisovyi commented on May 5, 2026

    @mlisovyi
    mlisovyi
    on May 5, 2026

    Tests in #2205 seem to be failing with the same error as before (llama_decode: failed to decode, ret = -1) . @abetlen is that expected?

    Related to #2051 (same error).

  4. davidmezzetti commented on May 5, 2026

    @davidmezzetti
    davidmezzetti
    on May 5, 2026
    Author

    Agree. That PR looked vibe coded.

  5. davidmezzetti commented on May 11, 2026

    @davidmezzetti
    davidmezzetti
    on May 11, 2026
    Author

    Thank you 🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions