Skip to content

fix: correctly size Llama.scores when draft_model implies logits_all - #2384

Open
yadukpb wants to merge 1 commit into
abetlen:mainfrom
yadukpb:fix/draft-model-logits-all-scores-buffer
Open

yadukpb wants to merge 1 commit into
abetlen:mainfrom
yadukpb:fix/draft-model-logits-all-scores-buffer

fix: correctly size Llama.scores when draft_model implies logits_all

3af4316
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs