Skip to content

PLAN: finding 38 with the Poco measured like the SM8850 - #8

Merged
alpharomercoma merged 1 commit into
mainfrom
docs-poco-cpu-gpu
Oct 4, 2026
Merged

alpharomercoma merged 1 commit into
mainfrom
docs-poco-cpu-gpu

Conversation

@alpharomercoma

@alpharomercoma alpharomercoma commented Oct 4, 2026 •

Copy link
Copy Markdown
Member

Documentation only. Finding 38 and the Vulkan bullet in docs/PLAN.md now carry the POCO's like-for-like CPU-vs-GPU run, measured through openweights' engine and ExecuServe. The Mali-G925 had no long-prompt CPU run before this.

  • Decode: the CPU decodes 2.2–3.7× faster at every length.
  • Prefill: the GPU only reads long prompts faster, 1.2–1.5×.

The raw logs and the runs CSV are in openweights tools/eval/results/vulkan-2026-10-04/.

pytest passes.

🤖 Generated with Claude Code


View with [code]smith
Need help on this PR? Tag @codesmith-bot with what you need. Autofix is enabled.

… had no long-prompt CPU run

On Mali the CPU file decodes 2.2 to 3.7 times faster at every length and the GPU only reads a
long prompt faster, 1.2 to 1.5 times; the study's raw files are in openweights.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@alpharomercoma
alpharomercoma merged commit a121997 into main Oct 4, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant