Skip to content

eval: 冻结公开入口画像 dev 集 entry_profile_v2 - #129

Merged
leafliber merged 1 commit into
mainfrom
eval/entry-profile-dev-v2
Oct 19, 2026
Merged

leafliber merged 1 commit into
mainfrom
eval/entry-profile-dev-v2

Conversation

@leafliber

Copy link
Copy Markdown
Member

按 EF-28 冻结规划者定稿的公开 dev 集,供后续 EXP2 发现实验使用。两份文件原样复制,工作区和暂存内容均与指定原稿逐字节一致;本 PR 仅新增这两份文件,不改代码、提示词、评分或既有计划内容。

  • entry_profile_v2.json:12例(EP101—EP112)、966条消息、74项 must_cover、136项 forbidden;现有 runner.load_corpus 解析通过。
  • JSON SHA-256:7a434db4c92923ff6e6ec09f056d3f13f7ba3c45eaa1b4b7d53cc3e4fbc26f77,与规划者指定值一致。
  • notes SHA-256:add089a47f0e35dc21a92b3dfd985270a5d05be48d319c663dd386466608a213。

验证按顺序完成:

  • uv run pytest,Python 3.13.13:5407通过,8个warning,1286.27秒。
  • uv run --locked --isolated --python 3.12 pytest,Python 3.12.12:5407通过,8个warning,1284.95秒。
  • uv build:wheel/sdist构建通过,包中无测试模型配置或密钥文件。
  • 测试后语料指纹不变,源码无改动;已清理本worktree的 .pytest-tmp,.venv仍为3.13。完整日志放仓库外。

本轮没有调用真实模型、没有运行 EXP2 或做质量判分。第二步等待规划者错开模型额度后另行通知;本 PR 不合并。

@leafliber
leafliber merged commit 93d1be9 into main Oct 19, 2026
1 check passed
@leafliber
leafliber deleted the eval/entry-profile-dev-v2 branch October 19, 2026 19:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant