Skip to content

Fix/scicode inspect stream - #69

Open
wangyunihan wants to merge 8 commits into
scicode-bench:mainfrom
MichaelYang-lyx:fix/scicode-inspect-stream
Open

wangyunihan wants to merge 8 commits into
scicode-bench:mainfrom
MichaelYang-lyx:fix/scicode-inspect-stream

Conversation

@wangyunihan

Copy link
Copy Markdown

Summary

  • Add streaming support for SciCode Inspect model calls.
  • Record generation errors and support stopping the evaluation without scoring failed samples.
  • Add tests for streaming and generation error handling.

Validation

  • SciCode Inspect native tests: 9 passed.
  • Tests used a mock model; no live model requests were made.

@wangyunihan
wangyunihan force-pushed the fix/scicode-inspect-stream branch from 91e30f4 to 8491d81 Compare November 16, 2026 12:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant