Repository navigation
Forward the controller preview size, and validate --bind in the paired CLI - #9
Closed
Omair-Asdaq wants to merge 2 commits into
Closed
Omair-Asdaq wants to merge 2 commits into
Omair-Asdaq wants to merge 2 commits into
Conversation
worker_command passed a literal 81 pixels for the none/default streams, so a controller-level --vis-pixels had no effect there while <output>.metadata.json still recorded it as an applied argument. Forward args.vis_pixels instead: the none/default preview stays 81 pixels by default and the full stream still uses args.pixels.
The paired driver validated pixels, repeats, durations, effects, streams and interpreters but accepted any --bind, so a bad address created the output directory and a manifest whose commands can never succeed and then failed every trial. Mirror the pixel runner's check so the invalid argument is reported once, with the same parser error and exit status.
Omair-Asdaq
marked this pull request as ready for review
October 17, 2026 18:47
Author
|
no reply from mantainer I am closing this Pr |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Two small fixes, plus one finding I deliberately did not fix.
--vis-pixelswas ignored fornone/defaultstreams, but recorded as appliedworker_commandalways forwarded thefull-stream pixel count, so a--vis-pixelsvalue had no effect on the preview streams — while<output>.metadata.jsonrecorded it as applied, meaning the report claimed a preview size the run never used. It now forwardsargs.pixelsforfullandargs.vis_pixelsotherwise, and the 81-pixel default is preserved.Repro:
Options(vis_pixels=1024)with adefaultstream forwarded--vis-pixels 81before and1024now.fullstill usesargs.pixels, and the argv for every other case I compared is byte-identical.The paired CLI never validated
--bindmatrix.pyaccepted any bind string, unlikeoptions.py. A non-loopback bind therefore created the output directory and manifest and then failed every trial — the pixel runner rejects the same value anyway — leaving a half-written output directory behind.matrix.parse_argsnow applies the same--bind must be an IPv4 loopback addresscheck, so it exits 2 before creating anything.Repro:
matrix ... --bind 192.0.2.1 --plan-onlywrote a manifest and returned 0 before; it now exits 2 with no output directory.127.0.0.1and127.0.0.2are still accepted.Not fixed:
--baselinecompares unlike measurement windowsscenario_keyomits the measurement window, so--baselinewill happily match rows measured over different--secondsvalues — contrary to the README, which promises that missing matches fail instead of silently comparing unlike workloads. The obvious fix (adding the row'ssecondsto the key) is wrong, and I'm flagging it rather than shipping it:secondsis the measured window (end - begin, aperf_counterdelta), so two runs of the same command differ by about a millisecond;matrix.paired_summaryraisesValueError: Paired workloads differon the first real pair — both rows come from one command line, but they record slightly different windows — soledfx-paired-benchdies mid-campaign;--baselinethen fails even on identical workloads, andgroup_rowssplits the repeats of one scenario into separate groups, turning the reported medians into single-sample values.The identity should key the requested window instead — e.g. record
args.seconds/args.warmupas their own row fields and key on those. That changes the row schema, so it needs a call on whether existing baseline files should be invalidated.Tests
One regression test per fix; both fail on the current
mainand pass here. The suite is26 passed, 3 failed, and the 3 failures are pre-existing and Windows-only — path separators intest_migration.py/test_integrity.py, plus onePath.as_uri()on a drive-relative path intest_integrity.py— untouched by these commits.ruffandpyreflyaren't installed in my environment, so I couldn't run the lint/type gates; the changed lines follow the surrounding style (88 columns, one argument per line).