Repository navigation
Views for the rest: names and trees, plans before writing, import preview, histogram explorer; version 0.10.10 - #43
Merged
Conversation
…view, histogram explorer; version 0.10.10 On a terminal, under the one view rule (--batch-process or DATA_BEANS_BATCH=1 runs straight through): - histogram opens the stat explorer on the --stat and --dim asked; -o values are still written. - row-names and column-names open a names browser, list-h5 and list-zarr a tree of the file (interactive::list_tui): / filters, Space marks, w writes the marked or shown entries (a tree's as paths), y copies. Batch output is unchanged. - merge-backend, merge-mtx, align-data, subsample and split show a plan of what they write before writing (interactive::plan_tui): inputs and what they share, the output and its size, and settings on keys (common rows, squeeze, data types, cells, genes, test fraction, folds, seed, grid), each change replanning. Enter writes; q writes nothing; a plan that cannot be written says why. - Every from-* build ends in an import preview: rows' and columns' non-zeros on log bins with the squeeze cutoffs, cutoffs and squeeze on keys. Enter keeps the build, q deletes it. The merge, align, subsample and split bodies take what the plan decided as arguments; qc's pooling and the MCP server run them in batch.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The remaining commands get first-class views, under the one view rule from #42: on a terminal they open, and
--batch-processorDATA_BEANS_BATCH=1runs them straight through. MCP and qc's internal pooling always run in batch.Browse
histogramopens the stat explorer on the--statand--dimasked (StatExplorer::on_stat);-ovalues are still written.row-names/column-namesopen a names browser (newinteractive::list_tui):/filters (a regular expression when the text is one), Space marks,amarks the shown entries,wwrites the marked (or shown) names,ycopies them. A file-ois still written.list-h5/list-zarrshow the file as a tree in the same browser; Enter or the arrows open and close groups, andwwrites paths. Batch output is byte-for-byte what it was.Plan before writing
New
interactive::plan_tui: a table of what will be written, notes, and settings on keys. Each change redraws the plan, Enter writes, andqwrites nothing. A plan that can't be written says why, and Enter waits.merge-backend: each input's rows and columns, the rows every input has and those only some have, and the output size.csets common rows andssqueeze. Files whose rows differ block untilc.merge-mtx: the MTX sets found and their common rows;ssqueeze.align-data: each file's data type and column group, and the rows and columns each keeps;rsets the data types.subsample: input against output size, and expected entries;ncells,ggenes,sseed.split: train and test cells per fold;ttest fraction,kfolds,sseed, andggrid under--coord.The merge, align, subsample and split bodies now take what the plan decided as arguments. Their batch behaviour is unchanged.
Import preview
Every
from-*build ends with the rows' and columns' non-zeros on log bins, with the squeeze cutoffs marked.ssqueeze andr/ccutoffs are settings. Enter keeps the build, squeezed if on;qdeletes it.Note
On a terminal,
merge-*,align-data,subsample,splitandfrom-*now wait for Enter. A script started from a terminal shouldexport DATA_BEANS_BATCH=1or pass--batch-process. The README says so.Version
0.10.10. A patch release: the new library API (
list_tui,plan_tui,StatExplorer::on_stat,zarr_io::output_path) is additive.Testing
cargo fmt --check,cargo clippy --all-targets --features sim -- -D warnings, andcargo test(219 lib, 97 bin, and the integration suites) pass.cargo check --all-targetspasses with--features hdf5,--features alg, and--no-default-features --features aux,tui.on_stat, the zarr and zip tree parsers, merge and align plan counts, split and subsample settings, and import-preview counts and histogram lines.