Skip to content

Async stats#61

Open
joshmoore wants to merge 6 commits intoome:mainfrom
joshmoore:async-stats
Open

Async stats#61
joshmoore wants to merge 6 commits intoome:mainfrom
joshmoore:async-stats

Conversation

@joshmoore
Copy link
Copy Markdown
Member

The parse.py command asynchronously parses all the CSVs to discover Zarrs and then from their attempts to load all JSONs within the Zarrs. Running the code then prints all (or nearly all) files other than chunks to stderr which can be captured and passed to wget.

https://github.com/ome/ome2024-ngff-challenge-metadata is the result of:

./parse 2>&1 | tee log
# cleanup the misc. logging
wget -x -i log
git add *

cc: @will-moore @khaledk2 @perlman

@netlify
Copy link
Copy Markdown

netlify Bot commented Oct 11, 2024

Deploy Preview for ngff-challenge canceled.

Name Link
🔨 Latest commit f003985
🔍 Latest deploy log https://app.netlify.com/sites/ngff-challenge/deploys/67091062399ebe00082fc518

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant