Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add convolution streaming pipeline notebook #353

Open
tbirdso opened this issue May 3, 2022 · 2 comments
Open

Add convolution streaming pipeline notebook #353

tbirdso opened this issue May 3, 2022 · 2 comments
Labels
Good first issue A good issue for community members new to contributing language:C++ Changes to C++ examples language:Python Changes to Python examples

Comments

@tbirdso
Copy link
Contributor

tbirdso commented May 3, 2022

Create a notebook example demonstrating how operations on large image input can be streamed in smaller, manageable chunks. Suggest reading from an .mha image (which supports streaming) and performing at least one convolution stage to demonstrate streaming behavior.

Reference Stream a Pipeline and itkConvolutionImageFilterStreamingTest. May be a slightly more challenging first issue, but a good way to learn the details about how the ITK pipeline model works.

@tbirdso tbirdso added Good first issue A good issue for community members new to contributing language:C++ Changes to C++ examples language:Python Changes to Python examples labels May 3, 2022
@Leengit
Copy link
Collaborator

Leengit commented May 3, 2022

Maybe it's not quite close enough to be of direct use, but in the context of machine learning and for getting the pixel data into Tensorflow, we do something similar in HistomicsStream. A large image is read chunk by chunk using large_image.

So you might check out the use of large_image starting at
https://github.com/DigitalSlideArchive/HistomicsStream/blob/121ba5fa1cd60aab203f73620f1caf64b936e5dd/histomics_stream/configure.py#L109
where some header information is extracted, and starting at
https://github.com/DigitalSlideArchive/HistomicsStream/blob/121ba5fa1cd60aab203f73620f1caf64b936e5dd/histomics_stream/tensorflow.py#L352
where it reads a chunk (e.g.,2048 × 2048 pixels) of an image.

@dzenanz
Copy link
Member

dzenanz commented May 17, 2022

Another example to possibly reference is https://github.com/OpenImaging/demos/tree/master/ProcessImageChunks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Good first issue A good issue for community members new to contributing language:C++ Changes to C++ examples language:Python Changes to Python examples
Projects
None yet
Development

No branches or pull requests

3 participants