Skip to content

VolkerH/DaskFusion

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

58 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

DOI

DaskFusion

This repo contains proof-of-concept code that fuses many image tiles from a microscopy scan, where the position of each tile is known from the microscopy stage metadat, into a large "fused" array.

This is achieved using the map_blocks functionality from dask.array which takes care of out-of-core processing, i.e. we can generate an array of mosaiced tiles that is much larger than what we can hold in RAM on a particular machine.

The notebook DaskFusion_Example.ipynb explains the approach. We use shapely to visualize the locations of the tiles in the notebook and also to find tiles that overlap the individual blocks (chunks) that we process.

In principle, this approach can be used to generate very large photomosaics, from collections of image tiles with known affine or even perspective transforms.

Caveats:

  • Regions with multiple ovberlapping tiles are simply merged using a maximum projection. In practice, you would want to amend the fuse function with a smooth blending method.
  • We assume the affine transforms are known. We disregard fine tuning the transformations to get pixel-perfect registration. Situations where the transformations are not known or require fine-tuning can be handled for exampl by SIFT-feature point matching between overlapping tiles and calculation of the transformations from feature point correspondences.
  • This is not production-quality code.

Additional reading and related work

We wrote up a small blog post on this proof of concept for the Dask Blog.

Some feedback on the blog post by Tobias deJong points out a very similar approach that allows incorporates optimization of tile positions, see this notebook.

Citation information

See: https://doi.org/10.5281/zenodo.10715850 for citation information

About

Fusing image tiles with dask array's map_blocks

Resources

License

Stars

Watchers

Forks

Packages

No packages published