Visualization and processing of multidimensional data using prefiltering and sorting criteria

Abstract

Complex multidimensional datasets generated by digital imaging spectroscopy can be organized and analyzed by applying software and computer-based methods comprising sorting algorithms. Combinations of these algorithms to images and graphical data, allow pixels or features to be rapidly and efficiently classified into meaningful groups according to defined criteria. Multiple rounds of pixel or feature selection may be performed based on independent sorting criteria. In one embodiment sorting by spectral criteria (e.g., intensity at a given wavelength) is combined with sorting by temporal criteria (e.g., absorbance at a given time) to identify microcolonies of recombinant organisms harboring mutated genes encoding enzymes having desirable kinetic attributes and substrate specificity. Restriction of the set of pixels analyzed in a subsequent sort based on criteria applied in an earlier sort (“sort and lock” analyses) minimize computational and storage resources. User-defined criteria can also be incorporated into the sorting process by means of a graphical user interface that comprises a visualization tools including a contour plot, a sorting bar and a grouping bar, an image window, and a plot window that allow run-time interactive identification of pixels or features meeting one or more criteria, and display of their associated spectral or kinetic data. These methods are useful for extracting information from imaging data in applications ranging from biology and medicine to remote sensing.

Description

RELATED APPLICATION DATA [0001] This application is a divisional of co-pending U.S. patent application Ser. No. 09 / 767,595, filed Jan. 22, 2001, now U.S. Pat. No. ______, which claims the benefit of U.S. Provisional Application No. 60 / 177,575, filed Jan. 22, 2000 and U.S. Provisional Application No. 60 / 186,034, filed Mar. 1, 2000, the entire disclosures of which are hereby incorporated by reference in their entirety.STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT [0002] The U.S. Government has certain rights in this invention pursuant to Grant No. R44GM5555470 awarded by the National Institutes of Health.FIELD OF THE INVENTION [0003] The current invention relates generally to the visualization and processing of multidimensional data, and in particular, to data formed from a series of images. BACKGROUND OF THE INVENTION [0004] Sophisticated analysis of imaging data requires software that can rapidly identify meaningful regions of the image. Depending on the size and n...

AI Technical Summary

Benefits of technology

[0008] Sorting can also be used for sequentially analyzing images and graphical data, such that the pixels that are ultimately displayed are restricted by at least two independent criteria. For example, pixels or features that have been extracted based on selected spectral criteria (e.g., absorbance) can be further analyzed based on temporal criteria (e.g., kinetics). This method of combined analysis provides a means for rapidly and efficiently extracting useful information from massive amounts of data. A further embodiment of sequential sorting involves discarding unwanted data during the sorting process. This ‘sort and lock’ procedure provides a useful new tool for data compression. This method for sorting and displaying multidimensional data from an image stack comprises the steps of: (a) selecting a subset of pixels from an image by a first algorithm; (b) discarding the pixels that are not selected; (c) selecting a subset of the remaining pixels by a second sorting algorithm; and (d) automatically indicating the final selection of pixels by back-coloring the corresponding pixels in the image. This type of multidimensional analysis can also be performed by manipulating the contour plot window. The method comprises the steps of (a) sorting the pixels by a first algorithm; (b) automatically indicating on the contour plot pixels sorted by the first algorithm; (c) selecting a subset of pixels in the contour plot; (d) sorting the subset of pixels by applying a second algorithm; (e) selecting a reduced subset of pixels in the contour plot; and (f) automatically indicating the final selection of pixels by backcoloring the reduced subset of pixels in the image. The present invention also provides a method for displaying a grouping bar that can be used to analyze images and graphical data within the graphical user interface (“GUI”). The grouping bar enables the user to segregate groups of pixels or features within a contour plot, and thereby facilitates independent sorting and backcoloring of the individual groups of pixels or features in the image. The methods of the present invention are applicable to a variety of problems involving complex, multidimensional, or gigapixel imaging tasks, including (for example) automated screening of genetic libraries expressing enzyme variants.

Problems solved by technology

In addition to requiring a burdensome amount of processing time, prior art sorting algorithms that may have been adequate to categorize and classify relatively noiseless feature data are not necessarily successful in sorting single-pixel spectra without additional parameters or human intervention.

Images