Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Reconstruction method of microscopic light field volume imaging and its forward process and back projection acquisition method

An acquisition method and technology of light field body, applied in microscopes, optics, optical components, etc., can solve the problems of long time consumption and large amount of calculation, and achieve the effect of improving reconstruction speed and convolution calculation speed.

Active Publication Date: 2020-07-31
PEKING UNIV
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The amount of calculation in this method is very large. The existing method uses FFT (the Chinese full name is "Fast Fourier Transform") to calculate the convolution, but due to the large number of convolutions, the calculation process takes a long time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Reconstruction method of microscopic light field volume imaging and its forward process and back projection acquisition method
  • Reconstruction method of microscopic light field volume imaging and its forward process and back projection acquisition method
  • Reconstruction method of microscopic light field volume imaging and its forward process and back projection acquisition method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] The present invention will be described in detail below in conjunction with the accompanying drawings and embodiments.

[0049] Such as figure 2 , image 3 and Figure 5 As shown, the forward process acquisition method in the reconstruction method of microscopic light field volume imaging provided in this embodiment intends to obtain a light field image f based on a known 3D volume image g, and the method includes:

[0050] Step 1, according to the 3D volume image (M 2 ,M 2 , S), whose size is M 2 , the number of layers is S, and the 3D-volume image is decomposed into N×N×S layer images, and the size of each layer image is M 2 × M 2 . Among them, each layer image is composed of multiple 2D sub-images c with a size of N×N, and the pixel value of each 2D sub-image c is 0 except for the pixel d at the coordinate (i, j), 1≤i≤N , 1≤j≤N.

[0051] Step 2, extracting the pixel d at the coordinate (i, j) on each layer image to rearrange into multiple single-channel ima...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for reconstructing volumetric imaging in a microscopic light field and its forward process and back-projection acquisition method. Composed of 2D sub-images, the pixel value of each 2D sub-image is zero except for coordinates (i, j); step 2, extract the pixels at coordinates (i, j) on each layer image to rearrange into a single channel image, stack all single-channel images into multi-channel images; step 3, rearrange the 5D point spread function of the light field microscope into a 4D convolution kernel; step 4, use the multi-channel images obtained in step 2 as the convolutional neural network Network input, use the 4D convolution kernel obtained in step 3 as the weight of the convolutional neural network, use the 4D convolution kernel to convolve the multi-channel image, and output the multi-channel image; step 5, rearrange the multi-channel image output in step 4 is the light field image. The invention can greatly increase the convolution calculation speed, thereby improving the image reconstruction speed.

Description

technical field [0001] The invention relates to the technical field of light field microscope image reconstruction, in particular to a reconstruction method of microscopic light field volume imaging and its forward process and back projection acquisition methods. Background technique [0002] Light-field microscopy is a fast bulk imaging method. By adding a microlens array on the phase plane, the traditional fluorescence microscope can be changed into a light-field microscope (such as figure 1 shown). Conventional microscopes can only perform 2D imaging, while light field microscopes can perform 3D imaging. The specific process is to take a light field image, and then use the light field image to reconstruct the 3D distribution of objects. [0003] Such as figure 1 Shown are typical microscopes, light field microscopes, and light field images of zebrafish captured by light field microscopes, respectively. Note that the images taken by the light field microscope have a typ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G02B21/36
CPCG02B21/367
Inventor 毛珩张光义陈良怡
Owner PEKING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com