Optimal Control for Multidimensional Microscopy (original) (raw)

An optical microscopy system for 3D dynamic imaging

PROCEEDINGS-SPIE THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING, 1996

AB STRACT We describe a prototype three-dimensional (3D) optical microscopy system that utilizes parallel computing and high-speed networks to address a major obstacle to successful implementation of 3D dynamic microscopy: the huge computational demand of real-time dynamic 3D acquisition, reconstruction, and display, and the highbandwidth demand of data transfer for remote processing and display. The system comprises image acquisition hardware and software, high-speed networks between acquisition and ...

Optical microscopy system for 3D dynamic imaging

1996

We describe a prototype 3D optical microscopy system that utilizes parallel computing and high-speed networks to address a major obstacle to successful implementation of 3D dynamic microscopy: the huge computational demand of real-time dynamic 3D acquisition, reconstruction, and display, and the high-bandwidth demand of data transfer for remote processing and display. The system comprises image acquisition hardware and software, high-

Spatio-Temporal Reconstruction Techniques for Optical Microscopy

2015

Author(s): Chacko, Nikhil | Advisor(s): Liebling, Michael | Abstract: Optical microscopy offers the unique possibility to study living samples under conditions akin to their native state. However, the technique is not void of inherent problems such as optical blur due to light diffraction, contamination with out-of-focus light from adjacent focal planes, and spherical aberrations. Furthermore, with a dearth of techniques that are capable of imaging multiple focal sections in quick succession, the multi-dimensional capture of dynamically changing samples remains a challenge of its own. Computational techniques that use auxiliary knowledge about the imaging system and the sample to mitigate these problems are hence of great interest in optical microscopy.The first part of this thesis deals with the design of a discrete model to characterize light propagation. Following the scalar diffraction theory in optics, we propose a discrete algorithm, based on generalized sampling theory, to re...

Optical microscopy system for 3D dynamic imaging

Three-Dimensional Microscopy: Image Acquisition and Processing III, 1996

We describe a prototype three-dimensional (3D) optical microscopy system that utilizes parallel computing and high-speed networks to address a major obstacle to successful implementation of 3D dynamic microscopy: the huge computational demand of real-time dynamic 3D acquisition, reconstruction, and display, and the highbandwidth demand of data transfer for remote processing and display. The system comprises image acquisition hardware and software, high-speed networks between acquisition and processing environments, parallel restoration using wavelet algorithms, and volume rendering and display in a virtual environment.

Computational multifocal microscopy

Biomedical Optics Express, 2018

Despite recent advances, high performance single-shot 3D microscopy remains an elusive task. By introducing designed diffractive optical elements (DOEs), one is capable of converting a microscope into a 3D "kaleidoscope", in which case the snapshot image consists of an array of tiles and each tile focuses on different depths. However, the acquired multifocal microscopic (MFM) image suffers from multiple sources of degradation, which prevents MFM from further applications. We propose a unifying computational framework which simplifies the imaging system and achieves 3D reconstruction via computation. Our optical configuration omits chromatic correction grating and redesigns the multifocal grating to enlarge the tracking area. Our proposed setup features only one single grating in addition to a regular microscope. The aberration correction, along with Poisson and background denoising, are incorporated in our deconvolution-based fully-automated algorithm, which requires no empirical parameter-tuning. In experiments, we achieve the spatial resolutions of 0.35um (lateral) and 0.5um (axial), which are comparable to the resolution that can be achieved with confocal deconvolution microscopy. We demonstrate a 3D video of moving bacteria recorded at 25 frames per second using our proposed computational multifocal microscopy technique.

Dynamic autofocus for continuous-scanning time-delay-and-integration image acquisition in automated microscopy

Journal of Biomedical Optics

Efficient image cytometry of a conventional microscope slide means rapid acquisition and analysis of 20 gigapixels of image data ͑at 0.3-m sampling͒. The voluminous data motivate increased acquisition speed to enable many biomedical applications. Continuous-motion time-delay-and-integrate ͑TDI͒ scanning has the potential to speed image acquisition while retaining sensitivity, but the challenge of implementing high-resolution autofocus operating simultaneously with acquisition has limited its adoption. We develop a dynamic autofocus system for this need using: 1. a "volume camera," consisting of nine fiber optic imaging conduits to charge-coupled device ͑CCD͒ sensors, that acquires images in parallel from different focal planes, 2. an array of mixed analog-digital processing circuits that measure the high spatial frequencies of the multiple image streams to create focus indices, and 3. a software system that reads and analyzes the focus data streams and calculates best focus for closed feedback loop control. Our system updates autofocus at 56 Hz ͑or once every 21 m of stage travel͒ to collect sharply focused images sampled at 0.3ϫ 0.3 m 2 /pixel at a stage speed of 2.3 mm/ s. The system, tested by focusing in phase contrast and imaging long fluorescence strips, achieves high-performance closed-loop imagecontent-based autofocus in continuous scanning for the first time.

Computer vision methods for optical microscopes

Image and Vision Computing, 2007

As the fields of micro-and nano-technology mature, there is an increasing need to build tools that are able to work in these areas. Industry will require solutions for assembling and manipulating components, much as it has done in the macro range. With this need in mind, a new set of challenges requiring novel solutions have to be met. One of them is the ability to provide closed-loop feedback control for manipulators. Because of unmatched flexibility by other solutions we foresee that visual servoing will play a leading role in this area. After introducing some of the most important issues related to micro-imaging and micro-vision, we present, as an illustration, a modified particle filter tracking technique and two depth reconstruction methods which are suitable for micro-objects placed under an optical microscope.