Single-frame 3D fluorescence microscopy with ultraminiature lensless FlatScope - PubMed (original) (raw)
Single-frame 3D fluorescence microscopy with ultraminiature lensless FlatScope
Jesse K Adams et al. Sci Adv. 2017.
Abstract
Modern biology increasingly relies on fluorescence microscopy, which is driving demand for smaller, lighter, and cheaper microscopes. However, traditional microscope architectures suffer from a fundamental trade-off: As lenses become smaller, they must either collect less light or image a smaller field of view. To break this fundamental trade-off between device size and performance, we present a new concept for three-dimensional (3D) fluorescence imaging that replaces lenses with an optimized amplitude mask placed a few hundred micrometers above the sensor and an efficient algorithm that can convert a single frame of captured sensor data into high-resolution 3D images. The result is FlatScope: perhaps the world's tiniest and lightest microscope. FlatScope is a lensless microscope that is scarcely larger than an image sensor (roughly 0.2 g in weight and less than 1 mm thick) and yet able to produce micrometer-resolution, high-frame rate, 3D fluorescence movies covering a total volume of several cubic millimeters. The ability of FlatScope to reconstruct full 3D images from a single frame of captured sensor data allows us to image 3D volumes roughly 40,000 times faster than a laser scanning confocal microscope while providing comparable resolution. We envision that this new flat fluorescence microscopy paradigm will lead to implantable endoscopes that minimize tissue damage, arrays of imagers that cover large areas, and bendable, flexible microscopes that conform to complex topographies.
Figures
Fig. 1. Traditional microscope versus FlatScope.
(A) Traditional microscopes capture the scene through an objective and tube lens (~20 to 460 mm), resulting in a quality image directly on the imaging sensor. (B) FlatScope captures the scene through an amplitude mask and spacer (~0.2 mm) and computationally reconstructs the image. Scale bars, 100 μm (inset, 50 μm). (C) Comparison of form factor and resolution for traditional lensed research microscopes, GRIN lens microscope, and FlatScope. FlatScope achieves high-resolution imaging while maintaining a large ratio of FOV relative to the cross-sectional area of the device (see Materials and Methods for elaboration). Microscope objectives are Olympus MPlanFL N (1.25×/2.5×/5×, NA = 0.04/0.08/0.15), Nikon Apochromat (1×/2×/4×, NA = 0.04/0.1/0.2), and Zeiss Fluar (2.5×/5×, NA = 0.12/0.25). (D) FlatScope prototype (shown without absorptive filter). Scale bars, 100 μm.
Fig. 2. T2S model.
(A) Illustration of the FlatScope model using a single fluorescent bead as the scene. (B) Fluorescent point source at depth d, represented as input image X d. (C) FlatScope measurement Y. FlatScope measurement can be decomposed as a superposition of two patterns: (D) pattern when there is no mask in place (open) and (E) pattern due to the coding of the mask. Each of the patterns is separable along x and y directions and can be written as (F and G) two separable transfer functions. The FlatScope model, which we call as the T2S, is the superposition of the two separable transfer functions.
Fig. 3. Resolution tests with the FlatScope prototype.
(A) Double slit with a 1.6-μm gap imaged with a 10× objective. (B) Captured FlatScope image. (C) FlatScope reconstruction of the double slit with a 1.6-μm gap. (D to F) FlatScope reconstructions of USAF resolution target at distances from the mask surface of 200 μm (D), 525 μm (E), and 1025 μm (F). Scale bar, 100 μm.
Fig. 4. 3D volume reconstruction of 10-μm fluorescent beads suspended in agarose.
(A) FlatScope reconstruction as a maximum intensity projection along the z axis as well as a ZY slice (blue box) and an XZ slice (red box). (B) Estimated 3D positions of beads from the FlatScope reconstruction. (C) Ground truth data captured by confocal microscope (10× objective). (D) Depth profile of reconstructed beads compared to ground truth confocal images. Empirically, we can see that the axial spread of 10-μm beads is around 15 μm in FlatScope reconstruction. That is, FlatScope’s depth resolution is less than 15 μm. The three beads shown are at depths of 255, 270, and 310 μm from the top surface (filter) of the FlatScope.
Fig. 5. 3D volumetric video reconstruction of moving 10-μm fluorescent beads.
(A) Subsection of FlatScope time-lapse reconstruction of 3D volume with 10-μm beads flowing in microfluidic channels (approximate location of channels drawn to highlight bead path and depth). Scale bar, 50 μm (FlatScope prototype graphic at the top not to scale). (B) Captured images of frames 1, 3, and 5 (false-colored to match time progression). (C and D) FlatScope reconstructions of frames 1, 3, and 5 at estimated depths of 265 and 355 μm, respectively (dashed lines indicate approximate location of microfluidic channels). Reconstructed beads false-colored to match time progression. Scale bar, 50 μm.
Similar articles
- Lensless microscopy by multiplane recordings: sub-micrometer, diffraction-limited, wide field-of-view imaging.
Istrate E, Pedrini G, Reichelt S. Istrate E, et al. Opt Express. 2023 Oct 23;31(22):36388-36401. doi: 10.1364/OE.503944. Opt Express. 2023. PMID: 38017792 - A workflow for 3D-CLEM investigating liver tissue.
Kremer A, VAN Hamme E, Bonnardel J, Borghgraef P, GuÉrin CJ, Guilliams M, Lippens S. Kremer A, et al. J Microsc. 2021 Mar;281(3):231-242. doi: 10.1111/jmi.12967. Epub 2020 Oct 27. J Microsc. 2021. PMID: 33034376 - Video-rate scanning confocal microscopy and microendoscopy.
Nichols AJ, Evans CL. Nichols AJ, et al. J Vis Exp. 2011 Oct 20;(56):3252. doi: 10.3791/3252. J Vis Exp. 2011. PMID: 22042305 Free PMC article. - Lensless Imaging and Sensing.
Ozcan A, McLeod E. Ozcan A, et al. Annu Rev Biomed Eng. 2016 Jul 11;18:77-102. doi: 10.1146/annurev-bioeng-092515-010849. Epub 2016 Jan 25. Annu Rev Biomed Eng. 2016. PMID: 27420569 Review. - Lensless digital holographic microscopy and its applications in biomedicine and environmental monitoring.
Wu Y, Ozcan A. Wu Y, et al. Methods. 2018 Mar 1;136:4-16. doi: 10.1016/j.ymeth.2017.08.013. Epub 2017 Aug 31. Methods. 2018. PMID: 28864356 Review.
Cited by
- Insertable Glucose Sensor Using a Compact and Cost-Effective Phosphorescence Lifetime Imager and Machine Learning.
Goncharov A, Gorocs Z, Pradhan R, Ko B, Ajmal A, Rodriguez A, Baum D, Veszpremi M, Yang X, Pindrys M, Zheng T, Wang O, Ramella-Roman JC, McShane MJ, Ozcan A. Goncharov A, et al. ACS Nano. 2024 Aug 27;18(34):23365-23379. doi: 10.1021/acsnano.4c06527. Epub 2024 Aug 13. ACS Nano. 2024. PMID: 39137319 Free PMC article. - DeepDOF-SE: affordable deep-learning microscopy platform for slide-free histology.
Jin L, Tang Y, Coole JB, Tan MT, Zhao X, Badaoui H, Robinson JT, Williams MD, Vigneswaran N, Gillenwater AM, Richards-Kortum RR, Veeraraghavan A. Jin L, et al. Nat Commun. 2024 Apr 5;15(1):2935. doi: 10.1038/s41467-024-47065-2. Nat Commun. 2024. PMID: 38580633 Free PMC article. - Three-dimensional topology-based analysis segments volumetric and spatiotemporal fluorescence microscopy.
Panconi L, Tansell A, Collins AJ, Makarova M, Owen DM. Panconi L, et al. Biol Imaging. 2023 Dec 14;4:e1. doi: 10.1017/S2633903X23000260. eCollection 2024. Biol Imaging. 2023. PMID: 38516632 Free PMC article. - Mesoscopic calcium imaging in a head-unrestrained male non-human primate using a lensless microscope.
Wu J, Chen Y, Veeraraghavan A, Seidemann E, Robinson JT. Wu J, et al. Nat Commun. 2024 Feb 10;15(1):1271. doi: 10.1038/s41467-024-45417-6. Nat Commun. 2024. PMID: 38341403 Free PMC article. - Real-time, deep-learning aided lensless microscope.
Wu J, Boominathan V, Veeraraghavan A, Robinson JT. Wu J, et al. Biomed Opt Express. 2023 Jul 10;14(8):4037-4051. doi: 10.1364/BOE.490199. eCollection 2023 Aug 1. Biomed Opt Express. 2023. PMID: 37799697 Free PMC article.
References
- Ozcan A., Demirci U., Ultra wide-field lens-free monitoring of cells on-chip. Lab Chip 8, 98–106 (2008). - PubMed
- Iddan G., Meron G., Glukhovsky A., Swain P., Wireless capsule endoscopy. Nature 405, 417 (2000). - PubMed
- A. Nikonorov, R. Skidanov, V. Fursov, M. Petrov, S. Bibikov, Y. Yuzifovich, Fresnel lens imaging with post-capture image processing, IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (IEEE, 2015), pp. 33–41.
Publication types
LinkOut - more resources
Full Text Sources
Other Literature Sources
Research Materials