Video-rate nanoscopy using sCMOS camera-specific single-molecule localization algorithms - PubMed (original) (raw)
doi: 10.1038/nmeth.2488. Epub 2013 May 26.
Tobias M P Hartwich, Felix E Rivera-Molina, Yu Lin, Whitney C Duim, Jane J Long, Pradeep D Uchil, Jordan R Myers, Michelle A Baird, Walther Mothes, Michael W Davidson, Derek Toomre, Joerg Bewersdorf
Affiliations
- PMID: 23708387
- PMCID: PMC3696415
- DOI: 10.1038/nmeth.2488
Video-rate nanoscopy using sCMOS camera-specific single-molecule localization algorithms
Fang Huang et al. Nat Methods. 2013 Jul.
Abstract
Newly developed scientific complementary metal-oxide semiconductor (sCMOS) cameras have the potential to dramatically accelerate data acquisition, enlarge the field of view and increase the effective quantum efficiency in single-molecule switching nanoscopy. However, sCMOS-intrinsic pixel-dependent readout noise substantially lowers the localization precision and introduces localization artifacts. We present algorithms that overcome these limitations and that provide unbiased, precise localization of single molecules at the theoretical limit. Using these in combination with a multi-emitter fitting algorithm, we demonstrate single-molecule localization super-resolution imaging at rates of up to 32 reconstructed images per second in fixed and living cells.
Figures
Fig. 1
sCMOS camera specific algorithms enable unbiased SMSN at the theoretical limit. (a) Readout variance map of a 128 × 128 pixel region in the center of a sCMOS camera. (b) Simulation of single emitters on a parallel line pair based on the shown variance map and localized using conventional MLE and MLEsCMOS. (c, d) Uncertainty estimator performance comparison for sCMOS camera data between conventional MLE and CRLB (c) and between MLEsCMOS and CRLBsCMOS (d) for different detected background photon values/pixel (bg) and single-molecule photon numbers incident on the camera chip. (e, f) Comparison of LLR, LLRsCMOS and the theoretically predicted distribution for two different locations on the camera chip. (g, h) Reconstructed super-resolution images of microtubules analyzed using conventional (g) and sCMOS algorithms (h). (i) Maximum projection of raw data used for (g, h) representing the diffraction-limited image. (j) Difference images of (g) and (h). Zero differences are shown in gray. (k) Difference image of another microtubule data set recorded in the same camera region. Artifacts in (g, j, k) correlate with high-noise pixels in (a) as highlighted by the white circles. The yellow boxes in (a, g–k) denote the positions of the enlarged sections shown in the insets. (l) Relative improvement in localization precision predicted by CRLB for EMCCD cameras and CRLBsCMOS for sCMOS, respectively. Color bars: (a, b) 0–400 ADU2; (i) min-max signal; (g, h) normalized to same scale; (j, k) normalized to same scale. Scale bar in (a, g–k): 2 µm.
Fig. 2
Unbiased, fast SMSN of fixed microtubules and focal adhesions demonstrating high-throughput capabilities. (a) Super-resolution image of microtubules in a 53 × 53 µm2 ROI imaged at 400 fps in 40 s. The data set was processed by the new sCMOS-specific algorithm resulting in about 4.4 million position estimates after filtering. The area marked by the blue box is shown in the inset as a maximum projection of the raw data (entire analyzed data set) representing the diffraction-limited wide-field image and as the super-resolution image. For visualization purposes, the upper bound in the color table has been adjusted for the overview image. (b) Enlarged maximum projection of raw data and super-resolution image of the area highlighted by the green box in (a). (c,d) Line profiles of position estimates in the small yellow boxes shown in (a) and (b), respectively. (e) Maximum projection of a microtubule raw data set recorded in a 6.5 × 6.5 µm2 FOV at 3,200 fps in 2 s total. (f–h) Reconstructed super-resolution images obtained from different subsets of the same raw data stack using sCMOS-specific multi-emitter fitting. (i,j) Maximum projection of a data set showing the distribution of Paxillin in focal adhesions recorded in 3 s and the corresponding super-resolution image, respectively. (k) Enlarged display of the area marked by the white boxes in (i,j). (l) Profile displaying the distribution of position estimates in the yellow box shown in the super-resolution image in (k).
Fig. 3
Live-cell SMSN at 0.5 to 2 s temporal resolution. (a) Super-resolution image of mEos3.2-labeled clathrin-coated pits (CCPs) in a live HeLa cell. The localization estimates are colored according to their recording time. (b) The enlarged image of the area marked by the yellow box in (a) reveals that movements of the structures over the course of recording obscure the details in the image. (c) Rings representing axial projections of CCPs can be resolved when displaying only a 2-s time window of the data. (d–f) Peroxisome dynamics in a live COS-7 cell labeled by tdEos. (d) Overview image of an 83-s data set. Data has been colored analogous to (a). (e) Super-resolution images and maximum projections of the raw data from the area in the green box in (d) in short 0.5-s time intervals. (f) Super-resolution images at 0.5-s time resolution of the area highlighted by the blue box in (d). Only every second frame is shown. See also Supplementary Fig. 10 and Supplementary Videos 1–5, 8 and 9.
Fig. 4
Video-rate live-cell nanoscopy of transferrin receptor clusters in live EA.hy926 cells. (a–b) Two examples of super-resolved transferrin cluster dynamics from a larger data set. Asterisks show splitting of single clusters into multiple clusters. Super-resolution images at a slower rate (~4 super-resolution images/s; shown on the left) lead to artifactual structures due to diffusion as visualized by reconstructed sequences of the same data at higher frame rates (~32 super-resolution images/s; on the right).
Similar articles
- Quantitative performance evaluation of a back-illuminated sCMOS camera with 95% QE for super-resolution localization microscopy.
Wang Y, Zhao L, Hu Z, Wang Y, Zhao Z, Li L, Huang ZL. Wang Y, et al. Cytometry A. 2017 Dec;91(12):1175-1183. doi: 10.1002/cyto.a.23282. Epub 2017 Nov 22. Cytometry A. 2017. PMID: 29165899 - Correcting Artifacts in Single Molecule Localization Microscopy Analysis Arising from Pixel Quantum Efficiency Differences in sCMOS Cameras.
Babcock HP, Huang F, Speer CM. Babcock HP, et al. Sci Rep. 2019 Dec 2;9(1):18058. doi: 10.1038/s41598-019-53698-x. Sci Rep. 2019. PMID: 31792238 Free PMC article. - Localization-based super-resolution microscopy with an sCMOS camera.
Huang ZL, Zhu H, Long F, Ma H, Qin L, Liu Y, Ding J, Zhang Z, Luo Q, Zeng S. Huang ZL, et al. Opt Express. 2011 Sep 26;19(20):19156-68. doi: 10.1364/OE.19.019156. Opt Express. 2011. PMID: 21996858 - Evaluation of sCMOS cameras for detection and localization of single Cy5 molecules.
Saurabh S, Maji S, Bruchez MP. Saurabh S, et al. Opt Express. 2012 Mar 26;20(7):7338-49. doi: 10.1364/OE.20.007338. Opt Express. 2012. PMID: 22453414 Free PMC article. - PALM and STORM: Into large fields and high-throughput microscopy with sCMOS detectors.
Almada P, Culley S, Henriques R. Almada P, et al. Methods. 2015 Oct 15;88:109-21. doi: 10.1016/j.ymeth.2015.06.004. Epub 2015 Jun 14. Methods. 2015. PMID: 26079924 Review.
Cited by
- High-speed optical imaging with sCMOS pixel reassignment.
Mandracchia B, Zheng C, Rajendran S, Liu W, Forghani P, Xu C, Jia S. Mandracchia B, et al. Nat Commun. 2024 May 30;15(1):4598. doi: 10.1038/s41467-024-48987-7. Nat Commun. 2024. PMID: 38816394 Free PMC article. - Ultra-high spatio-temporal resolution imaging with parallel acquisition-readout structured illumination microscopy (PAR-SIM).
Xu X, Wang W, Qiao L, Fu Y, Ge X, Zhao K, Zhanghao K, Guan M, Chen X, Li M, Jin D, Xi P. Xu X, et al. Light Sci Appl. 2024 May 29;13(1):125. doi: 10.1038/s41377-024-01464-8. Light Sci Appl. 2024. PMID: 38806501 Free PMC article. - Toward drift-free high-throughput nanoscopy through adaptive intersection maximization.
Ma H, Chen M, Nguyen P, Liu Y. Ma H, et al. Sci Adv. 2024 May 24;10(21):eadm7765. doi: 10.1126/sciadv.adm7765. Epub 2024 May 23. Sci Adv. 2024. PMID: 38781327 Free PMC article. - A statistical resolution measure of fluorescence microscopy with finite photons.
Li Y, Huang F. Li Y, et al. Nat Commun. 2024 May 4;15(1):3760. doi: 10.1038/s41467-024-48155-x. Nat Commun. 2024. PMID: 38704387 Free PMC article. - RASP: Optimal Single Puncta Detection in Complex Cellular Backgrounds.
Fu B, Brock EE, Andrews R, Breiter JC, Tian R, Toomey CE, Lachica J, Lashley T, Ryten M, Wood NW, Vendruscolo M, Gandhi S, Weiss LE, Beckwith JS, Lee SF. Fu B, et al. J Phys Chem B. 2024 Apr 18;128(15):3585-3597. doi: 10.1021/acs.jpcb.4c00174. Epub 2024 Apr 9. J Phys Chem B. 2024. PMID: 38593280 Free PMC article.
References
- Hell SW. Nat. Methods. 2009;6:24–32. - PubMed
- Van de Linde S, Heilemann M, Sauer M. Annu. Rev. Phys. Chem. 2012;63:519–540. - PubMed
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Research Materials