Multidimensional vision sensors for information processing - PubMed (original) (raw)

Review

. 2024 Jul;19(7):919-930.

doi: 10.1038/s41565-024-01665-7. Epub 2024 Jun 14.

Affiliations

Review

Multidimensional vision sensors for information processing

Zhaoqing Wang et al. Nat Nanotechnol. 2024 Jul.

Abstract

The visual scene in the physical world integrates multidimensional information (spatial, temporal, polarization, spectrum and so on) and typically shows unstructured characteristics. Conventional image sensors cannot process this multidimensional vision data, creating a need for vision sensors that can efficiently extract features from substantial multidimensional vision data. Vision sensors are able to transform the unstructured visual scene into featured information without relying on sophisticated algorithms and complex hardware. The response characteristics of sensors can be abstracted into operators with specific functionalities, allowing for the efficient processing of perceptual information. In this Review, we delve into the hardware implementation of multidimensional vision sensors, exploring their working mechanisms and design principles. We exemplify multidimensional vision sensors built on emerging devices and silicon-based system integration. We further provide benchmarking metrics for multidimensional vision sensors and conclude with the principle of device-system co-design and co-optimization.

© 2024. Springer Nature Limited.

PubMed Disclaimer

References

    1. He, C., Shen, Y. & Forbes, A. Towards higher-dimensional structured light. Light. Sci. Appl. 11, 205 (2022). -PubMed -PMC -DOI
    1. Oike, Y. Expanding human potential through imaging and sensing technologies. In 2022 International Electron Devices Meeting (IEDM) 1.2.1–1.2.5 (IEEE, 2022). This is a paper on the imaging and sensing technologies in different dimensions.
    1. Zhou, F. & Chai, Y. Near-sensor and in-sensor computing. Nat. Electron. 3, 664–671 (2020). -DOI
    1. Zhou, F. et al. Optoelectronic resistive random access memory for neuromorphic vision sensors. Nat. Nanotechnol. 14, 776–782 (2019). -PubMed -DOI
    1. Wan, T. et al. In-sensor computing: materials, devices, and integration technologies. Adv. Mater. 35, 2203830 (2023). -DOI

Publication types

LinkOut - more resources