Faces and objects in macaque cerebral cortex (original) (raw)

References

  1. Ungerleider, L. & Mishkin, M. Two cortical visual systems. in Analysis of Visual Behavior (ed. Ingle, D.) 549–586 (MIT Press, Cambridge, Massachusetts, 1982).
    Google Scholar
  2. Logothetis, N. & Sheinberg, D. Visual object recognition. Annu. Rev. Neurosci. 19, 577–621 (1996).
    Article CAS Google Scholar
  3. Gross, C.G., Rocha-Miranda, C.E. & Bender, D.B. Visual properties of neurons in inferotemporal cortex of the macaque. J. Neurophysiol. 35, 96–111 (1972).
    Article CAS Google Scholar
  4. Desimone, R., Albright, T., Gross, C.G. & Bruce, C. Stimulus-selective properties of inferior temporal neurons in the macaque. J. Neurosci. 4, 2051–2062 (1984).
    Article CAS Google Scholar
  5. Perrett, D., Hietanen, J., Oram, M. & Benson, P. Organization and function of cells responsive to faces in the temporal cortex. Phil. Trans. R. Soc. Lond. 335, 23–30 (1992).
    Article CAS Google Scholar
  6. Baylis, G., Rolls, E. & Leonard, C. Functional subdivisions of the temporal lobe neocortex. J. Neurosci. 7, 330–342 (1987).
    Article CAS Google Scholar
  7. Tanaka, K., Saito, H., Fukada, Y. & Moriya, M. Coding visual images of objects in the inferotemporal cortex of the macaque monkey. J. Neurophysiol. 66, 170–189 (1991).
    Article CAS Google Scholar
  8. Kanwisher, N., McDermott, J. & Chun, M. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 17, 4302–4311 (1997).
    Article CAS Google Scholar
  9. Haxby, J. et al. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293, 2425–2430 (2001).
    Article CAS Google Scholar
  10. Spiridon, M. & Kanwisher, N. How distributed is visual category information in human occipito-temporal cortex? An fMRI study. Neuron 35, 1157–1165 (2002).
    Article CAS Google Scholar
  11. Epstein, R. & Kanwisher, N. A cortical representation of the local visual environment. Nature 392, 598–601 (1998).
    Article CAS Google Scholar
  12. Downing, P., Jiang, Y., Shuman, M. & Kanwisher, N. A cortical area selective for visual processing of the human body. Science 293, 2470–2472 (2001).
    Article CAS Google Scholar
  13. Fujita, I., Tanaka, K., Ito, M. & Cheng, K. Columns for visual features of objects in monkey inferotemporal cortex. Nature 360, 343–346 (1992).
    Article CAS Google Scholar
  14. Wang, G., Tanaka, K. & Tanifuji, M. Optical imaging of functional organization in the monkey inferotemporal cortex. Science 272, 1665–1668 (1996).
    Article CAS Google Scholar
  15. Tsunoda, K., Yamane, Y., Nishizaki, M. & Tanifuji, M. Complex objects are represented in macaque inferotemporal cortex by the combination of feature columns. Nat. Neurosci. 4, 832–838 (2001).
    Article CAS Google Scholar
  16. Dubowitz, D.J. et al. Functional magnetic resonance imaging in macaque cortex. NeuroReport 9, 2213–2218 (1998).
    Article CAS Google Scholar
  17. Logothetis, N., Guggenberger, H., Peled, S. & Pauls, J. Functional imaging of the monkey brain. Nat. Neurosci. 2, 555–562 (1999).
    Article CAS Google Scholar
  18. Vanduffel, W. et al. Visual motion processing investigated using contrast-agent enhanced fMRI in awake behaving monkeys. Neuron 32, 565–577 (2001).
    Article CAS Google Scholar
  19. Nakahara, K., Hayashi, T., Konishi, S. & Miyashita, Y. Functional MRI of macaque monkeys performing a cognitive set-shifting task. Science 295, 1532–1536 (2002).
    Article CAS Google Scholar
  20. Leite, F.P. et al. Repeated fMRI using iron oxide contrast agent in awake, behaving macaques at 3 tesla. Neuroimage 16, 283–294 (2002).
    Article Google Scholar
  21. Van Essen, D.C. Organization of visual areas in macaque and human cerebral cortex. in The Visual Neurosciences (eds. Chalupa, L. & Werner, J. S.)(MIT Press, Cambirdge, Massachusetts, 2003).
    Google Scholar
  22. Lewis, J.W. & Van Essen, D.C. Mapping of architectonic subdivisions in the macaque monkey, with emphasis on parieto-occipital cortex. J. Comp. Neurol. 428, 79–111 (2000).
    Article CAS Google Scholar
  23. Sakata, H. et al. Neural coding of 3D features of objects for hand action in the parietal cortex of the monkey. Phil. Trans. R. Soc. Lond. B. Biol. Sci. 353, 1363–1373 (1998).
    Article CAS Google Scholar
  24. Scalaidhe, S., Wilson, F. & Goldman-Rakic, P. Areal segregation of face-processing neurons in prefrontal cortex. Science 278, 1135–1138 (1997).
    Article CAS Google Scholar
  25. Grill-Spector, K., Kourtzi, Z. & Kanwisher, N. The lateral occipital complex and its role in object recognition. Vision Res. 41, 1409–1422 (2001).
    Article CAS Google Scholar
  26. Allman, J. & McGuiness, E. Visual cortex in primates. in Comparative Primate Biology (eds. Mitchell, G. & Erwin, J.) 279–326 (Alan R. Liss, New York, 1988).
    Google Scholar
  27. Van Essen, D.C. et al. An integrated software system for surface-based analyses of cerebral cortex. J. Amer. Med. Informatics Assoc. 8, 443–459 (2001).
    Article CAS Google Scholar
  28. Gauthier, I. & Logothetis, N. Is face recognition not so unique after all? Cognit. Neuropsychol. 17, 125–142 (1999).
    Article Google Scholar
  29. Sereno, A.B. & Maunsell, J.H. Shape selectivity in primate lateral intraparietal cortex. Nature 395, 500–503 (1998).
    Article CAS Google Scholar
  30. Freedman, D.J., Riesenhuber, M., Poggio,T. & Miller, E.K. Categorical representation of visual stimuli in primate prefrontal cortex. Science 291, 312–316 (2001).
    Article CAS Google Scholar
  31. Rees, G., Friston, K.J. & Koch, C. A direct, quantitative relationship between the functional properties of human and macaque V5. Nat. Neurosci. 3, 716–723 (2000).
    Article CAS Google Scholar
  32. Logothetis, N.K., Pauls, J., Augath, M., Trinath, T. & Oeltermann, A. Neurophysiological investigation of the basis of the fMRI signal. Nature 412, 150–157 (2001).
    Article CAS Google Scholar
  33. Cavanagh, P. Vision is getting easier every day. Perception 24, 1227–1232 (1995).
    Article CAS Google Scholar
  34. Gallant, J.L., Braun, J. & Van Essen, D.C. Selectivity for polar, hyperbolic and Cartesian gratings in macaque visual cortex. Science 259, 100–103 (1993).
    Article CAS Google Scholar
  35. Biederman, I. Visual object recognition. in Visual Cognition (eds. Kosslyn, S. M. & Osheron, D. N.) 121–166 (MIT Press, Cambridge, MA, 1995).
    Google Scholar
  36. Turk, M. & Pentland, A. Eigenfaces for recognition. J. Cogn. Neurosci. 1995, 71–86 (1991).
    Article Google Scholar
  37. Leopold, D.A., O'Toole, A., Vetter, T. & Blanz, V. Prototype-referenced shape encoding revealed by high-level aftereffects. Nat. Neurosci. 4, 89–94 (2001).
    Article CAS Google Scholar
  38. Ungerleider, L. & Desimone, R. Cortical connections of visual area MT in the macaque. J. Comp. Neurol. 248, 190–222 (1986).
    Article CAS Google Scholar
  39. Sereno, M.I. et al. Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. Science 268, 889–893 (1995).
    Article CAS Google Scholar

Download references

Acknowledgements

We wish to thank R. Desimone, N. Kanwisher, K.S. Saleem, Y. Sasaki, W. Vanduffel and D.C. Van Essen for their comments on the manuscript and valuable discussions. We are also grateful to W. Vanduffel and L. Wald for setting up the monkey fixation system, to D.C. Van Essen for help with using CARET, and to D. Greve for help with using FSFAST. This study was supported by the National Center for Research Resources (P41RR14075), the Mental Illness and Neuroscience Discovery Institute, and grants from the National Institutes of Health (R01 MH67529 A01 and R01 EB00790 A01).

Author information

Authors and Affiliations

  1. Athinoula A. Martinos Center, Charlestown, 02129, Massachusetts, USA
    Doris Y Tsao, Tamara A Knutsen, Joseph B Mandeville & Roger B H Tootell
  2. Department of Neurobiology, Harvard Medical School, Boston, 02115, Massachusetts, USA
    Doris Y Tsao
  3. Center for Advanced Imaging, University of Bremen, Bremen, Germany
    Winrich A Freiwald
  4. Department of Brain and Cognitive Science, Massachusetts Institute of Technology, Cambridge, 02139, Massachusetts, USA
    Winrich A Freiwald
  5. Hanse Institute for Advanced Study, Delmenhorst, Germany
    Winrich A Freiwald
  6. Department of Radiology, Harvard Medical School, Boston, 02115, Massachusetts, USA
    Roger B H Tootell

Authors

  1. Doris Y Tsao
    You can also search for this author inPubMed Google Scholar
  2. Winrich A Freiwald
    You can also search for this author inPubMed Google Scholar
  3. Tamara A Knutsen
    You can also search for this author inPubMed Google Scholar
  4. Joseph B Mandeville
    You can also search for this author inPubMed Google Scholar
  5. Roger B H Tootell
    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence toDoris Y Tsao.

Ethics declarations

Competing interests

The authors declare no competing financial interests.

Supplementary information

Supplementary Fig. 1.

(a) Examples of the face and object stimuli. (b) Fourier-phase scrambled versions of images in the first row of a. (c) Grid-scrambled images. (d) Line drawings. (e) Monkey faces (used for Fig. 2e and Supplementary Fig. 4). (JPG 112 kb)

Supplementary Fig. 2.

(a,b) Areas more strongly activated by intact objects than by Fourier-scrambled objects in two monkeys ("M1" and "M2", respectively). For all slice data, the left half of each slice represents the left hemisphere. (c,d) Intact versus Fourier-scrambled object activation in monkey M2, imaged with MION contrast agent. Although MION increases signal-to-noise ratio several-fold18,20, the overall activation pattern remained the same. In (c), activation is rendered on folded and inflated views of the left hemisphere. In (d), the same functional data is overlaid on the raw functional slices (thus averting any "registration errors"). In MION images, major sulci are directly visible in the functional slices. Sulcal abbreviations: lu, lunate; ios, inferior occipital; ips, intraparietal; ots, occipito-temporal; pmt, posterior middle temporal; amt, anterior middle temporal; sts, superior temporal; lf, lateral fissure; cs, central; cgs, cingulated; arsp, arcuate spur; ias, inferior arcuate; sas, superior arcuate; ps, principal. (JPG 95 kb)

Supplementary Fig. 3.

Face-specific patches in caudal TE imaged in 10 experimental sessions spanning almost six months. In (a), (b), (d), (e), and (i), the stimulus sequence consisted of repeating cycles of {scrambled faces, faces, scrambled objects, objects}, with object epochs consisting of hands, fruits, technological objects, or bodies. In (c), (f), (g), and (h), the stimulus consisted of a fully randomized presentation sequence in which each of the five non-face stimulus categories were presented just as frequently as faces. In (f), MION contrast agent was used. In (i), the stimuli were line drawings of faces and objects. In (k), the face stimuli were pictures of macaque faces. In (j), a simple fixation task was performed instead of a foveal bar task, and only time points in which fixation was maintained within a 2° window were used. Despite these differences in experimental design, the pattern of face-selective patches remained remarkably consistent across different days. Best efforts were made to align the anterior-posterior position of the slices from different days, but since the slice separation was 1.25 mm, there may be a ±0.63 mm offset between slices in the same column. (JPG 109 kb)

Supplementary Fig. 4.

Consistency of face-selective patches across three monkeys. (a) Face patches from monkey M1 (same data as in Fig. 2b), rendered on raw functional slices. (b) Face-selective patches from monkey M2, derived using monkey faces versus objects. (c) Face patches from monkey M3 (who had never seen any of the face or object stimuli prior to scanning), derived using the exact same stimulus as in (a). (d) The same data as in (c), but without any spatial smoothing. (JPG 47 kb)

Supplementary Fig. 5.

A possible homology between the macaque face patches and the FFA. (a) Macaque face patches mapped from the individual hemisphere to the macaque atlas and displayed on the intact right hemisphere surface (left) and a flat map of the entire hemisphere (middle). The macaque atlas was registered to a human atlas using surface-based registration and landmarks based on likely functional homologies, including visual areas V1, V2, and MT27, and the deformed macaque face patches are displayed on the human right hemisphere flat map (right). (b) The location of the macaque face patches relative to reported foci of face-specific activity (green squares) and classical human visual areas. In the human map, the registered macaque face patch appears very close to the human FFA as projected to the cortical surface based on its published stereotaxic (Talairach) coordinates21. (JPG 19 kb)

Supplementary Fig. 6.

Analysis of distributed response patterns to different object categories (as in Fig. 4c), (a) without spatial smoothing, and (b) restricted to the 30 most visually-activated voxels in each region. See Results for details. (GIF 104 kb)

Rights and permissions

About this article

Cite this article

Tsao, D., Freiwald, W., Knutsen, T. et al. Faces and objects in macaque cerebral cortex.Nat Neurosci 6, 989–995 (2003). https://doi.org/10.1038/nn1111

Download citation