The role of autoshaping in cooperative two-player games between starlings - PubMed (original) (raw)
The role of autoshaping in cooperative two-player games between starlings
J C Reboreda et al. J Exp Anal Behav. 1993 Jul.
Abstract
We report a study of the behavior of starlings in laboratory situations inspired by the "prisoner's dilemma." Our purpose is to investigate some possible mechanisms for the maintenance of cooperation by reciprocity and to investigate the process of autoshaping at a trial-by-trial level. In Experiment 1, pairs of starlings housed in adjacent cages played a discrete-trial "game" in which food could be obtained only by "cooperation." In this game, pecking at a response key eliminated the opportunity to obtain food but produced food for the partner. If neither bird pecked, neither had the opportunity to obtain food in that trial. Some level of cooperation persisted for several sessions whether the birds had been pretrained for a high or low probability of pecking at the key. The probability of a cooperative response was higher after trials in which the partner responded (and a reward was obtained) than after trials in which neither bird responded (and no reward was obtained), but the probability of a response was even higher after trials in which the same bird had responded, even though no reward was obtained by the actor in these trials. This behavior did not require visual presence of another player, because similar results were obtained in Experiment 2 (a replicate of Experiment 1 in which the members of the pair could not see each other) and in Experiment 3, a game in which each starling played with a computer responding with "tit for tat." Using an omission schedule, in which food was given in all trials in which the bird did not peck, Experiment 4 showed that pecking could be maintained by autoshaping. In this experiment, overall probability of pecking decreased with experience, due to a drop in the tendency to peck in consecutive trials. The probability of pecking in trials following a reinforced trial did not decrease with experience. An implementation of the Rescorla-Wagner model for this situation was capable of reproducing molar, but not molecular, aspects of our results. The results violate the predictions of several game-theoretical models for the evolution of cooperation, including tit for tat, generous tit for tat, and the superior win-stay-lose-shift.
Similar articles
- Learning by pigeons playing against tit-for-tat in an operant prisoner's dilemma.
Sanabria F, Baker F, Rachlin H. Sanabria F, et al. Learn Behav. 2003 Nov;31(4):318-31. doi: 10.3758/bf03195994. Learn Behav. 2003. PMID: 14733481 - Human cooperation in the simultaneous and the alternating Prisoner's Dilemma: Pavlov versus Generous Tit-for-Tat.
Wedekind C, Milinski M. Wedekind C, et al. Proc Natl Acad Sci U S A. 1996 Apr 2;93(7):2686-9. doi: 10.1073/pnas.93.7.2686. Proc Natl Acad Sci U S A. 1996. PMID: 11607644 Free PMC article. - Prisoner's dilemma and the pigeon: Control by immediate consequences.
Green L, Price PC, Hamburger ME. Green L, et al. J Exp Anal Behav. 1995 Jul;64(1):1-17. doi: 10.1901/jeab.1995.64-1. J Exp Anal Behav. 1995. PMID: 16812760 Free PMC article. - A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game.
Nowak M, Sigmund K. Nowak M, et al. Nature. 1993 Jul 1;364(6432):56-8. doi: 10.1038/364056a0. Nature. 1993. PMID: 8316296 - Resolving the iterated prisoner's dilemma: theory and reality.
Raihani NJ, Bshary R. Raihani NJ, et al. J Evol Biol. 2011 Aug;24(8):1628-39. doi: 10.1111/j.1420-9101.2011.02307.x. Epub 2011 May 23. J Evol Biol. 2011. PMID: 21599777 Review.
Cited by
- Translations in Stimulus-Stimulus Pairing: Autoshaping of Learner Vocalizations.
da Silva SP, Williams AM. da Silva SP, et al. Perspect Behav Sci. 2019 Nov 25;43(1):57-103. doi: 10.1007/s40614-019-00228-9. eCollection 2020 Mar. Perspect Behav Sci. 2019. PMID: 32440645 Free PMC article. - Pigeons (Columba livia) approach Nash equilibrium in experimental Matching Pennies competitions.
Sanabria F, Thrailkill E. Sanabria F, et al. J Exp Anal Behav. 2009 Mar;91(2):169-83. doi: 10.1901/jeab.2009.91-169. J Exp Anal Behav. 2009. PMID: 19794832 Free PMC article. - Long-term social bonds promote cooperation in the iterated Prisoner's Dilemma.
St-Pierre A, Larose K, Dubois F. St-Pierre A, et al. Proc Biol Sci. 2009 Dec 7;276(1676):4223-8. doi: 10.1098/rspb.2009.1156. Epub 2009 Sep 9. Proc Biol Sci. 2009. PMID: 19740884 Free PMC article. - Applied implications of theory and research on the nature of reinforcement.
Iwata BA. Iwata BA. J Appl Behav Anal. 1994 Spring;27(1):183-93. doi: 10.1901/jaba.1994.27-183. J Appl Behav Anal. 1994. PMID: 16795824 Free PMC article. No abstract available. - Learning by pigeons playing against tit-for-tat in an operant prisoner's dilemma.
Sanabria F, Baker F, Rachlin H. Sanabria F, et al. Learn Behav. 2003 Nov;31(4):318-31. doi: 10.3758/bf03195994. Learn Behav. 2003. PMID: 14733481
References
- J Theor Biol. 1964 Jul;7(1):17-52 - PubMed
- Nature. 1984 Apr 5-11;308(5959):541-3 - PubMed
- Science. 1981 Mar 27;211(4489):1390-6 - PubMed
- New Sci. 1990 Jun 9;126(1720):28 - PubMed
- J Exp Anal Behav. 1962 Oct;5:531-3 - PubMed
LinkOut - more resources
Full Text Sources
Miscellaneous