The Symbolic Foundations of Conditioned Behavior Distinguished Lecture Series 1st Edition Charles R. Gallistel Instant Download
The Symbolic Foundations of Conditioned Behavior Distinguished Lecture Series 1st Edition Charles R. Gallistel Instant Download
https://ebookfinal.com/download/the-symbolic-foundations-of-conditioned-
behavior-distinguished-lecture-series-1st-edition-charles-r-gallistel/
https://ebookfinal.com/download/foundations-of-quantum-physics-
charles-e-burkhardt/
https://ebookfinal.com/download/memory-and-the-computational-brain-
why-cognitive-science-will-transform-neuroscience-1st-edition-c-r-
gallistel/
https://ebookfinal.com/download/crustacean-nervous-systems-and-their-
control-of-behavior-1st-edition-charles-derby/
https://ebookfinal.com/download/foundations-of-comparative-
genomics-1st-edition-arcady-r-mushegian/
Reproductive Ecology and Human Evolution Evolutionary
Foundations of Human Behavior 1st Edition Peter Ellison
https://ebookfinal.com/download/reproductive-ecology-and-human-
evolution-evolutionary-foundations-of-human-behavior-1st-edition-
peter-ellison/
https://ebookfinal.com/download/clinical-skills-lecture-notes-4-sub-
edition-r-turner/
https://ebookfinal.com/download/understanding-human-behavior-and-the-
social-environment-7th-edition-charles-zastrow/
https://ebookfinal.com/download/lux-mundi-a-series-of-studies-in-the-
religion-of-the-incarnation-1st-edition-charles-gore/
https://ebookfinal.com/download/deviant-behavior-crime-conflict-and-
interest-groups-charles-h-mccaghy/
The Symbolic Foundations of Conditioned Behavior
Distinguished Lecture Series 1st Edition Charles R.
Gallistel Digital Instant Download
Author(s): Charles R. Gallistel, John Gibbon
ISBN(s): 9780805829341, 0805829342
Edition: 1st
File Details: PDF, 20.29 MB
Year: 2002
Language: english
The Symbolic Foundations
of Conditioned Behavior
CHARLES R. GALLISTEL
Rutgers University
JOHN GIBBON
New York State Psychiatric Institute and
Columbia University
0-8058-2934-2
Preface V
Series Preface ix
introduction 1
ResponseTiming 5
The Peak Procedure 9
Scalar Expectancy Theory 11
The FI Scallop 14
The Timing of Aversive CRs 15
Timing the CS: Discrimination 20
Summary22
Acquisition 23
Quantitative Results 26
Rate Estimation Theory 36
Generalizing the Model 46
Cue
Competition
and
inhibitory
Conditioning 57
Experimental Results 57
Two Principles 61
General Solution to the Rate Estimation Problem 62
Intuitive “Derivations” 65
Conclusions 78
iii
iv CONTENTS
4 Extinction 80
Model of Simple Extinction 83
Generalizing the Model 86
5 Backward,
Secondary,
and
Trace
Conditioning 10 7
Delay Conditioning Versus Trace Conditioning 108
Forward Versus Backward Conditioning 109
Secondary Versus Primary Conditioning 111
6 Operant
Choice 124
Opting Versus Allocating 125
Hyperbolic Discounting and Self-Control 141
Harmonic Averaging andthe Preference
for Variabillty 143
The Equivalence of Delayed Rewards
and Probabilistic Rewards 148
lime-Scale Invariance in Free Operant Avoidance 151
Summary153
7 The
Challenge
for
Associative
Theory 156
Different Answers to Basic Questions 156
Contrasting Basic Assumptions 159
The Challenges Posed by Experimental Findings 163
Summary176
References 178
AuthorIndex 189
Subject
Index 193
Preface
As this book goes to press, there is an ongoing discussion on the Animal Learning
and Behavior List Server about the decline of behaviorism in psychology and the
rise of cognitivism. Most of the participants in the discussion do research and
teaching in animal learning. Most of them remain to varying degrees behaviorists.
They are, by and large, uncomfortable with cognitive theorizing and unhappy
about the decline of behaviorism. In this book, we hope to persuade students of
animal learning that cognitive theorizing is essential for an understanding of the
phenomena revealed by conditioning experiments.We hope also to persuade the
cognitive psychology community that conditioning phenomena offer such a strong
empirical foundation for a rigorous brand of cognitive psychology that the study
of animal learning should reclaim a more central place in the fieldof psychology.
There is, we believe, no way to achieve a coherent uilderstandingof animal
conditioning phenomena without recognizing that computational processingof
information-bearing sensory signals constructs a symbolic representation of
selected aspects of the animal’s experience, which is stored in memory and
subsequently retrieved for use in the decision processes that determine the behavior
we observe. These essentially cognitive notions-information processing,
computation, symbolic representation, memory storage, retrieval from memory,
and decision processes-are in no sense merely metaphors. They are what the
brain is doing to produce the behavior we observe. We cannot understand the
phenomena revealed by conditioning experiments without understanding the
structure of the underlying information-processing operations in the brain, any
more than we can understand the phenomena of chemistry without understanding
the structure of the underlying atoms.
We believe our analysis of the work we review also merits the attention of
the cognitive science and philosophy communities because it speaks directly to a
central question that separates many forms of connectionist modeling from the
artificial intelligence(AI) approach to the mind. This is also a question that figures
prominently in the philosophy of mind, particularly those aspects of the philosophy
of mind that have been influenced by connectionist modeling and by
neurobiological considerations, that is,by the argument that the explanation for
how the mind works is to be sought in our current understanding of how the brain
works. Here the question is whether learning is primarily a matter of learning
that or primarily a matter of learning to.
In traditional AI and traditional philosophy of mind, computers and minds
learn that something is true about the world. That is, they acquire beliefs. What
they then do follows from what they believe together with the computer’s goals
V
vi PREFACE
Hebb’s rule (1949) statesthat learning and memory are based on modifications
of synaptic strength among neurons that are simultaneously active. This implies
that enhanced synaptic coincidence detection would lead to better learning and
memory. If the NMDA (N-methyl-D-aspartate) receptor, a synaptic coincidence
detector, acts as
a graded switchfor memory formation, enhanced signal detection
by NMDA receptors, should enhance learning and memory. . . . (Tang et al.,
1999, p. 63)
There is, we argue, little empirical foundation for the claim that coincidence
detection on a time scale of a few hundred milliseconds plays any role in learning
or memory, at least notin the learning and memory processes that mediate basic
conditioning. Aswe show at some length, the behavioral data indicate that what
matters in conditioning are the relative durations of the intervalsin the protocol,
not their absolute durations. The importance of relative durations as opposed to
absolute durations is central to our suggestion that conditioning processes are
time-scale invariant.
We argue that what neuroscientists ought to be looking for are not mechanisms
of synaptic plasticity activated bynarrowtemporal coincidences but rather
mechanisms by which variables may be stored and retrieved. Mechanisms for the
storage and retrieval of variables, together with mechanisms for doing
computations with those variables, are the heart and soul of a conventional
computer, so there can be no question about the physical realizability of such
mechanisms. How they are realized i n neural tissue is anothermatter.
Neuroscientists will not get an answer to this profoundly important question until
they begin to actively look for the mechanisms of information processing.
This book is based closely on a paper in the Psychological Review entitled
“Time, Rate, and Conditioning” (Gallistel& Gibbon, 2000). Most of the figures
and much of the text first appeared there. That paper was being written at the time
one of us (CRG) was asked to give the MacEachran Lectures at the University of
Alberta. The lectures, of which this book is a product, were given October6-8,
1997. CRG is grateful to our colleagues at the University of Alberta for the
opportunity they provided to put this material in lecture and book form and for
the many fruitful discussions during his visit. He is also grateful for their patience
with the long delay in publication. We are both indebted to many colleagues for
critical readings of parts or all of what appears here. Wewish particularly to
thank Ralph Miller for detailed and meticulous critical readings of the
Psychological Review manuscript.
viii PREFACE
ACKNOWLEDGMENTS
We gratefully acknowledge support from the following grants during the period
when these works were being written: SBR-9720410, entitled “Learning and
Intelligent Systems: Learning in Complex Environments by Natural and Artificial
Systems,” from the National Science Foundation (Roche1 Gelman, Orville
Chapman, Charles R. Gallistel, Edward P. Stabler, Charles E. Taylor, Phillip J.
Kellman, John R. Merriam, James W. Stigler, and Joseph A. Wise, CoPIs) and
MH14649 from the National Institutes of Health to John Gibbon.
During the copyediting process, John Gibbon died. He was a scientist of the
first rank, both
as a theorist, andas an experimentalist. He pioneered the application
of the information-processing framework to the analysis of timing behavior. He
will be sorely missed by the field, to which he contributedso much. To those who
knew him as a friend and collaborator, his loss is beyond the power of words to
express.
“ c . R. Gallistel
John M. MacEachran
Memorial Lecture Series
TheDepartmentofPsychologyattheUniversityofAlbertainauguratedthe
MacEachranMemorialLectureSeriesin1975inhonor of thelateJohn M.
MacEachran.ProfessorMacEachranwasborninOntarioin1877.In 1906 he
received a PhD in Philosophy from Queen’s University in 1905. In 1906 he left
for Germany to begin more formal study in psychology, first spending just less
thanayearinBerlinwithStumpf,andthenmoving to Leipzig, where he
completedasecondPhDin1908withWundtashissupervisor.Duringthis
period he also spent timein Paris studying under Durkheim and Henri Bergson.
With these impressive qualifications the University of Alberta was particularly
fortunate in attracting him to its faculty in 1909.
ProfessorMacEachran’simpacthasbeensignificantattheuniversity,
provincial, and national levels. At the University of Alberta he offered the first
courses in psychologyandsubsequently served as Head oftheDepartmentof
Philosophy and Psychology and Provost of the University until his retirementin
1945. It was largely owing to his activities and example that several areas of
academicstudywereestablishedonafirmandenduringbasis.Inaddition to
playing a major role in establishing the Faculties of Medicine, Education, and
Law in theProvince,ProfessorMacEachranwasalsoinstrumental in the
formative stages of the Mental Health Movement in Alberta. At a national level,
he was one of the founders of the Canadian Psychological Association and also
became itsfirstHonoraryPresident in 1939.JohnM.MacEachranwas indeed
one of the pioneers in the development of psychologyin Canada.
Perhaps the most significant aspect of theMacEachranMemorialLecture
Series has been the continuing agreement that the Department of Psychology at
the University ofAlbertahaswithLawrenceErlbaumAssociates,Publishers,
Inc., for the publication of each lecture series. The following is a list of the
Invited Speakers and the titles of their published lectures:
ix
X SERIES PREFACE
1997 Charles R. Gallistel (Rutgers University) and John Gibbon (New York
State Psychiatric Institute and Columbia University)
The Symbolic Foundations of Conditioned Behavior
served when animals are being conditioned that students ofanimal learning
continue even now to read his lectures with profit.
Stimuli like food, water, puffs of air delivered to the sclera, or mildly
painful shocks to the feet-stimuli that reliably motivate observable behav-
ior-are called reinforcers.The terminology reflects the conceptual frame-
work that Pavlov and almost all students of conditioning after him have a p
plied to the understanding of this phenomenon. Pavlov thought that the
food strengthened(reinforced) a connection between elements in the nerv-
ous system.The connection served as a conducting pathway over which ex-
citation propagated from the tone-sensitive elements to the food-sensitive
elements. The development of this pathway-the conditioned reflex path-
way-explained how it was that the tone came in time to elicit a response
similar to the responseelicited by the food itself.This conception of the un-
derlying process-that it involves the strengthening of a connection-still
dominates thinking about basic learning.
Pavlov also called reinforcers unconditioned stimuli (USs). We will use
the terms reinforcer and US more or less interchangeably. Following Pav-
lov, we will call the originally neutral stimuli (the tones, lights, etc.) condi-
tioned stimuli (CSs for short) and the responses that develop to them con-
ditioned responses (CRs).
Clearly, Pavlov’saccount of learning that occurs during conditioning is a
“learning to” account; the dog learns to salivate, rather than learning that
the tone predicts food. In associative models of the conditioning process,
symbolic knowledge of the world is not acquired. The altered conductive
connections (the associations) may mediate an adaptive response-for ex-
ample, a blink that shields the eye from an impending puffof air-but they
do not encode what it is about the experienced world that makes an appro-
priately timed blink adaptive. The connection forged by repeated experi-
ence of a tone and an air puff ora tone and food does not encode the tem-
poral relation between CS and the US.
In contemporary discussions of associative conditioning, properties of
the stimuli used are commonly assumed to be encoded in stimulus traces
left behind in the nervous system by the transient activity that the CSs and
USs evoke (Balleine, Garner, Ganzalez, & Dickinson, 1995; Bouton, 1993;
Colwill & Rescorla, 1990; Dickinson, 1989; Dickinson & Balleine, 1994;Res-
coria, 1991, 1993;Rescorla & Colwill, 1989).However, associative theories do
not specify the principles governing stimulus encoding, so it is a moot ques-
tion whether stimulus properties (e.g., amount, intensity, color, flavor, size,
duration, tonal composition) may themselves be represented by associa-
tive strengths, and, if so, how. In associative theories, as currently elabo-
rated, the strengthof the associative bond does not specify any objectively
describable property of the CS, the US, or the relation between them. That
is why the associations produced by conditioning do not have symbolic
INTRODUCTION 3
content. Their strengths do not specify objective facts about the animal’s
conditioning experience.
The subjects in conditioning experiments do, however, learn the tempo-
ral intervals in the protocols. This conclusion, once controversial, is now
widely accepted, on the basis of the kinds of experimental evidence re-
viewed at length in the chapters that follow. This temporal learning has
been modeled quantitatively by so-called timing models (Church, Broad-
bent, & Gibbon, 1992; Gibbon, 1977,1992; Gibbon, Church, & Meck,1984;
Killeen & Fetterman, 1988).
The ability of timing models to explain the timing of conditioned re-
sponses is widely recognized. It is not widely appreciated, however, how
fundamentally the discovery of an interval timing capacity may alter our
conception of the conditioning process itself. Timingmodels give us models
of conditioning in which symbolic knowledge is the foundation of the o b
served behavior. They are models of how this knowledge is acquired and
used. In this new conceptual framework, almost every aspect of basic con-
ditioning appears in a different light. Our purpose in this book is to make
clear salient features of that conceptual framework.
One feature of this conceptual framework is that the learning mecha-
nisms that mediate conditioned behavior should not be thought of as basic
to higher learning of all kinds. What is primarily manipulated in the great
majority of experiments commonly discussed under the heading of classi-
cal or operant conditioning is the temporal relations among stimuli. The
models we discuss are specific to this kind of learning. Our models operate
in the domain of nonstationary multivariate time series analysis. They do
not purport to be general theories of learning. On the contrary, they are
predicated on the assumption that there can be no such thing as a general
theory of learning, because learning mechanisms, like other biological
mechanisms,have problem-specific structures (Gallistel, 1992b, 1999b).
Mechanisms with problem-specificstructure aremore or less inherentin an
information processing approach to thebrain, becausedifferent kinds of in-
formation must be processed in different ways.
Within the account we propose, there is no important distinction-at the
level of process-between instrumentaland classical conditioning. The
learning that occurs in both kinds of protocols depends on mechanisms
for learning temporal intervals and rates and using those intervals and
rates tomeasure contingency. On the other hand,in our framework,the ac-
quisition of a conditioned response, the extinction of that response and the
timing of the response are distinct problems, requiring distinct decisions
for their solution.
In our view, different learning mechanisms may make use of a common
set of elementary neurocomputational operations, such as the storageand
retrieval of the values of variables (distances, intervals, intensities, etc.),
4 INTRODUCTION
1
Response Timing
5
6 TIMING 1. RESPONSE
FIG. 1.1. Time line for simple classical conditioning. The duration of the CS is
T, the reinforcement (dot) coincides with the offset of the CS. For reasons to
be explained later, the duration of this reinforcement (the duration of the US)
may be ignored. The other important interval is I, the interval between trials
(CS presentations). The sum of the I and T is C, the cycle duration.
INTRODUCTION 7
1001 I
FIG. 1.3. Data from a onetrial con-
textual fear conditioning experi-
ment. Rats were given a brief foot
shock 3 min after being placed in an
experimentalchamber(the con-
text). The next day, they wereagain
placed In the chamber, and their
freezing behavior (a manifestation
of fear) was scored during an8-min
test.Thepercentage of rats o b
served to be freezing was maximal
at the latency at which they had
beenshockedthepreviousday.
(From Fanselow & Stote, 1995, r e 0
produced by permission of the au- 0 1 2 3 4 5
thors.) Minutes
dence thatthe animals are in fact learning at least one of the temporalinter-
vals in the protocol, namely, the reinforcement latency.
Another property of the distribution of CRs, whose empirical generality
and theoretical importance was first emphasized by Gibbon (1977) is that
its standard deviation is proportional to its mode: The longer the CR is on
average delayed, the more variable is its latency. Thus, the coefficient of
Another Random Scribd Document
with Unrelated Content
Sagana; maganda ang loob, Bountiful-a Magsagana; busto. Bounty
n-Pabuya; ganting palad. Bouquet-w Tali ng manga bulaklak. Bourn-
Bourne-n-Sapang munti. Bout n Talo; away, laban. Bovine-a-
JSaaukol sa bakang lalakí Botoro. Bow-t;-Batiin; yumuko; iyuko;
sumuko. Bow w Yuko; batí; tango. Bow-ti Anomang bagay na
baluktot. Bowed a Balantok; baluktot. Bowel n Isaw; bituka. Bowel-
í;-Alisan ang mga bituka. Bower n Bahay na munti sa halamanan na
walang dingding at may mga uupuan sa loob. Bowers Ang bumati;
ang yumuko, Bowknot-n Tali na mainam. Bowl w Man gkok.
Bowlder-ti Botong malaki. BowFegged a-Mabilog ang binti. Bowline
w-Lubid ng layag. Box-n-K ahon ; kaha. BoxwSumbi; sampal; palo;
tampal. Box-v-Ilagay ó isilid sa kahon; ikahon, Box v-Sampalin;
magboxing. Boxer n Ang marunong magboxing. Boxing n-Boxing.
Boy-nBatang lalaki. Boyish-a May ugaling batang lalaki. Brace-n
Pareja; tungkod; dipa; dalawa. Brace v Itungkod. Bracklet-w Pulsera.
Bracket-n-Tungkod. Bracket-v-Itungkod. ^ Brakish-a Maalat. Brad n
Pakong maiklí; pakong maliit at walang tilo. Brag'?; Magyabang;
maghambog maghangin. Brag w Kahambugan; kayabangan;
kahanginan. Braga Mahambog; hambog; mayabang. Braggartw-
Tawonghambogómayabang.
BRE 179 BRI Braggartisnin-Kabambngan; kayabangan
kahanginan. Braid n Trintas. Braid v Trintasin; mamirintas. Brain n
Utak; sa iilo. Brake n-Pangpigil. Brakeman wTaga pigil, Brakish a-
Tapsim; maalat; maasim. Bramble w-Kaugoygoyan na may tinik.
Bran-?i-Darak. Branch n Sanga. Branch a Kasanga, Branch v
Magsanga, Brand n Tanda; marka,- tatak; tala; ka sangkapang pang
lagay ng tanda. Brand i; Tandaan; markahin ilagay ng tanda;
tatakan; tal a an; Branding n Pag lalagay ng tanda, pa . nananda;
pananaktak Brandish í; Kawayin; pagpagin; ipagpag. Brandish n
Kaway, pagpag. Brandnew a-Bagongbago. Brandy n Alak. Brant n
Gansang ramo; bibi; itik. Brash a-Marupok; mainit ang ulo; mabutlig.
Brash-n-Butlig. Brasier-Braziern-Ang marunong gumawa ng mga
kasangkapan ng tansong dilaw. Brass n Tansong dilaw. Brassy a
Parang tan so; may halong tanso, Bratn Batang hamak. Bravado II
Tawong hambog. Brave a Matapang; mangabas bayani; marahas:
marikit. Brave n Tawong matapang. Bravery nKatapangan; dahas
kapangahasan tining ng loob. Bravo-n-Tulisán na matapang. Bravo
¿nfer. -Mabuti; tapan g. Brawl-n Guio; talo; away; usap. Brawl-v-
Makipagtalo; mag usap. Brawn n-Lakas; kalakasan. Brawny a
Malakas. Bray-i^-Durugin; dikdikin. Bray-v-Pumutok. Bray n-Iyak ng
kabayong mula. Bray i;-Umiyak ang mula. Brazen-ii May halong
tanso; bastos. Breach n Puang: sira; puit ng baril. * Breach-v-
Pumutok, Bread. w Tinapay. Breadth-n-Luang lapad; kapalaran;
kaluagan. Break t;Basagin; sirain; tipuin; biakin; lapakin: bumasag;
masira; tumipo; lumagok; lagutin; masayang. Break n Basag; sira;
tipo; lagot; kaei raan; puang. Breaker-w-Ang maninira; maninira.
Breakfast-Ti-Agahan. Breakfast-i; Kumain ang agahan. Breakneck n-
Lugar na matirik. Breakneck-a-Matulin na matulin. Breakwater w
Harangan ng tubig. Breast-?i-Dibdib; loob ng dibdib. Breast-t?
Salubungan; lumaban; huma rap. Breastbone-w Buto ng dibdib.
Breastpin-^-Alfiler. Breastwork-n-l^ uta. Breathe-w-Ang hininga.
Breathe-i; Huminga. Breathing-n Paghihininga. Breathless a Walang
hinga. Bred v. imp &p. j?.-Nagalaga. Breech n Puit. Breech v Ibigay
ng salawal. Breeches-n-Salawal. Breeching-w-Salawalin. Breed-w
Magiwi; magalaga. Breed n Lahi. Breeding !^Kagalangan; kaugalian;
asal, galang; turo; dunong; karunungan; kagalingan; inam ng kilos;
pinagaralan. Breedern-Taga alaga. Beeze n Hangin; amihan; habagat
Brent n-Gansang lalaki. Brethern n Magkakapatid. Brett n
Carruageng mahaba. Breve-n-Nota ng música. Brevet n Kalagayang
mataas pero wa lang dagdag ang suedlo. Brevity-w-Kaiklian. Brew-r-
Ilahok. 3rew-v-Gumawa ng servesa. Brew ?i-Lahok. Brewery n-
Gawaan ng servesa. Brewhouse m Gawaan ng servesa. Brewing n
Pag gagawa ng servesa. Bribe n Suhol. Bribe-2/-Suhulin; suhulan.
Bribery n Suhol; pagsusuhol. Bricabrac n Manga sangkap na munti
ang halaga. Brick-n-Lario; ladrillo. Brick-v Ilagay ng lario. Brickbat-?!-
Pirasong lario. Brick kiln n.Gawaan ng ladrillos ó lario. Bricklayer-ti
Kantero. Brickmakern Ang gumagawa ng lario. Bridal-a Nauukol sa
kasal. Bride n Mapangasawa. Bridegroom wLalaking bagong kasal.
Bridesmaid n Babaying abay sa kasal. Bridge w Tulay.
The text on this page is estimated to be only 17.05%
accurate
Our website is not just a platform for buying books, but a bridge
connecting readers to the timeless values of culture and wisdom. With
an elegant, user-friendly interface and an intelligent search system,
we are committed to providing a quick and convenient shopping
experience. Additionally, our special promotions and home delivery
services ensure that you save time and fully enjoy the joy of reading.
ebookfinal.com