Psych 3140/6140

Shimon Edelman, <se37@cornell.edu>

Week 2: Universal tools, I

 Lecture 2.2: Behavior

how to study animal minds?

[from Lecture 1.1] A real explanation of some aspect of the mind would have to be:

[from Lecture 1.2] A complete explanation of some aspect of the mind would have to be:

How should we choose what aspects/activities of the mind to study? Ethology — the science of BEHAVIOR — to the rescue.

how to NOT make sense of behavior

how to NOT make sense of behavior

behavior and the distinction between "mathematical" and "computational" psychology

"Look at our present theories... Look at Hull's system or at the probabilistic models that are multiplying like overexcited paramecia. Although already too complicated for the average psychologist to handle, these theories are not yet adequate to account for the behavior of a rodent on a runway."

— W. K. Estes, Of models and men, American Psychologist 12:609-617 (1957)


In physics — where observations are always given a mathematical formulation — the foundational concern is with quantitative PATTERNS or LAWS, which are to be inferred, by induction, from particulars. (In psychology, Shepard's Law of Generalization, to be discussed in a later week, is a key example; the role of induction in cognition will also be discussed.)

Computational cognitive science requires, in addition to a mathematical theory, an EXPLICIT and EFFECTIVE algorithmic component: a mere statement of "law" (pattern) is not enough. Computational models also aim to explain — productively and quantitatively, not merely verbally — the PARTICULARS OF BEHAVIOR.

[ASIDE #1] a propos mutual aid in rats: P. Kropotkin (1902)

"And man is appealed to be guided in his acts, not merely by love, which is always personal, or at the best tribal, but by the perception of his oneness with each human being. In the practice of mutual aid, which we can retrace to the earliest beginnings of evolution, we thus find the positive and undoubted origin of our ethical conceptions; and we can affirm that in the ethical progress of man, mutual support not mutual struggle — has had the leading part. In its wide extension, even at the present time, we also see the best guarantee of a still loftier evolution of our race."

[ASIDE #1, cont.] mutual aid: an updated survey (Servigne & Chapelle, 2022)

"In the merciless arena of life, we are all subject to the law of the jungle, to ruthless competition and the survival of the fittest – such is the myth that has given rise to a society that has become toxic for our planet and for our and future generations."

"But today the lines are shifting. A growing number of new movements and thinkers are challenging this skewed view of the world and reviving words such as ‘altruism’, ‘cooperation’, ‘kindness’ and ‘solidarity’. A close look at the wide spectrum of living beings reveals that, at all times and in all places, animals, plants, microorganisms and human beings have practised different forms of mutual aid. And those which survive difficult conditions best are not necessarily the strongest, but those which help each other the most."

— P. Servigne and G. Chapelle (2022). Mutual Aid: The Other Law of the Jungle.

[ASIDE #2] what to do when your friend or neighbor is caged

[ASIDE #2, cont.] when your friend or neighbor is caged

[ASIDE #3] borders and climate

Video source: A conceptual framework for cross-border impacts of climate change, T. R. Carter et al. (2021). Global Environmental Change 69:102307.

See also: The planetary commons: A new paradigm for safeguarding Earth-regulating systems in the Anthropocene, J. Rockström et al. (2024). Proc. Natl. Acad. Sci. 121(5):e2301531121.

[back to explaining behavior] minds are FOR behavior, and behavior is...

Behavior is much more than

(Some) psychologists knew it all along:

To make real progress towards understanding behavior, one must study ethology and evolutionary ecology.

the S/R fallacy: William James expressing the "reflex arc" idea (1911)


"The structural unit of the nervous system is in fact a triad, neither of whose elements has any independent existence. The sensory impression exists only for the sake of awaking the central process of reflection, and the central process of reflection exists only for the sake of calling forth the final act."

— William James (1911)
Essays in Popular Philosophy

the S/R fallacy: Donald Hebb's publisher's cover designer expressing the "reflex arc" idea (1911)

Another facepalm is in order (look at the subtitle)...

the S/R fallacy exposed: John Dewey on the "reflex arc" concept (1896)


"What we have is a circuit, not an arc or broken segment of a circle. [...] The motor response determines the stimulus, just as truly as sensory stimulus determines movement. Indeed, the movement is only for the sake of determining the stimulus, of fixing what kind of a stimulus it is, of interpreting it.
[...] There is simply a continuously ordered sequence of acts, all adapted in themselves and in the order of their sequence, to reach a certain objective end, the reproduction of the species, the preservation of life, locomotion to a certain place. The end has got thoroughly organized into the means."

John Dewey (1896)
The Reflex Arc Concept in Psychology
Psychological Review, 3, 357-370

decades later, the S/R fallacy persists (critique by Louis Thurstone, 1923)


"My main thesis is that conduct originates in the organism itself and not in the environment in the form of a stimulus. [...] Perception is the discovery of the suitable stimulus which is often anticipated imaginally. The appearance of the stimulus is one of the last events in the expression of impulses in conduct. The stimulus is not the starting point for behavior."

L. L. Thurstone (1923)
The Stimulus Response Fallacy in Psychology
Psychological Review, 30, 354-369

fast forward to the present: the S/R fallacy is rampant in textbooks (Brembs, 2020)

Six arbitrarily selected examples from neuroscience textbooks schematically depicting the passive-static perspective on nervous system function.

doing away with the reflex arc fallacy (Brembs, 2020)

  1. Freely moving animals control their sensory input with their behavior and the perceived feedback from the environment instructs them which actions to select next in order to achieve their goal (goal-directed behavior). This closed-loop situation complicates clear statements about cause and effect in neuroscience, leading to attempts to open the loop for linear analysis.
  2. Opening the closed feedback loop at the behavior of the animal presupposes that the main causation needing understanding is one from the environment to the behavior. It assumes that nervous systems are organized mainly in a passive way, such that external stimuli are both necessary and sufficient causal antecedents for behavior. Active internal processes, inasmuch as they play a role in this perspective at all, at most modulate the response to external stimuli.
  3. The goal-directed nature of behavior is largely preserved in the active-dynamic perspective, where internal processes generate actions in order to control the stimuli the organism will encounter. If present, stimuli modulate the generation of behavior, but are neither necessary nor sufficient for any given behavior to be generated.

how complex is "mere" foraging behavior?

How complicated can it be to live as a goat, or a cow?

foraging: environmental constraints

foraging: long-term needs

foraging: immediate choices

how to valiantly try and still fail to make sense of behavior

"In the second half of the last century, a whole institute (Max Planck Institute of Biological Cybernetics, Tübingen) was founded on the discovery of an input-output behavior, the optomotor response, which for the first time had been described by a mathematical algorithm. Drosophila got introduced to many branches of neuroscience and has made fascinating contributions to these fields. Yet, has any of that spectacular progress revealed how brains work? Rather not; neither in the Tübingen School nor anywhere else. Why? What is the problem with brain research? The problem is the input-output doctrine. It is the wrong dogma, the red herring. The hard-wired reflex, the innate response to a stimulus, is not the essence of brain function, not the basic building block of behavior. Behavior is problem solving. It is part of the evolutionary process. It is fundamentally active."

[from The Beauty of the Network in the Brain and the Origin of the Mind in the Control of Behavior, M. Heisenberg, J. Neurogenetics, 28:389-399, 2014]

how to go about making sense of behavior (Anderson & Perona, 2014)

The new field of ‘‘Computational Ethology’’ is made possible by advances in technology, mathematics, and engineering that allow scientists to automate the measurement and the analysis of animal behavior. We explore the opportunities and long-term directions of research in this area.

Contempt for simple observation is a lethal trait in any science.—Niko Tinbergen (‘‘On Aims and Methods of Ethology’’)

Toward a Science of Computational Ethology, D. J. Anderson and P. Perona, Neuron 84:18-31 (2014).


On the right: Summary of steps in the automated analysis of social behavior. Each of the four steps (detection, tracking, action detection, and behavior analysis) requires validation by comparison to manually scored ground truth. The ethogram illustrates different behaviors performed during male-male and male-female social interactions.

how to go about making sense of behavior (Anderson & Perona, 2014)

Ethograms based on machine vision analysis of multiple flies, for eight different behaviors.

  1. Automatic scoring from video recordings of 20 flies walking in an arena.
  2. Two minute trajectory of a single male fly detected among 20 in the arena.
  3. Upper: raster plot for behaviors exhibited during the trajectory in (B); lower: translational and angular velocities superimposed on a 30 s segment of the raster plot.
  4. Behavioral ‘‘vectors’’ for female, male, and fru1/fru1 mutant male flies. Each column represents a single fly and each row a single behavior. Numbers at top refer to experiment and number of flies tracked.

Gómez-Marín & Ghazanfar: the life of behavior (2019)

"It is daunting to render the behavior of organisms intelligible without suppressing most, if not all, references to life. When animals are treated as passive stimulus-response, disembodied and identical machines, the life of behavior perishes. Here, we distill three biological principles, spell out their consequences for the study of animal behavior, and illustrate them with various examples from the literature.

We propose to put behavior back into context, with the brain in a species-typical body and with the animal’s body situated in the world; stamp Newtonian time with nested ontogenetic and phylogenetic processes that give rise to individuals with their own histories; and supplement linear cause-and-effect chains and information processing with circular loops of purpose and meaning. We believe that conceiving behavior in these ways is imperative for neuroscience."

"The three principles are a subset of features arguably unique to life. We claim their necessity to understanding living organisms and reformulate them as fundamental principles in behavior rather than as mere characteristics. The principles are materiality, agency, and historicity. Behaviorally, they account for the constitutive roles of (1) morphology and environment; (2) action-perception closed loops and purpose; and (3) individuality and historical contingencies. These factors make up ‘‘the life of behavior.’’"

Gómez-Marín & Ghazanfar: An integrative example: tool use by chimpanzees

"Chimps use sticks to gather honey, termites, and ants from the ground or trees in order to eat them without getting stung, bit, or pinched. We can use this behavior to illustrate how materiality, agency, and historicity contribute to an explanation.

The goal of tool-using in this case is to acquire energy. This goal belongs to a hierarchy of goals: a higher level than having enough energy is the goal of not dying; a level below acquiring energy is the goal of finding a tool and then using it properly, which in turn entails the goal of approaching the potential food source. Levels above answer why; the levels below answer how. Depending on the task (breaking, prodding, or collecting), the stick can be held in various ways, including the precision grip (that is, between any two fingers but without the use of the palm). This illustrates an equifinality; chimps will diverge in the means but converge in the goal. To perform a precision grip requires specific hand biomechanics (e.g., thumbs that rotate around a joint). All Old World primates (and one New World monkey) can perform a precision grip; other animals cannot.

Tool use also requires specialized neural circuitry operating in conjunction with those biomechanics in a goal-directed manner. The precision grip is correlated with extensive cortico-motoneuronal terminations in the ventral horn of the spinal cord, and motor planning and coordination are associated with neocortical areas 2 and 5, which are enlarged in tool-using primates. Finally, tool use is also a learned behavior; young chimpanzees learn by watching older chimpanzees combined with trial and error. Thus, tool use is a behavior bound to the body and brain circuits, and that emerges on evolutionary and developmental timescales."

Gómez-Marín & Ghazanfar: the life of behavior (2019)

  1. Within the pervasive (and at times pernicious) information processing metaphor, life is nothing but information run in dull matter as disposable hardware.
  2. The brain is embodied, and the body is not a mere neural placeholder.
  3. The brain and its body live in the real world, under the constraints of physical surroundings (Umgebung) but also in the meaningful environment of the animal (Umwelt). In sum, materiality matters.
  4. Inertia is the default state of inert objects, whose motion is the result of reactive push-pull forces. Along with (A), brains are computers that transform stimuli into responses, which are equated with behavior.
  5. Beyond linear causality, a feedback loop goes through the world and back. Behavior then is not simple production of output but rather control of input.
  6. Servomechanisms fail to do justice to the fact that animals are proactive and have purposes in mind. Agency is intrinsic to life.
  7. Having de-contextualized space (A) and linearized time (D), the study of behavior falls prey to the ‘‘manipulate and measure’’ approach, where variability is deemed noise to be tamed with statistics.
  8. From the perspective of the animal, variable output serves to achieve intended invariant inputs. Living beings harness stochasticity.
  9. These iterative processes take place on multiple nested timescales, from actual genesis to ontogenesis to phylogenesis. Animals are individuals.

[EXTRA] Gómez-Marín & Ghazanfar: the life of behavior (2019)

The ceteris paribus principle (‘‘the same produces the same’’) is inapplicable in experimental biology, since the covert assumption ‘‘all things being equal’’ actually fails.

  1. Inert systems can be treated as indistinguishable—they have no history, agency, or personality.
  2. Despite the existence of common biological mechanisms and shared principles of behavior, humans are not a collage of a handful of laboratory animals. Organisms with fewer neurons are not necessarily ‘‘simpler’’ organisms either, and ‘‘organism models’’ are not ‘‘model organisms’’.
  3. Laboratory wild-type animals are often anything but wild or exact controls for transgenic animals. Average group behavior may not coincide with any of the behavior of the individuals in that group. Individuality is real and relevant.
  4. Behavior studied in animals whose bodies and worlds have been truncated can be misleading and not generalizable (the behavior of a paralytic cat in an empty arena is far from cat behavior).
  5. During development, animals undergo major changes not only in their behavior but also in their bodies. Behavior is generated serially. HISTORY MATTERS.

[EXTRA] Gómez-Marín & Ghazanfar: beyond a Frankenstein biology

  1. The modern approach to understand behavior ‘‘cuts’’ but fails to ‘‘stitch.’’ Wholes are taken to be the sum of their parts, which in turn are considered replaceable. Context is believed to be dispensable. Biology literally becomes puzzle-solving; like in a Sudoku, our job is to fill in the gaps or crack the circuit.
  2. In opposition to (A), after cutting, one cannot really sew life back the life of behavior, because context is constitutive and thus inseparable from content. This tension is illustrated in (C) and (D) with respect to space and in (E) and (F) with respect to time.
  3. Do not cut the body, as it is not a neural ‘‘plug-in’’ for behavior. For instance, in chess, only algorithm matters, and implementation is irrelevant. However, in pool, the body is an inextricable part of the game. One can never play the same pool game twice.
  4. Do not cut the world. Even when the body is taken into account, the same posture can reflect very different behaviors. Leaving the world out literally leaves the body floating in an empty space, disregarding the umwelt of the animal. The meaning of the behavior is then lost.
  5. Do not cut the loop. When our study of the organism in the lab is framed under the ‘‘manipulate and measure’’ arc, anthropomorphism has crept into the interpretation of behavior before any data are even collected. The organism, being an agent like the scientist, is also trying to measure and manipulate. Thus, linear causality (so dear to us) is a broken loop that cannot account for the circularity that constitutes the behavior of organisms.
  6. Do not cut the history. The restoration of initial conditions is an abstraction inapplicable in biology. Living organisms are individuals; they have their own history. Treating them as indistinguishable particles smears out their intrinsic differences and trumps not only predictability but biological understanding.

Gómez-Marín & Ghazanfar: the life of behavior (2019) — conclusions

"In stressing that animals operate under circular causality, one could be tempted to conclude that what we need to do is to map animals to machines. Behavior would then be an engineering problem. Such a view would not grant animals with purpose, however. The life of behavior is circular causality toward a goal.

William James made the distinction beautifully: ‘‘If now we pass from such actions as these to those of living things, we notice a striking difference. Romeo wants Juliet as the filings want the magnet; and if no obstacles intervene he moves towards her by as straight a line as they. But Romeo and Juliet, if a wall be built between them, do not remain idiotically pressing their faces against its opposite sides like the magnet and the filings with the card. Romeo soon finds a circuitous way, by scaling the wall or otherwise, of touching Juliet’s lips directly. With the filings the path is fixed; whether it reaches the end depends on accidents. With the lover it is the end which is fixed, the path may be modified indefinitely’’ (James, 1890, p.7)."

[Beautiful, but irrelevant. Machines can be much more complex than a pile of iron filings. In Shakespeare's story, Romeo is one such machine; Juliet another.]

[Re: circular causality] "Why am I here? It's complicated."

Walking one evening along a deserted road, Mulla Nasruddin Hodja saw a troop of horsemen rapidly approaching. His imagination started to work; he saw himself captured or robbed or killed and frightened by this thought he bolted, climbed a wall into a graveyard, and lay down in an open grave to hide. Puzzled at his bizzare behaviour, the horsemen – honest travellers – followed him. They found him stretched out, tense, and shaking. “What are you doing in that grave? We saw you run away. Can we help you? Why are you here in this place?” “Just because you can ask a question does not mean that there is a straightforward answer to it,” said Nasruddin, who now realized what had happened. “It all depends upon your viewpoint. If you must know, however, I am here because of you – and you are here because of me!”

"Why am I here?" (cont.)

Merovingian: You see, there is only one constant, one universal, it is the only real truth: causality. Action. Reaction. Cause and effect.

Morpheus: Everything begins with choice.

Merovingian: No. Wrong. Choice is an illusion, created between those with power, and those without. ... Causality. There is no escape from it, we are forever slaves to it. Our only hope, our only peace is to understand it, to understand the `why.’ `Why’ is what separates us from them, you from me. `Why’ is the only real social power, without it you are powerless.

[EXTRA] an aside on "human wants" (recall Thurstone), free will, and the causes of things

From Computing the Mind (ch.10, p.464):

FREE WILL is “a philosophical term of art for a particular sort of capacity of rational agents to choose a course of action from among various alternatives”. Upon a close examination, this seemingly simple concept disintegrates into a heap of contradictions, as noted by Voltaire: “Now you receive all your ideas; therefore you receive your wish, you wish therefore necessarily. [. . . ] The will, therefore, is not a faculty that one can call free. The free will is an expression absolutely devoid of sense, and what the scholastics have called will of indifference, that is to say willing without cause, is a chimera unworthy of being combated” (cf. Dennett, 1984, p. 143).

Contrary to the popular misconception, randomness is not a solution to the problem of reconciling free will with physics: I want my decisions to be up to me—not blind chance or implacable fate. In the pursuit of free will, giving up determination in favor of randomness is like inviting the Vandals into the city just to dispose of its tyrant.


Intrigued? Outraged? Want to read more? See chapter 10 of Computing the Mind.

Still intrigued? Insufficiently outraged? There's The Consciousness Revolutions: From Amoeba Awareness to Human Emancipation.

Wait, there's more! My next book, provisionally titled Dialectics of Freedom, is in the works; watch this space!