Tyler Burge begs the question against nonrepresentationalism

There is an interesting article by Tyler Burge in the NY Times philosophy blog called “A Real Science of Mind” that I happen to disgree with vehemently. He basically claims that representationalism is the only game in town when it comes to explaining visual perception. In fact, he doesn’t even hint at the fact that representationalism is but one theory, and one supported by philosophically ambiguous explanations of what it means to actually “represent” something. Indeed, he says:

Explanation in perceptual psychology is a sub-type of task-focused explanation.  What makes it distinctively psychological is that it uses notions like representational accuracy, a specific type of correlation…Why are explanations in terms of representational accuracy needed?  They explain perceptual constanciesVisual perception is getting the environment right — seeing it, representing it accurately…Perceptual psychology explains how perceptual states that represent environmental properties are formed.

Now, it seems to me that Burge has massively begged the question against nonrepresentational explanations of low-level visual perception.

In  making this claim, I put myself in a precarious position. One of the main points of Burge’s article is that vision science is a highly developed and “mathematically rigorous” science. Burge is insistent that vision science is on solid explanatory ground and I have no intention of challenging the mountain of empirical evidence gathered by orthodox representational visual science. No, the question is not about the facts, but rather, about the interpretation of the facts. It is my claim that representationalism is but one way of interpreting the empirical facts gathered by orthodox visual science.

My claim goes as follows: talk about the visual creature “accurately representing” the environment can be replaced, without losing any explanatory power, by talk of “discriminating information” in the environment. Some would say this is merely a matter of semantics, and in a way they would be right. But when it comes to philosophical explanations of visual perception, semantics are of the utmost importance. But why bother with this semantic triviality between “representation” and “discrimination”? Aren’t they the same thing? In a way, yes. But, as William Ramsey has argued in his important book Representation Reconsidered, this theoretical equivalency is actually the result of orthodox visual science moving away from classic forms of representationalism. For when a visual scientist claims that the organism “accurately” represents a feature of the environment in perception, all the explanatory work is being done by the neural workhorse that is the brain. And, naturally, this explanation is ultimately cashed out in physiological terms, against Burge’s claim that visual science is truly representational.

It is my contention that talk of “differentiation” or “discrimination” is just as psychological as talk of “representation”, but discrimination is more ontologically coherent. Take the example of a hungry primate perceiving a juicy red strawberry. Orthodox visual science would say that in successfully perceiving the strawberry the primate must have accurately represented the red strawberry as a red strawberry, (and not, say, as a purple poisonberry). This is the classic representationalist explanation. On my view, it would be more philosophically parsimonious to say that in successfully perceiving the strawberry, the primate discriminated the strawberry from out of the ambient array of energy surrounding the strawberry. Another way of putting it would be that in perceiving the red strawberry the primate attended to the information specific to the features of the strawberry that were relevant to its internal needs, namely, hunger.

On this account, the primate can be said to perceive the red strawberry as nutritious, not as a strawberry. Notice how this is starkly different from the representationalist interpretation. For the representationalist, the primate’s perception of the strawberry is cashed out in terms of how accurately the internal representation is in comparison to the objective features of the strawberry. If the primate represents the strawberry as being red, and the strawberry really is red, then the primate’s perception of the strawberry is said to be “accurate”, and thus successful. It is then said that the brain consults the representation when forming its intentions to act. Orthodox visual theory is thus committed to what some philosophers have called the sense-represent-planact model. The primate receives proximal sense-data, tries to form an accurate representation of distal stimulus, consults the representation to form a plan, and then executes a motor command to pluck the strawberry and bring it into its mouth.

On my interpretation, we can eliminate the “represent” and “plan” stages and replace it with a sensorimotor model. On this account, the task of the brain is to discriminate the meaningful information already in the environment by attending to it. Neurally speaking, the discrimination supervenes upon the neural patterns of activity. So how is this different from the representationalist story? Because unlike Burge, I think the behavioral nature of discriminatory perception is actually a plus, not a downside (and of course, behavioral explanations are a kind of psychological explanation unless we beg the question against behaviorism). So we shouldn’t expect visual neuroscience to engage in representational theorization when the proper explanatory level of description is behavioral, not representational. I have never seen a representational theory that avoided the homunculus problem without merely collapsing into descriptions of the behavior of  neurons.

And for good reason. Although Burge claims that representation is well understood by visual science, he is only half-right. Representation is well understood if by that we mean that we understand the neural underpinning and physiological correlations of the representation. But as William Ramsey has argued, this is precisely the point. Orthodox visual science has never actually successfully explained how a representation actually functions as a representation, as opposed to being a merely physiological mediator in a long chain of neural activity that ultimately leads to effective motor behavior.

So while Burge is perfectly right to say that “neuralbabble” is nonexplanatory on the psychological level, I believe he is mistaken when he claims that representationalism offers a philosophically rigorous interpretative framework that explains the phenomena at hand. Burge recognizes this when he talks about “generic representations” that apply so widely to any causal correlation as to no longer being explanatorily useful in cognitive science. To make representation explanatorily worthwhile, he introduces the notion of “accuracy”. But as I attempted to explain above, there is an alternative interpretation of accuracy available that focuses on the accurate perception of an affordance. But, crucially, the accurate perception of an affordance is entirely different than the accurate representation of an objective feature. This is because the affordance is more directly tied into the motivational circuits and can thus undercut the “represent” and “plan” stages of the sense-represent-plan-act model and jump right into the scientifically respectable arena of “sensation” and “action”. Hence, sensorimotor models of visual perception. The notion of accurately representing objective features of the environment is replaced by the accurate discrimination of information specific to invariant properties of objects which are themselves specific to affordances (opportunities for behavior). Perceiving the strawberry then becomes a matter of attending to those features of the strawberry which either past experience or innate knowledge has taught to be relevant to homeostatic needs.

Hence, we can account for the normative or “psychological” component of perception (its possible success or failure) in terms of how well the organism is capable of detecting information specific to properties that are themselves specific to affordances. And this offers us a path towards a “real science of mind”. Why? Because affordance perception is directly tied into those sensorimotor causal pathways that have been so successfully studied by orthodox visual science. And it does this without invoking a notion of one thing somehow “standing in for” something else.

Now, my representational critics will respond by saying that the discrimination of information specific to affordances is no more understood than is the notion of accurately representing the environment. Point well taken. But it is my contention that orthodox visual science has been talking about discrimination all along. So I really don’t see myself as being a “revolutionary”. I contend that we could go into almost every single visual science article and change “represents” with “discriminates” without losing any explanatory value. In fact, I think this semantical change would actually enhance the explanatory power of visual science precisely because “discrimination” is more ontologically tractable insofar as it doesn’t make a sharp distinction between the “merely mechanical” sensation of a bacterium and the “cognitive” perceptual capacities of “representing creatures”. One could say that my theory offers a “flat ontology” wherein all lifeforms are said to share in the capacity for discrimination of information and reactivity in direct response to that discrimination. Accordingly, my interpretation is immediately amenable with the advances being made in evolutionary biology.

Moreover, and most importantly for my purposes, the rejection of representationalism for an explanation of basic visual perception would leave room for those phenomena that truly deserve a representational explanation: human symbolic cognition. Indeed, in rejecting representationalism for the explanation of basic visual perception I do not reject all representational explanations like Anthony Chemero does. I thus think, following Clark and Toribio, that some phenomena are “representation hungry”, while others aren’t. Following Gibson, I do not think that basic visual perception as shared by most animals on this planet is representation hungry. What I do think absolutely requires a representational explanation is the symbolic and linguistic cognition of humans. For the referential system that is language absolutely requires an explanation of how one thing (a linguistic symbol) could “stand in for” something else. For example, the word “strawberry” cognitively stands in for a real strawberry. Now, I’m not claiming to have a complete theory worked out about symbolic cognition. But I think significant progress in the mind sciences would be made if we all recognized this demarcation between the nonrepresentational, sensorimotor cognition we share with nonhuman animals and the representational, symbolic cognition seemingly unique to humans.



Filed under Philosophy, Psychology

5 responses to “Tyler Burge begs the question against nonrepresentationalism

  1. What do you mean by the term “representation?” I know what psychologists mean, even if they tend to use the term rather loosely, but I’m not quite sure what you mean by it.

    • Gary Williams


      I tend to use the standard definition of one thing “standing in for” something else, particularly when that something isn’t currently present. So, if a brain is representing an apple, then that brain has something inside of it which stands in for the apple, even if that apple isn’t in front of it.This is why representationalism is usually associated with some kind of internalism: the representation is said to be “inside” the head, standing in for something that is outside the head. This allows the brain to experience the apple even if the apple isn’t actually there. This is why the illusions and hallucinations are often cited as examples of evidence for the truth of representationalism as a general theory of how brains works.

      My claim is that no adequate explanation has ever been given of how this “standing in for” function actually works in terms of brain physiology. It is one thing to say that the activity of neurons in the brain represents an apple, it is quite another to give a working theory of how neurons actually “stand in for” something else, as opposed to being mere causal mediators in a chain of complicated physiological reactions.

      Moreover, it is important to note that psychologists and neuroscientists often use representation to mean something like a “map”. So the existence of topographic maps in the visual cortex is supposed to be proof that the brain is a representing machine. But one can talk about isomorphic and topographic map-making without talking about those maps “standing in for” what they are representing. The maps simply fulfill a function, in the same way you could train a stupid computer to use a map without really “understanding” it symbolically. The human geographical map only “stands in for” the terrain because there is a cultural custom which dictates it symbolically. But to say that this same kind of standing-in-for is going on in the brain is a different thing altogether, especially when you consider that the neurons aren’t getting together and jointly deciding that neural maps will stand in for something else. We can explain geographical maps in terms of cultural customs, but this is what’s called a “derived” representation, since it only makes sense in terms of a community of cognitive agents with a shared set of norms. But a population of neurons doesn’t work in the same way as a population of symbol using agents. So while neuroscientists often claim that representations are well-understood since we sort of understand how maps are made, the analogy simply doesn’t go through when talking about a neuron “standing in for” something else. The point of my article was to show that we can replace talk about neurons “standing in for” something else with talk about neurons making discriminations and differentiating information. It’s still a form of information processing, but the emphasis is on immediate reactivity and sensorimotor couplings rather than things “standing in for” things at a distance. I hope that answers your question.

  2. I would agree that, at least in psychology, there isn’t really one idea of what the “standing in” for something means, though I’m not sure representation always means “standing in,” as that phrase seems to carry a lot with it that the term “representation,” as it’s used in both perceptual and cognitive psychology, doesn’t necessarily imply. I prefer “discrete information states,” which tends to be what computationalists, who are certainly representationalists, mean by “representation,” along with a the assumption of a represented world and a “representing world,” which can be any number of things (a “mind,” an actual digital computer, or depending on your view, a thermostat). This is considerably less than “standing in,” though it doesn’t preclude it. With this definition, which again, is pretty much the baseline in psychology, you still need some way of connecting the discrete information states in the representing world with the represented world, and there are a lot of ways of doing that. Your solution sounds a lot like behaviorism, even if I think it’s a little muddled at one end (so was behaviorism), but there are other ways of getting from here to there. Bayesians, computationalists, connectionists, all ultimately have some behavioral connection, even if it’s not always clear how you get from here to there. I’m not sure it’s really any clearer on your view, though.

  3. Vic P

    I think Burge’s statement performs a clarity of disitnction which may help your own explanation of differences: “Representation, in the specific sense, and consciousness are the two primary properties that are distinctive of psychological phenomena. Consciousness is the what-it-is-like of experience. Representation is the being-about-something in perception and thought. Consciousness is introspectively more salient. Representation is scientifically better understood.”

    If conscious experience occurs in all neurons in our brain as latent consciousness, then represention is a heightening of conscious experience within those firing neuron patterns. Heightened conscious experiences move through a complex system of gate keeping and accuracy attainment along with our ability to suppress superfluous environmental information. We may spot a woman in a crowd from afar and our emotions are heightened because she may appear to be a long lost friend. Only when we get closer to her can we confirm or deny our emotional reaction which is supportive of the idea that I believe you are promoting.

  4. The evidence for representationalism is present in the world you see around you. The arguments for direct perception are indefensible. See

    Gestalt Isomorphism and the Primacy of Subjective Experience

    Or for a more informal cartoon presentation of the same issues see

    A Cartoon Epistemology

    Theories that provide no ontology for the sense-data of experience are theories that fail to acknowledge the existence of the most significant explanandum (that which is to be explained) which is: What is the origin of conscious experience? The answer “There is no conscious experience” (or “it is not experienced the way it is experienced to be experienced”) are no longer defensible.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s