Composite image with a drawing of a face on the left and the names of colors on the right

Unit 3: When seeing shouldn’t be believing

Guided Learning

Introduction

Those of us who are sighted rely immensely on our visual system to know and understand our physical and social world.

But the visual world is not perceived directly – our perception is only as good as the inferences we make based on past experiences. And sometimes these inferences just fail us. Was the job candidate you hired actually qualified, or did you make an incorrect assumption based on a visual cue that you were unaware of, like the beauty of their face or the style of their suit?

Here, we will explore different visual biases that may impact our decisions. The good news is that once we truly understand that our vision is fallible, we can act to outsmart it.

Module 1 of 5

Strooped!

Video

Most of us believe we can control what pieces of information influence our decisions. But can we? The Stroop Test suggests no.

Watch the video

Highlights

Key takeaways from this module
Interactive

Experience a powerful illusion in this demo based on experiments by Professors Dan Levin and Mahzarin Banaji.

Module 3 of 5

Illusions at work

Video

We say that “seeing is believing,” but visual illusions can trick us, whether we’re looking at checkerboards or human faces. How can we outsmart them?

Watch the video

Highlights

Key takeaways from this module
Interactive

Do you know what “competence” looks like? Try this quiz, based on Professor Alexander Todorov’s 2005 experiment, to learn what your impressions predict.

Our faces broadcast information about us: whether we’re smart, warm, trustworthy. How do these signals influence decision-making – and are they accurate?

Watch the video

Highlights

Key takeaways from this module

What You've Learned

Our vision is fallible. We inadvertently process irrelevant information, and our expectations, not reality, shape our perception.

Think back to the Levin and Banaji study, where pictures of faces with Afrocentric features were seen as darker than faces with Eurocentric features even though both were the same shade of gray. This should surprise us – our vision wasn’t accurate! What we saw was contrary to the facts. What does this mean for how we treat others?

We can hold ourselves to higher standards. We can ask ourselves to prove our initial assessments about a person with data, not gut feelings. Be your own devil’s advocate. Ask yourself questions like: what has this person done to justify this impression?

Vision plays a large role in making decisions. Identify and outsmart the sources of bias from visual information that can lead you astray – by deviating from both accuracy and your own values.

Test Your Knowledge

  1. What is the Stroop Effect?
  2. From the Stroop Task (saying the color of the word, not the word), the right lessons to take away are: (select all that apply)
  3. In the checkerboard illusion designed by vision scientist Ted Adelson, the shadowed “white” square and the unshadowed “black” square are actually
  4. Which of these facts about face perception are true? (select all that apply)

Reflections

Question 1

In the workplace, we often hire or assign tasks based on our evaluations of trust and competence. Of course, we want to hire people who are both trustworthy and competent, but our eyes and what we ‘see’ in a face can mislead us.

Faces are among the most potent sources of bias because we often fail to recognize that we are making deeper assumptions of a person’s character from the physical aspects of their face. What are ways we can outsmart face-based bias?

Think of concrete, actionable ways, not just vague promises like “I’ll try not to form impressions from the face”. These don’t work effectively – our brains automatically process the information in front of us, even if we don’t want them to!

What you write in this box is just for you. You will have a chance to download your response, but it will not be stored on our servers.

Your response:

Our thoughts:

The next time you can see a whole bunch of new faces, look at each face and ask yourself whether you believe the person “looks” trustworthy or not. Then do the same thing but ask yourself if the person “looks” competent or not. See if you can surprise yourself by how easily you seem to be making these decisions based on just the face, even though you know nothing about that person!

Are there patterns to your decisions? Do you think women’s faces exude greater trust than men’s faces? Or, that men’s faces signal more competence than women’s?

Now that you know the data, work to become your own best critic.

Congratulations! You have completed Unit 3: When seeing shouldn’t be believing.

Subscribe to Outsmarting Implicit Bias

Dive deeper

Extra materials if you want to learn more

Frank Stanton, the then-president of CBS, said of the Kennedy-Nixon debate: “Kennedy was bronzed beautifully… Nixon looked like death.” The legendary debate changed the face of political media strategy, but was it warranted? A 2003 study by political scientist James Druckman suggests, yes. People were significantly more likely to think Kennedy “won” the debate when they watched it versus listened to it.

Colors are one thing, but our decisions can also be influenced by something as insignificant as a single letter – whether we’re aware of it or not. Watch this video about how José Zamora dropped a single letter to gain a title, and read more about the research that shows how names can Stroop us.

There are illusions we all fall prey to, like Ted Adelson’s Checker-Shadow illusion or Roger Shepard’s table tops. But some perceptions vary from person to person. Remember this dress? Was it black and blue or white and gold? This simple question set fire to the internet in 2015. The real dress was black and blue… so why did some people see something so different? It turns out that the colors we “see” change depending on how our minds interpret the source of light in the photograph. Read more about the science behind the illusion at Wired.

Just as a face labeled “Black” or “White” looks darker or lighter, or how a musician labeled a “natural” or a “hard-worker” sounds different, the name at the top of a resume can change how qualified we think a person is. To learn more, read our article Can women be biased against other women? and listen to our podcast Race bias in hiring: When both applicant and employer lose.

“Some 51% of the employers who considered candidates individually chose an employee who had underperformed relative to the group. By contrast, only 8% of the employers who considered candidates side-by-side chose underperformers.” How does simultaneous evaluation help us see talent more clearly? Read more about the research at The Wall Street Journal.

“Most companies say they want to attract a diverse workforce, but few deliver. The only solution may be a radical one: anonymity.” Find out how Silicon Valley is taking steps towards a more diverse workforce (New York Times).

See more demonstrations of how faces influence our first impressions on the Perception and Judgment Lab’s website. Dr. Todorov’s book Face Value: The Irresistible Influence of First Impressions was published in 2017 by Princeton University Press.

“People are convinced that more competent-looking business people are more valuable, and they get higher salaries,’ [Professor Christopher] Olivola explained, even though the companies don’t perform any better under their leadership”. From James Hamblin’s article in The Atlantic: The Introverted Face.

“After his mugshot sent the Internet into a frenzy, the 32-year-old received modeling offers. Fundraising efforts and Facebook groups were created for Meeks”. From the Los Angeles Times’ Veronica Rocha: “‘Hot Felon’ Jeremy Meeks released from federal prison and gets job offers”.

A person’s face can even influence the medical care they receive: when clinicians watched videos of women undergoing painful examinations, Amanda Williams and colleagues found that they were less likely to recommend appropriate pain treatment for those who “looked” less trustworthy. Learn more at “The Conversation”.

Next unit:

Unit 3: When seeing shouldn’t be believing