The metadata of experience, the experience of metadata

I like to know where things stand. I like to know how things are progressing. I signed up for UPS My Choice and FedEx Delivery Manager and USPS Informed Delivery. I know when a package has been shipped to me, where it is at every moment as it hops across the country toward me, the projected window of its ultimate delivery, the fact of its delivery.

I know when there are exceptions. I know when the weather has turned inclement. I know the hubs, and I know the spokes.

When I myself require carriage, I order a car through Uber or Lyft, and in an instant I know my driver’s name, what he looks like, the model and color of the vehicle he is driving, and his rating (Vladislav, white Toyota Camry, 4.8). I see where he is on the map, how many minutes I must wait for his arrival. Sometimes his progress stalls, and my wait time increases by a minute, and this is painful to me.

I don’t want to be surprised. I prefer suffocation to surprise.

I give Vladislav five stars not because he deserves more than four stars but because I would like my life to be a series of five-star experiences.

I am standing in line in a building, waiting to get a matter taken care of, and in front of me is a sign requesting that I rate how I am feeling by pressing one of three emoji buttons. There is a smiling face and there is a frowning face, and between the two is a face with an expression of complete affectlessness. I choose the button in the middle, and immediately I feel my face go blank.

I like the fact that I can now check my credit rating without affecting my credit rating. I am no fan of the uncertainty principle.

I have come to realize that I learn more about other people by googling them than by meeting them and talking with them.

When a friend posts a new photo on Instagram, I give a lot of thought as to whether or not I should like it. These choices have effects on people, and they have ramifications for how people will judge me and my own offerings in the future. The likes I give, or withhold, say something about me as well as about the object or experience being rated. The generation of metadata should never be taken lightly.

Metadata is a kind of agony.

Everything that happens to me is time-stamped. My life is a series of transactions recorded in official ledgers. I am a clerk. I am a bureaucrat. I’m always on the job.

I know all the details. I know what just happened, and I know what happens next. Only the present escapes me.

Trump and Twitter

I have an essay on Donald Trump’s Twitter habit, and what it says about the times, in the new issue of Politico Magazine.

Here’s a bit:

In the early 1950s, the Canadian political economist Harold Innis suggested that every informational medium has a bias. By encouraging certain forms of speech and discouraging others, a popular medium not only influences how people converse; it also shapes a society’s institutions and values. Early types of media — tablets, scrolls, theaters — were “time-biased,” Innis wrote. Durable and largely stationary, they encouraged the long view and tended to underpin communities that were stable, hierarchical, and often deeply religious.

As communication technology advanced, new “space-biased” media came to the fore. Communication networks extended across great distances and reached mass audiences, and the messages the networks carried took on a more transactional and transitory character. Modern media, from post offices to telegraph lines to TV stations, encouraged the development of more dynamic societies built not on eternal verities but on commerce and trade.

By altering prevailing forms of communication, Innis argued, every new medium tends to upset the status quo. The recent arrival of social media fits this pattern. Thanks to the rise of networks like Twitter, Facebook, and Snapchat, the way we express ourselves, as individuals and as citizens, is in a state of upheaval. Radically biased toward space and against time, social media is inherently destabilizing. What it teaches us, through its whirlwind of fleeting messages, is that nothing lasts. Everything is disposable. Novelty rules. The disorienting sway that Trump’s tweets hold over us, the way they’ve blurred the personal and the public, the vital and the trivial, the true and the false, testifies to the power of the change, and the uncertainty of its consequences.

Read on.

Image: Politico.

Gray area: Google’s truthiness problem

I never realized that the guy who wrote Straw Dogs is the very same guy who wrote Men Are from Mars, Women Are from Venus. Sometimes it boggles the mind what you discover through Google:

The absurdity of confusing these two writers is priceless, but Google’s cavalier willingness to allow its algorithms to publish misinformation and nonsense does raise important questions, both epistemological and ethical. Is it OK to run an AI when you know that it will spread falsehoods to the public — and on a massive scale? Is it OK to treat truth as collateral damage in the supposed march of progress? Google in its early days illuminated the possibilities of search algorithms. Now it seems determined to reveal their limits.

Update: Google is even cavalier when it comes to issuing death notices.

Being there

I have an essay, “The World Beyond the Screen,” in the catalog for the current exhibition Being There at the Louisiana Museum of Modern Art in Denmark. The essay begins:

The paradox of modern media is that in opening the world to us, it removes us from the world. To enjoy the informational and recreational bounties of the networked screen, whether it’s a television, a personal computer, or a smartphone, we have to withdraw from our immediate physical and social surroundings. Our mind, with its faculties of attention and perception, has to shift its focus to the simulated, or virtual, images and experiences served up by the technological system. To speak of our time as one of great “connectivity” is to see only half the picture. We disconnect to connect.

The ability of the human mind to remove itself, purposely, from its physical surroundings and enter an artificial environment is, so far as we can tell, a talent unique to our species. And it’s a talent that seems elementally important to us, as individuals and as a society. It’s what unlocks the realm of imagination, and it’s what gives rise to much of what’s most valuable and enduring in culture. When we speak of being “transported” by a work of literature or art, we’re acknowledging the power of the mind to wander beyond the here-and-now, beyond the physical and temporal bounds of immediate reality.

Yet our ability to remove ourselves from reality also brings peril. . . .

The exhibition runs until February 25th of next year. Copies of the catalog are available at the museum’s shop.

How smartphones hijack our minds

So you bought that new iPhone. If you’re like the typical owner, you’ll be pulling your phone out and using it some 80 times a day, according to data Apple collects. That means you’ll be consulting the glossy little rectangle nearly 30,000 times over the coming year. Your new phone, like your old one, will become your constant companion and trusty factotum — your teacher, secretary, confessor, guru. The two of you will be inseparable.

The smartphone is something new in the world. We keep the gadget within reach more or less around the clock, and we use it in countless ways, consulting its apps and checking its messages and heeding its alerts scores of times a day. The smartphone has become a repository of the self, recording and dispensing the words, sounds and images that define what we think, what we experience and who we are. In a 2015 Gallup survey, more than half of iPhone owners said that they couldn’t imagine life without the device.

We love our phones for good reasons. It’s hard to think of another product that has provided so many useful functions in such a handy form. But while our phones offer convenience and diversion, they also breed anxiety. Their extraordinary usefulness gives them an unprecedented hold on our attention and a vast influence over our thinking and behavior. So what happens to our minds when we allow a single tool such dominion over our perception and cognition?

Scientists have begun exploring that question — and what they’re discovering is both fascinating and troubling. Not only do our phones shape our thoughts in deep and complicated ways, but the effects persist even when we aren’t using the devices. As the brain grows dependent on the technology, the research suggests, the intellect weakens.

So what happens to our minds
when we allow a single tool such dominion
over our perception and cognition?

Adrian Ward, a cognitive psychologist and marketing professor at the University of Texas at Austin, has been studying the way smartphones and the internet affect our thoughts and judgments for a decade. In his own work, as well as that of others, he has seen mounting evidence that using a smartphone, or even hearing one ring or vibrate, produces a welter of distractions that makes it harder to concentrate on a difficult problem or job. The division of attention impedes reasoning and performance.

A 2015 Journal of Experimental Psychology study found that when people’s phones beep or buzz while they’re in the middle of a challenging task, their focus wavers, and their work gets sloppier — whether they check the phone or not. Another 2015 study, appearing in the Journal of Computer-Mediated Communication, showed that when people hear their phone ring but are unable to answer it, their blood pressure spikes, their pulse quickens, and their problem-solving skills decline.

What the earlier research didn’t make clear is whether smartphones differ from the many other sources of distraction that crowd our lives. Dr. Ward suspected that our attachment to our phones has grown so intense that their mere presence might diminish our intelligence. Two years ago, he and three colleagues — Kristen Duke and Ayelet Gneezy from the University of California, San Diego, and Disney Research behavioral scientist Maarten Bos — began an ingenious experiment to test his hunch.

The researchers recruited 520 undergraduates at UCSD and gave them two standard tests of intellectual acuity. One test gauged “available working-memory capacity,” a measure of how fully a person’s mind can focus on a particular task. The second assessed “fluid intelligence,” a person’s ability to interpret and solve an unfamiliar problem. The only variable in the experiment was the location of the subjects’ smartphones. Some of the students were asked to place their phones in front of them on their desks; others were told to stow their phones in their pockets or handbags; still others were required to leave their phones in a different room.

The results were striking. In both tests, the subjects whose phones were in view posted the worst scores, while those who left their phones in a different room did the best. The students who kept their phones in their pockets or bags came out in the middle. As the phone’s proximity increased, brainpower decreased.

In subsequent interviews, nearly all the participants said that their phones hadn’t been a distraction—that they hadn’t even thought about the devices during the experiment. They remained oblivious even as the phones disrupted their focus and thinking.

A second experiment conducted by the researchers produced similar results, while also revealing that the more heavily students relied on their phones in their everyday lives, the greater the cognitive penalty they suffered.

In an April article in the Journal of the Association for Consumer Research, Dr. Ward and his colleagues wrote that the “integration of smartphones into daily life” appears to cause a “brain drain” that can diminish such vital mental skills as “learning, logical reasoning, abstract thought, problem solving, and creativity.” Smartphones have become so entangled with our existence that, even when we’re not peering or pawing at them, they tug at our attention, diverting precious cognitive resources. Just suppressing the desire to check our phone, which we do routinely and subconsciously throughout the day, can debilitate our thinking. The fact that most of us now habitually keep our phones “nearby and in sight,” the researchers noted, only magnifies the mental toll.

Dr. Ward’s findings are consistent with other recently published research. In a similar but smaller 2014 study in the journal Social Psychology, psychologists at the University of Southern Maine found that people who had their phones in view, albeit turned off, during two demanding tests of attention and cognition made significantly more errors than did a control group whose phones remained out of sight. (The two groups performed about the same on a set of easier tests.)

In another study, published in Applied Cognitive Psychology this year, researchers examined how smartphones affected learning in a lecture class with 160 students at the University of Arkansas at Monticello. They found that students who didn’t bring their phones to the classroom scored a full letter-grade higher on a test of the material presented than those who brought their phones. It didn’t matter whether the students who had their phones used them or not: All of them scored equally poorly. A study of nearly a hundred secondary schools in the U.K., published last year in the journal Labour Economics, found that when schools ban smartphones, students’ examination scores go up substantially, with the weakest students benefiting the most.

Imagine combining a mailbox, a newspaper, a TV,
a radio, a photo album, a public library
and a boisterous party attended by
everyone you know, and then compressing them all
into a single, small, radiant object.
That is what a smartphone represents to us.

It isn’t just our reasoning that takes a hit when phones are around. Social skills and relationships seem to suffer as well. Because smartphones serve as constant reminders of all the friends we could be chatting with electronically, they pull at our minds when we’re talking with people in person, leaving our conversations shallower and less satisfying. In a 2013 study conducted at the University of Essex in England, 142 participants were divided into pairs and asked to converse in private for ten minutes. Half talked with a phone in the room, half without a phone present. The subjects were then given tests of affinity, trust and empathy. “The mere presence of mobile phones,” the researchers reported in the Journal of Social and Personal Relationships, “inhibited the development of interpersonal closeness and trust” and diminished “the extent to which individuals felt empathy and understanding from their partners.” The downsides were strongest when “a personally meaningful topic” was being discussed. The experiment’s results were validated in a subsequent study by Virginia Tech researchers, published in 2016 in the journal Environment and Behavior.

The evidence that our phones can get inside our heads so forcefully is unsettling. It suggests that our thoughts and feelings, far from being sequestered in our skulls, can be skewed by external forces we’re not even aware of. But the findings shouldn’t be a surprise. Scientists have long known that the brain is a monitoring system as well as a thinking system. Its attention is drawn toward any object that is new, intriguing or otherwise striking — that has, in the psychological jargon, “salience.” Media and communications devices, from telephones to TV sets, have always tapped into this instinct. Whether turned on or switched off, they promise an unending supply of information and experiences. By design, they grab and hold our attention in ways natural objects never could.

But even in the history of captivating media, the smartphone stands out. It is an attention magnet unlike any our minds have had to grapple with before. Because the phone is packed with so many forms of information and so many useful and entertaining functions, it acts as what Dr. Ward calls a “supernormal stimulus,” one that can “hijack” attention whenever it is part of our surroundings — and it is always part of our surroundings. Imagine combining a mailbox, a newspaper, a TV, a radio, a photo album, a public library and a boisterous party attended by everyone you know, and then compressing them all into a single, small, radiant object. That is what a smartphone represents to us. No wonder we can’t take our minds off it.

The irony of the smartphone is that the qualities that make it so appealing to us — its constant connection to the net, its multiplicity of apps, its responsiveness, its portability — are the very ones that give it such sway over our minds. Phone makers like Apple and Samsung and app writers like Facebook, Google and Snap design their products to consume as much of our attention as possible during every one of our waking hours, and we thank them by buying millions of the gadgets and downloading billions of the apps every year. Even prominent Silicon Valley insiders, such as Apple design chief Jonathan Ive and veteran venture capitalist Roger McNamee, have begun to voice concerns about the possible ill effects of their creations. Social media apps were designed to exploit “a vulnerability in human psychology,” former Facebook president Sean Parker said in a recent interview. “[We] understood this consciously. And we did it anyway.”

As strange as it might seem, people’s knowledge
and understanding may actually dwindle
as gadgets grant them easier access
to online data stores.

A quarter-century ago, when we first started going online, we took it on faith that the web would make us smarter: More information would breed sharper thinking. We now know it’s not that simple. The way a media device is designed and used exerts at least as much influence over our minds as does the information that the device disgorges.

As strange as it might seem, people’s knowledge and understanding may actually dwindle as gadgets grant them easier access to online data stores. In a seminal 2011 study published in Science, a team of researchers — led by the Columbia University psychologist Betsy Sparrow and including the late Harvard memory expert Daniel Wegner — had a group of volunteers read forty brief, factual statements (such as “The space shuttle Columbia disintegrated during re-entry over Texas in Feb. 2003”) and then type the statements into a computer. Half the people were told that the machine would save what they typed; half were told that the statements would be erased.

Afterward, the researchers asked the subjects to write down as many of the statements as they could remember. Those who believed that the facts had been recorded in the computer demonstrated much weaker recall than those who assumed the facts wouldn’t be stored. Anticipating that information would be readily available in digital form seemed to reduce the mental effort that people made to remember it. The researchers dubbed this phenomenon the “Google effect” and noted its broad implications: “Because search engines are continually available to us, we may often be in a state of not feeling we need to encode the information internally. When we need it, we will look it up.”

Now that our phones have made it so easy to gather information online, our brains are likely off-loading even more of the work of remembering to technology. If the only thing at stake were memories of trivial facts, that might not matter. But, as the pioneering psychologist and philosopher William James said in an 1892 lecture, “the art of remembering is the art of thinking.” Only by encoding information in our biological memory can we weave the rich intellectual associations that form the essence of personal knowledge and give rise to critical and conceptual thinking. No matter how much information swirls around us, the less well-stocked our memory, the less we have to think with.

This story has a twist. It turns out that we aren’t very good at distinguishing the knowledge we keep in our heads from the information we find on our phones or computers. As Dr. Wegner and Dr. Ward explained in a 2013 Scientific American article, when people call up information through their devices, they often end up suffering from delusions of intelligence. They feel as though “their own mental capacities” had generated the information, not their devices. “The advent of the ‘information age’ seems to have created a generation of people who feel they know more than ever before,” the scholars concluded, even though “they may know ever less about the world around them.”

That insight sheds light on society’s current gullibility crisis, in which people are all too quick to credit lies and half-truths spread through social media. If your phone has sapped your powers of discernment, you’ll believe anything it tells you.

Data, the novelist and critic Cynthia Ozick once wrote, is “memory without history.” Her observation points to the problem with allowing smartphones to commandeer our brains. When we constrict our capacity for reasoning and recall or transfer those skills to a gadget, we sacrifice our ability to turn information into knowledge. We get the data but lose the meaning. Upgrading our gadgets won’t solve the problem. We need to give our minds more room to think. And that means putting some distance between ourselves and our phones.

This essay appeared originally, in a slightly different form, in the Wall Street Journal.

Image of iPhone X: Apple.

Design for misuse

Last Friday, New Yorker editor David Remnick interviewed Apple design chief Jony Ive as part of the magazine’s TechFest. Midway through the conversation came an interesting (and widely reported) exchange in which Ive expressed some regret about people’s use of his most celebrated creation, the iPhone:

Remnick: There’s a ubiquity about the iPhone and its imitators. And I wonder, … do you have any sense of how much you’ve changed life and the way daily life is lived, and the way our brains work? And how do you feel about it? Is it pure joy? Are you ambivalent about it in any way?

Ive: No, there’s — there’s certainly an awareness. I mean, I tend to be so completely preoccupied with what we’re working on at the moment. That tends to take the oxygen. Like any tool, you can see there’s wonderful use and then there’s misuse. …

Remnick: How can — how can they be misused? What’s a misuse of an iPhone?

Ive: I think perhaps constant use.

Remnick: Yes.


It’s good to see Ive admitting that there may be a problem with people’s compulsive use of smartphones. But, as Business Insider‘s Kif Leswing and others have pointed out, there’s something cynical about the designer’s attempt to shift the blame to the owners of the iPhone for “misusing” it. Remnick didn’t follow up by asking Ive to describe particular design decisions that he and his team have made to deter the iPhone’s “constant use,” but it would have been a fair question, and I’m pretty sure Ive wouldn’t have had much of an answer.

Everything we know about the iPhone and its development and refinement suggests it has been consciously and meticulously designed and marketed to encourage people to use it as much as possible, to treat it, even, as a fetish. Here, for example, is how Apple is promoting the new iPhone X at its web store:

If Apple’s “vision” has always been to create a phone “so immersive the device itself disappears into the experience,” it’s hard to credit Ive’s suggestion that people are misusing it by using it immersively. If “constant use” is a misuse of the iPhone, then the device has been designed for misuse. And the future we’re supposed to welcome will be one in which the smartphone becomes all the more encompassing, the line between gadget and experience blurring further.

If Ive is sincere in his belief that people should be more deliberate in their use of smartphones — and I believe he is — I’m sure he could find elegant ways to nudge people in that direction. One obvious possibility is to change the way the iPhone handles notifications. (I would guess Ive didn’t foresee how app makers, including Apple itself, would come to abuse the iPhone’s notification function, but I assume he would acknowledge that torrents of notifications push people to use the phone constantly.)

The iPhone does have a “Do Not Disturb” setting that turns off tactile and audio notification alerts (though it still allows notifications to appear on the home screen), but that setting is turned off by default. To put it a different way, the iPhone’s default setting is “Disturb.” That could be reversed in the next iOS update. The default setting could be changed so that all notifications are turned off, requiring the user to make a conscious choice to turn on notifications, preferably app by app. And when the user turns on notifications, a notice might appear warning of the dangers in overusing the device.

If Apple took steps to discourage the “constant use” of its most popular product, might that not put a small dent in the company’s profits? Probably so, but let me leave you with one other thing Ive said in the interview:

Ive: Steve [Jobs] was very clear that the goal of Apple was not to make money. And we were very, very disciplined and very clear about how we configured our goals.

Image: Apple.

Apples and atoms

The long conversation in the New York Review between Riccardo Manzotti and Tim Parks is bearing fruit:

Manzotti: The view that only the smallest constituents, atoms, are “real” is called smallism in science, or nihilism in philosophy, and it clashes with everyday experience and common sense in the most blatant way. As Democritus suggests, it’s self-defeating because it is conducted only with the aid of the senses, which it claims have no reality. The world we live in is a world of objects. Apples exist, too!

Parks: But an apple is made of atoms.

Manzotti: To be made of something is not the same as to be identical with it. … We live in a time when scientists seem to like nothing better than to expose our everyday view of reality as delusional. They say, “You see the color red, but in fact, out there are only atoms; there are no colors. You hear music, but out there, there are no sounds,” etc. This gives them the authority to describe an entirely different reality, in which deciding between chocolate or strawberry ice cream, say, is nothing more than a matter of warring cohorts of neurons transferring their electrical charges and chemical processes this way and that, while outside your brain there is only a flavorless world of atomic particles. It’s a vision that denies not only our existence — as people choosing between ice-cream flavors — but also the existence of the things we experience: the banana sundae, a new car, paintings, planets, smells, seas. All these macroscopic objects cease to be real. They are all merely subjective. Merely the product of your brain.

Parks: But what if that’s the truth of the matter?

Manzotti: It is not the truth. It is a profound misunderstanding. The notion that objects exist relative to each other, brought into existence by each other, does not clash with any scientific finding or demonstrated result. Only with smallism, which, again, is an idea, a theory, not a scientific finding. There are atoms, but there are also macroscopic objects, and the key to understanding why both categories exist and are equally real is that they exist relative to different things.

Image: Michele Dorsey Walfred.