Monday, June 08, 2009

.

Computers in movies and television

In 2007, I had a series in these pages about technology in Star Trek. I remembered that series the other day, when I read an article in New Scientist about the science in Battlestar Galactica.[1]

The New Scientist article focuses on human physiology and psychology, and on gravity and g-forces. It doesn’t look at power, speed, computers, astronomical issues, or any of a number of other things that would have been fun to see covered. Oh, well.

But it made me think to come back to the idea of how technology is portrayed — in particular, how computers had been and are depicted in movies and television.

Star Trek, of course, and other futuristic stories, such as 2001: A Space Odyssey (which, at the time the movie was made,[2] was still set more than 30 years in the future), sported talking computers that showed varying degrees of intelligence. The Enterprise’s computer mostly responded to spoken commands and queries, but other computers in the Star Trek universe were semi-sentient to the point of being able to be confused or tricked, an angle that was central to the plot of more than one episode. And 2001’s HAL-9000, well... we all know what happened there, whether or not we understood what was happening.

But cinematic views of contemporary computers have always been somewhat odd, usually aimed at being obvious or flashy. In the old days, they always consisted of banks and banks of tape drives and flashing lights, long after real computers had few or none of those. As personal computers came around and more people had more realistic images of computers — boxes on their desks, rather than mysterious roomfuls of equipment — the tape-drives-and-lights depiction had to change.

Now, computers look like what we’re used to seeing, but what they can do seems just about unlimited. The stuff that’s comical now has to do with those limitless capabilities and the silly user interfaces.

Computers on television can search for anything, find anything, display anything. They can zoom in on the minutest details, rotate images in three dimensions to show any perspective, and go through millions or billions of data records or documents in no time at all. They understand commands or queries in human language, just as the Star Trek computer did, except we have to type the instructions, not speak them.

The interesting thing about that last bit is that it’s actually backward from what the real technology can do: we’re much better at having a computer turn the spoken language into the right words than we are at having the computer understand what those words and sentences mean. My former colleagues at IBM’s Watson Research Center have long had the ViaVoice products working quite well, but they’ve only recently begun a “grand challenge” project to get a computer to understand human-language questions well enough to play Jeopardy! competitively.

We often see police investigators zooming in on low-quality surveillance videos and “enhancing” a cropped portion in order to identify a face, read a sign or a car’s license plate, or the like. A certain amount of computer-enhancement can, indeed, be done, and technology for image processing is getting better all the time. That said, for the most part what they’re doing is ridiculous. Image data can only be extrapolated to a point, and the reality is that information that isn’t there can’t be created out of nothing. A low-resolution image can’t magically become high-resolution with the aid of a computer, and if you zoom in on a 30-pixel-square portion of a grainy, one-megapixel security-camera image, you will never, with any computer, get a clear image of the suspect’s face.

The same goes for the 3-D rotation: such manipulation is possible, and it’s done all the time when the 3-D data are available. But a two-dimensional source does not have that information, and, beyond approximation and guesswork, such an image can’t be rotated to show a side view.

When was the last time you did a search on your computer and wound up with a large blinking, beeping box in the middle of the screen, saying, “NO MATCH FOUND”? A pop-up box with an “OK” button on it, maybe, but we just don’t have them blink and beep repeatedly.

The other thing we don’t have them do is display the thing to be searched for — often a face or a fingerprint — on the left side of the screen, while rapidly flashing all the unmatched images we’re searching through on the right side. That may look cool on TV (which is why they do it), but in reality it would slow the search down so much that it’d be entirely useless. No one would ever design a real search program that did that.

Finally, in the movies people always seem able to go up to any computer, start any program, and use it expertly. They can even do this with special-purpose computers, not just ones that run Windows or Unix or MacOS. To address the most ridiculous case that comes to my mind: it would simply not be possible to connect your laptop to a space-alien’s computer and upload a computer virus that would take out the computer system and defeat the aliens.

Suspension of disbelief has its limits.
 


[1] The recent, well-received series, of course, with Edward James Olmos, not the horrible, short-lived one from the late ’70s, with Lorne Greene.

[2] And, for the record, the book came from the movie’s screenplay, not the other way around.

8 comments:

Thomas J. Brown said...

That scene from Independence Day completely lost me. I was willing to let them know how to fly the alien ship, but upload a virus into its operating system? Please.

Michelle said...

You mean you can't feed a computer with photos of people (eg Einstein, David Lee Roth and Kelly le Brock) and have it create, for instance, a highly intelligent, cool, funny supermodel who really wants to hang out with you... I mean.. in the 80s this seemed like a distinct possibility...

Michelle said...

Oh and a computer that can make tea would impress me. I'm going to be quiet now.

Frisky070802 said...

I too have been troubled by the flashing images when searching a database. If they were showing the "close but no cigar" pictures I could see it, but the random sampling is useless except as eye candy and I wish they'd stop.

JP Burke said...

Yes, it's really annoying when they get computers so wrong that it pulls you out of the story.

I believe there are algorithms that can do amazing things with zooming by reconstructing 3D objects from moving images, so that video surveillance image zoom may not be so far-fetched. Not the way they show it on screen, of course. They make it look like you're simply "enhancing" pixels that aren't there. But the concept of creating a detailed still from a grainy video is quite realistic.

Fingerprint matching gets some of the most amusing and annoying tech treatments.

Maggie said...

I believe Jeff Goldblum can write a virus for an alien operating system. Remember how smart he was in Jurassic Park? :-P

I remember in the Star Trek episode "Mirror, Mirror," Kirk has the computer record the process for getting them back to their universe onto a red square (disk?), and then he hands the red square to Scotty and says, "can you do it?"

Now how did Scotty know what was on that red square? That always bugged me.

And of course there's the "Hello Computer" scene in Star Trek IV, and then Scotty "typing" in the formula for transparent aluminum on the Mac, and all the images coming up, and the sounds it made... that one bugged me, too.

But it's definitely annoying when data is "enhanced" to include information that wasn't included with the original data. I wonder if people believe that. I once read that because of shows like CSI, criminals are more careful about not leaving cigarette butts, etc., at crime scenes. Not good.

Barry Leiba said...

Both sides: criminals are more careful, and jurors may be more demanding. Five years ago, NPR interviewed the head of the Las Vegas crime lab, and also talked with other at the lab. 8 minutes into the audio, listen to Tory Johnson, the firearms expert at the lab, say this:
«I also have concerns about the effect it has on potential jurors. People go in, having seen this, thinking that it’s based in truth, and then they see what really happens, and there’s not all these sort of magical tests, computers don’t put in a fingerprint and generate a picture of the defendant and his address and all that. And they’re somewhat disappointed, and it may even actually colour their evaluation of a case.»

NPR’s Robert Siegel adds:
«Several of the people at the Las Vegas crime lab voiced that very concern: that jurors might vote unreasonably to acquit just because real life doesn’t live up to expectations — expectations learned from Gil Grissom’s crime lab on television.»

Maggie said...

They should have "Gil Grissom" do a PSA that they show jurors about how his show is fiction. It would be more interesting than the one we watch here in MA!