Archive for the ‘Computer Science’ Category

On Politics and Intelligence

Friday, April 13th, 2007

We had a ’round table’ type discussion in my AI class today about the Turing Test and the feasibility of algorithms that can pass it. In particular, the discussion centered on the Chinese Room thought experiment. The “Turing Test” is a method proposed by Alan Turing (although he didn’t call it that) to tell whether or not a computer is intelligent. Basically, a human converses with the computer via an instant-messenger style interface for a half hour, and at the end of the half hour, the human has to be able to tell whether or not the computer actually was a computer or was a human being.

This guy Searle argued that even if a computer could pass the turing test, it still might not have any understanding. A computer follows a set of rules to take input and produce output. Suppose we designed a computer that could easily pass a turing test, provided that turing test was administered in chinese. When presented with sentences in chinese, the computer would follow its rulebook and respond with some more chinese. If a human being were to sit in a room and follow the same algorithm that the computer followed, he could be said to be “passing” the turing test for intelligence, even though he would have no understanding of chinese. Searle argued that his “Chinese Room” example means that passing a turing test doesn’t make a computer intelligent.

First, let me state my opinion that arguing about wither property p applies to object x is pointless unless you’re dealing with a formally defined system. Then, you can prove either way or perhaps prove that “p applies to x” is undecidable. Either way, the nature of the debate is pretty simple. When you deal with that messy place some folks call “meatspace,” however, the arguments just get ridiculous. Invariably somebody brings up what “webster” says is the case. Words mean slightly different things to everybody that uses them, and these arguments almost always boil down to what very abstract words mean to individuals, which is why I think it’s stupid to even argue about such things. Either you think p applies to x or you don’t; there is no right answer. I tried, then to answer in terms of my understanding of how must people define intelligence.

Suppose you ask a person “Alice” whether or not an agent “Bob” is exhibiting intelligence. By agent, I mean anything – person, computer, animal, or particle. In my experience, Alice will only say Bob is intelligent if Alice thinks that Bob makes decisions in a manner roughly isomorphic to the way she (Alice) makes decisions. In other words, most people will say that something that doesn’t think in the same manner that they do is not intelligent. An algorithm that uses brute force to make moves in a game of chess operates in a manner so different from most of us that we won’t label it as intelligent. If the algorithm has a way of evaluating the value of each move based upon one or two predicted moves, uses knowledge of the history of its oponent, and perhaps makes mistakes, more people would be willing to label it “intelligent.”

The World of Politics is full of examples. How many pundits decry those who dont share their opinions as stupid? I saw a magazine cover once, asking about the result of the 2004 election, saying “How can 59 Million people be so stupid?” The 59 Million number was supposed to be the number of people that voted for Bush. Unfortunately for the Daily Mirror, counting after the election increased the total number of votes for Bush to 62 Million and the number of votes for Kerry to 59 Million. Such are the dividends of arrogance, I suppose.

As for whether or not machines could ever posses intelligence, I think that if you want say that machines can’t ever posses intelligence, you must either conclude that humans don’t posses intelligence, or that humans are somehow magical. My reasoning is simple – if you believe in the laws of science, you believe that humans are made up of particles that follow rules. A computer could simulate a human being atom by atom using the same rules. Unless you think that humans are somehow “magic” in that they don’t follow the same rules as the rest of the universe, you’d have to conclude that a [sufficiently powerful] computer could do anything a human mind could do. As to whether this will ever be feasible, that’s an entirely different debate. My answer is a solid “maybe.”

On AI, the End of the World, and Small Town Wisdom

Monday, March 19th, 2007

I was watching a special on the history channel about 7 ways that scientists think the world could to end. The first two were not unreasonable – ‘gamma ray bursts’ occur when a star collapses, and if this happened in our galaxy, apparently the burst would destroy our ozone layer. Without that ozone layer, we’d be killed by solar radiation. The second way we could potentially meet our doom was a roaming black hole. If that thing came too close to the earth, we’d be done for. The physics sounded about right to me, although a few things were exagerated. If you fell into the event horizon of the black hole, you’d be dead before you were able to tell what was going on. I don’t think it’d be particularly painful, and the gruesome images they gave, although they might have been accurate, would have occurred so quickly that they’d be irrelevant.

The third way we could meet our doom, however, was completely ludicrous. They had some AI researches (as well as steven hawking) claiming that computers would become more intelligent than human beings, and that for some reason they’d decide to wipe us out. I think the entire field of AI is completely misnamed. Most of those guys would, I think, make lousy theoreticians. They spend their time dreaming up ’solutions’ to NP Complete problems that run in exponential time and have absolutely no guarantees. When they’re not doing that, it appears that they’re busy making absurd predictions and prognostications about the nature of intelligence and what computers will do for us. They even had Steven Hawking claiming that within 100 years, computers would be more intelligent than human beings.

First off, people have been predicting human-level intelligence from algorithms for years. I’m not saying it won’t happen, but I think we’ve got no way of knowing how far off in the future it will be. Personally, I don’t think we’ll have human level intelligence from computers untill we can simulate an entire brain on a cellular (or maybe even molecular) level. When and if humans do produce computers with human level (or greater) intelligence, the AI that is produced will be used to accomplish all kinds of trivial crap that human beings don’t want to do. The thought of an AI that would decide to destory the world, and have the capability to do such a thing, is absurd – the AI would have to want to destory the world, and the only reason it would want such things is if it were designed to want them.

If you designed an AI capable of talking with human beings to do things like answer phone calls, you’d make it so it would be happy if it satisfied customers, and unhappy if it didn’t satisfy the customer. Human beings have all kinds of tendencies that we’d never have any decent reason to incorporate into AI – boredom, tempers, and greed. I could go on an on about this, but basically i think it’s completely absurd to be afraid that computers will take over the world. If we ever develop computers that pass turing tests and can think like humans do, it’ll be a great day for humanity because we could eliminate the need for all kinds of thankless, unpleasant tasks.

In any event, the thing that struck me the most was the difference between a small town fireman in Iowa talking about how he’d respond to one of these distaters, and the big name scientists they had talking about how the world was going to end. The scientists seemed so sure of themselves and their own intellgience. The fireman and police captain in the small town said that, in the event that one of these disasters were to occur, perhaps the only thing they could do would be to pray. I dig that. I dont like arrogant people. I’m afraid I am becoming one, however. It’s something I’ll have to watch out for.

Uh Oh?

Wednesday, March 14th, 2007

I was doing research for my project on Procedural Content generation last night, and I wanted to contact the author of one of the papers I was reading. When I put his name into google, I found his “reasons for leaving the field of computer graphics research.” He listed what he thought were serious probelms in the field, including a sort of arrogance and obsession with a particular conference. Apparently, everybody in the graphics field wants to present their work at one conference, so the competition is brutal. I absolutely loved a lot of the papers I read, but I did notice that most of the papers written in the past 15 years were all from the SIGGRAPH Annual Meeting proceedings. I hope I’m not considering going into a field with serious problems.

I am In Love

Tuesday, March 13th, 2007

I completely love the field of computer science. I keep rediscovering this fact. Today, on the way home from work, I was pondering what it meant for a set to be recursively enumerable but not recursive. The trick of using many different turing machines, on a ‘time share’ basis, all working to verify members of your recursively enumerable set, is pretty sweet.

I spent most of this evening working on my senior research project, which is a study of ‘Procedural Content Generation.’ That’s the process of using mathematical rules and computer code to generate computer graphics, instead of having an artist draw it. The kind of work people are doing is absolutely amazing. The neat thing is that when someone wants to write an algorithm to draw realistic clouds, they get to go and study what clouds are, how they form, and how they move about. Some other algorithms that I was reading about are based upon biological models.

The fact that studying how spots form on leopards, how clouds form, and what kinds of problems we can efficiently solve are all considered part of the same glorious field makes me giddy. I can’t believe how lucky I am that I can study pretty much anything that interests me, and so long as I take a mathematical approach to the things I’m studying, I can put on my ‘computer scientist’ hat (and keep whatever job I eventually get as a computer scientist.)

If you have access to the ACM digital library (If you’re a college student, most likely you can visit it through your library’s website), you simply must read the paper “A Simple, Efficient Method for Realistic Animation of Clouds.” Heck, don’t even bother reading it – just look at the pictures on the last page. They’re amazing.

I Love Designing Algorithms

Tuesday, February 27th, 2007

I am working on a sweet geometrical algorithm for my senior project. It is very cool. It is also top secret. Details to be revealed later…

Grad School Update

Tuesday, February 27th, 2007

For those keeping track at home, I received a Rejection letter today from Carnegie Mellon, and an acceptance letter from UNC Chapel Hill. I had expected to be admitted to UNC, so although it was still pleasant, it was not exactly a surprise. I didn’t expect to get into CMU because they’re ridiculously selective, but I still had hopes.  The rejection letter was like a kick to the gut. It was all I could do to finish the bug I was fixing at work without breaking down at my desk.

Rejection’s tough. I’ve never really had to deal with it before.

A New Record

Friday, February 23rd, 2007

After messing with linux for maybe 3 hours, I’m back with windows.

I wanted to get some mp3’s playing so I could listen to music while I set up my new computer. Fat chance of getting mp3 support in a standard linux distro. You have to enabled some ‘other repositories’ or something. After spending a half hour reading ubuntu support forums and becoming more irritated with my lack of knowledge I decided to go back to Winodws. I’ll be using cygwin a lot more than I was before, but I already know how to get everything working just the way i like with windows. Even if it took me a week to get to that level of comfort with unix, i don’t think it’s worth at this point. I plan to buy a mac anyways, at which point I’ll turn this machine into a linux server and it won’t matter if i can’t listen to music or do whatever on that box, because I’ll be doing all of that on my mac anyhow.

The whole process of trying to get linux working reinforces my belief that linux on the desktop is going nowhere fast. I’m a computer savy guy. I really know my way around a windows system, and I’m somewhat familiar with UNIX based systems. Nevertheless, I’ve neither the time nor the patience to learn to work linux and get it set up. I understand the merits of open source software, and I really like using the command line to get my way around. I really like the idea of geting a linux system set up, but every time I’ve tried, I’ve found the whole process one big frustrating pain in the ass. If they can’t get me to switch over, how the heck are they gonna convince joe schmoe computer user?

When you spend a half hour and can’t get something as simple as mp3 playback working, you know there’s something wrong with the system. Could I stand to be more patient? Of course. I just don’t have a week to spend fiddling with my computer, getting it ‘just right’, when I’ve already got it that way in Windows.

Linux: Not for Beginners

Friday, February 23rd, 2007

I am setting my machine up to use linux. This is maybe the third or fourth time I’ve gotten irritated with windows and decided to switch over to the ’superior’ operating system. Every time I have done this, I’ve found myself thinking ‘thank god I know what I’m doing, because otherwise I’d be screwed.’ I have no idea how these people expect this system to become at all popular when something as simple as changing the resolution on your monitor requires to disable the windowing system type in a bunch of cryptic command line arguments.

Hopefully, once I get this working, I’ll be happy with it.

Use appropriate terminology people!

Monday, February 19th, 2007

Why do they call them ‘regular expressions’ when they can be used to test for languages which are not regular, or even context free?  </grumble>

On Knowledge, History, and Experts

Monday, February 19th, 2007

My housemates and I got into an argument about global warming friday night. This is not an infreqeunt occurence at 3739 Regent Avenue; we are an interesting mix.

I forget how the subject was brought up, but the argument started when Tim said “I know the earth is getting warmer, but I don’t know whether humans are to blame.” I asked him how he knew it was getting warmer, and he said that a majority of climate scientists would say it was getting warmer.

My argument was that Tim had never talked to a climate scientist or read one of their papers; he had only (to the best of my knowledge, anyhow) heard summaries of papers, as reported by members of the press. I contended the only way you could really know that the earth was getting warmer would be to conduct the experiments yourself, or read a paper written by someone who had conducted the experiments, verifying that their methodology was correct.

Kevin told me he found this line of thinking arrogant; he said that he recognized expertise and that if a majority of climate scientists felt the earth was getting warmer and that humans were to blame, most likely they were correct. I responded that majority has no place in true science, that scientists are frequently wrong, and there have been many times in the history of scientific development when the ‘community consensus’ was used to stifle ideas originally considered far-fetched that turned out to be correct.

I wrote about this almost example a year ago, in the case of Marconi. At that time, I took kevin’s viewpoint – Marconi ignored conventional scientific wisdom and, as I saw it, got lucky when that wisdom turned out to be incorrect. I defended the scientists who told Marconi he was a fool for trying to send radio signals across the atlantic.

I think very differently now. My reasoning is this: Marconi’s detractors told him he couldn’t send signals across the atlantic because the curvature of the earth would prevent the signals from crossing the atlantic. They made a prediction – It is not possible to send radio waves distances that are on the order of the radius of the earth – based upon a mathematical model of the universe.

Where’d this model come from? Mathematical characterizations of past observations. A bunch of people saw a bunch of different stuff, and over the course of human history, the more mathematically inclined observers devised a framework that categorized past observations.

We use that framework to make predictions about our future, but in doing so we make an assumption: things will happen in the future in the same way that they’ve happened in the past. If we say it is impossible for event X to occur, what we are saying, ultimately, is ‘X has never happened in the past, and things that did not happen in the past will not happen in the future, therefore, X will not happen in the future.’

Is that line of thinking logical? It’s consistent with a set of axioms, so yes. Does the set of axioms make sense? Yes, but only if you’re careful about generalizing your framework. That’s been the goal of science – to build a framework as general as possible. A good example of this is the struggle to develop a unified theory of physics that fixes the discrepancies between quantum mechanics and general relativity. We’d rather not have two sets of rules describing how things work, one for small scales and one for large scales.

If your framework is too specific, however, you can look really foolish. For example: I have never been to France. Things that did not happen in the past will not happen in the future. Therefore, I will never go to France. You’d be laughed at if you tried to make this argument seriously. Yet it’s really the same argument scientists make when they say you can’t build a perpetual motion machine: Nobody’s ever been able to produce energy for free before. Things that did not happen in the past will not happen in the future. Therefore, nobody will ever be able to produce energy for free.

As I see it, physics is really a mathematical study of our history, coupled with the assumption that there is a simple framework that can describe everythng we will experience in the universe, and that by mathmatically characterizing past events, we can accurately predict future events. For this reason, i’m more interested in math and (especially) computer science. I think the best way to understand our universe is to study those generalizations we’re creating, so we can understand their limitations.

When you get right down to it, i feel like there’s no reasonable way you can argue that something isn’t possible. All you can do is say “We’ve never encountered that before.”

As to our discussion on global warming, the Marconi example is particularly suitable for my argument. Marconi was able to send his radio waves becuase of the ionosphere, a layer of the atmosphere that refelects radio waves. The scientists of his day didn’t understand the atmosphere like they thought they did, and were therefore incorrect to tell him he couldn’t send radio signals across the atlantic. My argument to my housemates was twofold, which is probably why I didn’t make much sense to them. The first, less interesting argument, was that you shouldn’t talk about scientific subjects unless you’ve read the literature and understand it and can make the arguments yourself. I’m not sure how common this viewpoint is, and I’m not really even sure if it’s mine, because I trust ‘experts’ all the time.

The second, more interesting argument was “Knowing scientists have been wrong in the past, particularly on the issue of the environment, what makes you so sure they’re not wrong now?”

When I realized where our argument was going I decided to just give up and go to bed. I recognize I can be a crank when it comes to my scientific ideas, and there were people over who had no interest in the discussion.

What do you think?