Finally, we've got the CEC version of the car racing competition up and running. Feel free to participate! Indeed, please participate! We're very eager to have as many participants as possible, using as different approaches as possible to how to develop their controllers. It's OK if you don't win - at least, it's OK for me...
I quote from the mail I just sent out to the CIG mailing last:
The competition is an incrementally evolved version of the competition
run for the Computational Intelligence and Games Symposium in April.
If you participated in that competition, you will be able to adapt
your submission to the new format with minimum effort. Even if you
have never heard of the competition before, the software is designed
to be as easy as possible to get started with.
Some main changes when compared to the CIG version of the conference are:
* A prize of 500 US Dollars is awarded to the winner. This is subject
to the winner being a registered attendant at CEC, and to at least 5
of the competitors registering for CEC.
* The software package and API have been extended to better
accommodate value function based control, and the software comes
complete with examples of temporal difference learners and genetic
programming controllers as well as various types of neural networks
and evolutionary algorithms.
* The submission format has changed in order to make sure that any
competitor (as well as the organizers) can easily download and run any
other competitor's submission.
Apart from that, various bug fixes have been made, and the competition
score method has changed slightly.
Wednesday, July 18, 2007
Tuesday, July 17, 2007
Me, Myself, I, etc.
It's now three weeks since I handed in my PhD thesis. I'm still trying to find out how to wind down; I don't think I've ever been as exhausted as right after handing it in.
The title of the thesis is "Optimization, Imitation and Innovation: Computational Intelligence and Games". It contains the experimental sections of most of the papers I've published so far (I had to omit the Sudoku ones to keep the thesis focused, and also to keep the length down - it is already quite a massive heap of paper). It also contains a number of background chapters situating my research in the context of evolutionary robotics and of game AI, and trying to define some sort of taxonomy of apporaches to computational intelligence and games.
I will of course make it available for download from my home page, but not until I've finished my corrections, which will be issued when I've had my viva, which I really hope will take place in early September. Oh yes, and I need to pass the viva as well. Fingers crossed. In the meantime, if you're interested in a copy of the uncorrected version, just mail me.
Assuming I pass my viva, I will then start my new job as a posdoctoral researcher at IDSIA in Lugano, Switzerland, in November. There, I will be working with Juergen Schmidhuber, who is quite famous for his work on reinforcement learning and recurrent neural networks. The place is full of other intelligent people doing great research as well, such as Faustino Gomez doing very interesting work on neuroevolution. That I'm excited about this goes without saying.
The title of the thesis is "Optimization, Imitation and Innovation: Computational Intelligence and Games". It contains the experimental sections of most of the papers I've published so far (I had to omit the Sudoku ones to keep the thesis focused, and also to keep the length down - it is already quite a massive heap of paper). It also contains a number of background chapters situating my research in the context of evolutionary robotics and of game AI, and trying to define some sort of taxonomy of apporaches to computational intelligence and games.
I will of course make it available for download from my home page, but not until I've finished my corrections, which will be issued when I've had my viva, which I really hope will take place in early September. Oh yes, and I need to pass the viva as well. Fingers crossed. In the meantime, if you're interested in a copy of the uncorrected version, just mail me.
Assuming I pass my viva, I will then start my new job as a posdoctoral researcher at IDSIA in Lugano, Switzerland, in November. There, I will be working with Juergen Schmidhuber, who is quite famous for his work on reinforcement learning and recurrent neural networks. The place is full of other intelligent people doing great research as well, such as Faustino Gomez doing very interesting work on neuroevolution. That I'm excited about this goes without saying.
GECCO 2007 conference report
A little late, but I figured I should write something about GECCO, even though so many others have.
I was first author on one paper, which I also presented, and second author on two other papers and a poster, so the conference was quite busy for me. Literally. There was a lot of walking through long corridors, and running back through the same corridors after figuring out a wrong turn had been taken somewhere. Let this be my one comment on the organisation of this year's GECCO: UCL is not a good conference venue. Sure, it's in London, and London is one of the world's capitals and very easily accessible through cheap flights and all that, but UCL is the sort of ancient labyrinth where you would expect to bump into a minotaur at any time. Or at least some trolls, or Jeremy Bentham. There was not a single room where all of the conference attendees could fit at once, severely limiting the potential for these all-important random encounters with other researchers, and some of the talk venues seemed to be ten minutes on foot from each other - if you could find them.
I can safely say that the recent SSCI in Hawaii and CEC in Vancouver were better in at least these respects.
But on to the important question: were the papers any good? Better or worse than CEC?
I don't know if I can, and want to, answer that question. As it is physically impossible to see more than perhaps a fifth of the papers, and I didn't even see that many, it's a bit preposterous to have a firm opinion on that. Also, it is a well-known but seldom-talked-loudly-about fact that there is a certain unhealthy animosity between CEC and GECCO, and I don't want to isolate myself from any of these communities. I suppose it's fair to say that the quality is at least comparable but with the conferences having slightly different focus, with somewhat more of e.g. GP and EDA on GECCO, and somewhat more of the stuff I'm most interested in (e.g. games, robotics, neural nets) on CEC.
Then again, one could make the argument that both of these conferences have their entry barriers set a bit too low. That's why I like the GECCO's approach to not treat poster presentations as full papers, in order to enforce more of a separation between contributions of different quality, but I would rather see that the oral acceptance rate was lowered a bit, so that some of the less original studies that were now presented as full papers were accepted as posters instead. Just my 2p.
Oddly enough, I don't know which papers won the best paper awards. They were presented in a session so early in the morning that no-one could reasonably be expected to attend, and the actual awards (as opposed to the nominations) are not to be found on the GECCO homepage. No-one seems to have blogged about it, either. My own picks for two of the tracks would be the paper on HyperNEAT by David D'Ambrosio and Ken Stanley, and the paper on learning noise by Michael Schmidt and Hod Lipson; the first because it is a really cool new idea which might initiate a new paradigm in developmental systems (in addition to the cell chemistry and graph rewriting paradigms), and the second as the general idea might prove to be very useful for modelling the dynamics of physical robotic systems, something I've become rather intereseted in myself recently. As for the other tracks, I didn't see all the best paper nominees, so I don't really have an informed opinion.
Does anyone of you actually know which papers won the awards?
I was first author on one paper, which I also presented, and second author on two other papers and a poster, so the conference was quite busy for me. Literally. There was a lot of walking through long corridors, and running back through the same corridors after figuring out a wrong turn had been taken somewhere. Let this be my one comment on the organisation of this year's GECCO: UCL is not a good conference venue. Sure, it's in London, and London is one of the world's capitals and very easily accessible through cheap flights and all that, but UCL is the sort of ancient labyrinth where you would expect to bump into a minotaur at any time. Or at least some trolls, or Jeremy Bentham. There was not a single room where all of the conference attendees could fit at once, severely limiting the potential for these all-important random encounters with other researchers, and some of the talk venues seemed to be ten minutes on foot from each other - if you could find them.
I can safely say that the recent SSCI in Hawaii and CEC in Vancouver were better in at least these respects.
But on to the important question: were the papers any good? Better or worse than CEC?
I don't know if I can, and want to, answer that question. As it is physically impossible to see more than perhaps a fifth of the papers, and I didn't even see that many, it's a bit preposterous to have a firm opinion on that. Also, it is a well-known but seldom-talked-loudly-about fact that there is a certain unhealthy animosity between CEC and GECCO, and I don't want to isolate myself from any of these communities. I suppose it's fair to say that the quality is at least comparable but with the conferences having slightly different focus, with somewhat more of e.g. GP and EDA on GECCO, and somewhat more of the stuff I'm most interested in (e.g. games, robotics, neural nets) on CEC.
Then again, one could make the argument that both of these conferences have their entry barriers set a bit too low. That's why I like the GECCO's approach to not treat poster presentations as full papers, in order to enforce more of a separation between contributions of different quality, but I would rather see that the oral acceptance rate was lowered a bit, so that some of the less original studies that were now presented as full papers were accepted as posters instead. Just my 2p.
Oddly enough, I don't know which papers won the best paper awards. They were presented in a session so early in the morning that no-one could reasonably be expected to attend, and the actual awards (as opposed to the nominations) are not to be found on the GECCO homepage. No-one seems to have blogged about it, either. My own picks for two of the tracks would be the paper on HyperNEAT by David D'Ambrosio and Ken Stanley, and the paper on learning noise by Michael Schmidt and Hod Lipson; the first because it is a really cool new idea which might initiate a new paradigm in developmental systems (in addition to the cell chemistry and graph rewriting paradigms), and the second as the general idea might prove to be very useful for modelling the dynamics of physical robotic systems, something I've become rather intereseted in myself recently. As for the other tracks, I didn't see all the best paper nominees, so I don't really have an informed opinion.
Does anyone of you actually know which papers won the awards?
Wednesday, June 27, 2007
The problem with the iPlayer
So the BBC is going ahead with making much of their content available online - through a system crippled by Microsoft's DRM. The reason they give is that "the right's holders - the people that make the programmes, from Ricky Gervais to the independent producers that account for up to a third of our programming - simply wouldn't have given us the rights to their programmes unless we could demonstrate very robust digital rights management."
Alright. But what about the programs that the BBC produce themselves? Shouldn't they by default be exempt from DRM? As for the independent producers, the BBC by merit of its size should be in such a bargaining position that they could force them to accept DRM-free distribution. But apparently the corporation hasn't got enough spine for that. Sad.
DRM is fundamentally at odds with the spirit of public service. Who is going to stand up against DRM if not the public service media corporations? And what's the point in public service at all if it bows to commercial media's ideas about DRM?
Alright. But what about the programs that the BBC produce themselves? Shouldn't they by default be exempt from DRM? As for the independent producers, the BBC by merit of its size should be in such a bargaining position that they could force them to accept DRM-free distribution. But apparently the corporation hasn't got enough spine for that. Sad.
DRM is fundamentally at odds with the spirit of public service. Who is going to stand up against DRM if not the public service media corporations? And what's the point in public service at all if it bows to commercial media's ideas about DRM?
Wednesday, June 06, 2007
Where is Julian?
Is he nowhere to be seen? That is only because he is writing up his thesis. He's been hiding in Ekerö, Sweden for quite a while now, where everything is quiet, idyllic and there is nothing to disturb his thesis writing. See for yourselves how idyllic it is:

But now he's back in England! Rumours have it that he's trying to get the thesis ready for submission in two weeks time. Lots of work, then. Probably not much time for blog posting until that's done.

But now he's back in England! Rumours have it that he's trying to get the thesis ready for submission in two weeks time. Lots of work, then. Probably not much time for blog posting until that's done.
Tuesday, May 01, 2007
Thursday, April 19, 2007
Grand and Molyneux on game AI
The Guardian has an article containing short interviews with Peter Molyneux and Steve Grand, two people who have managed to put out commercial games (in one case arguably commercially successful as well) containing "real" AI. Interesting read. They're both essentially pushing the idea that as games get even prettier, the stupidity of current game "AI" will shine through more and more, and so the need for "real" AI will increase, not increase.
I say maybe. While Molyneux's games are a great source of inspiration it's possible that it and its likes will always constitute a niche market, and your average FPS, RTS or movie tie-in adventure will never benefit from a neural network or evolutionary algorithm. But I do hope that I'm wrong here.
Whichever the case, we can still use commercial games for academic research just the same, in order to help us understand natural and computational intelligence. And I think we should. Much more than today.
I say maybe. While Molyneux's games are a great source of inspiration it's possible that it and its likes will always constitute a niche market, and your average FPS, RTS or movie tie-in adventure will never benefit from a neural network or evolutionary algorithm. But I do hope that I'm wrong here.
Whichever the case, we can still use commercial games for academic research just the same, in order to help us understand natural and computational intelligence. And I think we should. Much more than today.
Tuesday, April 17, 2007
Back from Hawaii, back to reality...




Finally, my first "normal" day since coming back. That is, I plan to spend most of my day in the lab... reviewing some papers for CEC, answering some mails, and starting to write my thesis.
Yes, that's right. The plan is to start writing my PhD thesis. Today. So maybe it's not that normal a day after all. Further, according to the plan, I will hand in my thesis in June and have a viva in September. It's not impossible, I believe.
The IEEE Symposium Series on Computational Intelligence was a good event from a scientific perspective, and an excellent one from a networking perspective. I spent plenty of time drinking cocktails with Games and ALife people, discussing research ideas and completely unrelated stuff.
After the conference we spent a few more days in Hawaii, and me and Hugo went on to do some touristing in San Francisco. Fantastic city, indeed.
Sunday, April 15, 2007
CIG Car Racing Competition results
The winner of the CIG Car Racing Competition is Peter Burrow - congratulations, Pete! He used a modular controller based on two incrementally evolved neural networks, and the nearest competitor, Thomas Haferlach, also used a modular controller based on two neural networks, although CTRNNs rather than the more straightforward networks Pete used.
Aravind Gowrisankar and Matthew Simmerson submitted controllers based on NEAT (NeuroEvolution of Augmenting Topologies) and I submitted a simple hard-coded controller, an simple evolved neural network, as well as (together with Hugo Marques) a controller based on an evolved neural network for controlling the car together with a copy of the whole simulation environment for predicting which car will reach the current way point first. None of these approaches scored as well as the modular controllers of Pete and Tom, but with some more work they might well do.
As for where that work would be submitted, we are planning to run another car racing competition for CEC 2007. That would give contestants several more months (until September) to work on their controllers. We haven't currently decided on the exact details of that competition, but plan to finalise it before the end of April. So if you have any ideas on in what direction to take the competition (changing the interfaces? dynamics model? task? etc) please speak up now!
Aravind Gowrisankar and Matthew Simmerson submitted controllers based on NEAT (NeuroEvolution of Augmenting Topologies) and I submitted a simple hard-coded controller, an simple evolved neural network, as well as (together with Hugo Marques) a controller based on an evolved neural network for controlling the car together with a copy of the whole simulation environment for predicting which car will reach the current way point first. None of these approaches scored as well as the modular controllers of Pete and Tom, but with some more work they might well do.
As for where that work would be submitted, we are planning to run another car racing competition for CEC 2007. That would give contestants several more months (until September) to work on their controllers. We haven't currently decided on the exact details of that competition, but plan to finalise it before the end of April. So if you have any ideas on in what direction to take the competition (changing the interfaces? dynamics model? task? etc) please speak up now!
Saturday, March 31, 2007
In Hawaii
So now I'm in Hawaii, "preparing" for the IEEE Symposium Series which will start tomorrow. Preparing on the beach, that is.
There has been a lot of interest in the CIG Car Racing Competition after the recent media coverage. Unfortunately, the deadline is passed (the results will be presented on Thursday) but given the interest I will definitely look into some way of rerunning the competition, either by attaching it to another conference or making it into some form of permanent league.
Another "Ask Slashdot" of mine recently got on the frontpage - it's about the Most Impressive Game AI. Check it out. Unfortunately I don't know if I can contribute much to the discussion as there's no Internet on the beach. Or, at least, I'm not bringing a laptop to the beach.
There has been a lot of interest in the CIG Car Racing Competition after the recent media coverage. Unfortunately, the deadline is passed (the results will be presented on Thursday) but given the interest I will definitely look into some way of rerunning the competition, either by attaching it to another conference or making it into some form of permanent league.
Another "Ask Slashdot" of mine recently got on the frontpage - it's about the Most Impressive Game AI. Check it out. Unfortunately I don't know if I can contribute much to the discussion as there's no Internet on the beach. Or, at least, I'm not bringing a laptop to the beach.
Subscribe to:
Posts (Atom)