Computer teaches itself to play Civilization II
By Julian Benson
Posted on 13 Jul 2011 at 16:57
MIT researchers have developed software that they claim has taught itself to play Civilization II - and to win most of the time, too.
In a recently published paper, the team explained how the software starts from nothing and learns to play by reading the manual, winning 80% of the time.
Beginning with a blank memory, and only able to move and click the mouse, the computer analyses the game screen. It picks out words such as "river" and "road", to search through the game manual.
Lead developer Regina Barzilay said they used the game's manual rather than a strategy guide because it gave the player "very general" advice, leaving a player to “figure out a lot of other things on [their] own”.
Finding the relevant search terms in the manual, the program then runs the paragraph through a sentence analysis algorithm, which it uses to form instructions.
With these instructions, the program can then form strategies. “Because of [a game's] complexity you need a technique that can handle very complex scenarios that react in potentially random ways,” said developer S.R.K. Branavan.
The researchers used the Monte-Carlo method, normally used for analysing financial simulations. It allows the developers' program to take a point in the game and test many possible responses. Keeping an eye on the game's score, it remembers which was the most beneficial decision and stores it in a database.
The amount of data stored by the system quickly becomes mind boggling. At every turn of its 200 games the computer would perform 500 possible actions, and “each roll-out is run for 20 simulated game steps before halting the simulation and evaluating the outcome,” the researchers said. Each of those 200 games are played for at least 100 turns, for a total of 200 million Civilization turns.
Is your business a social business? For helpful info and tips visit our hub.
That's a nice picture of Civilization V! ;)
By lkipper on 13 Jul 2011
I'm guessing you are the "work experience guy" who occasionally gets to speak on the podcast?
If so, congratulations on a very professional first article!
By JohnAHind on 14 Jul 2011
- Windows 8.2: release date, features and free cloud version
- iPad sales stall as owners "too happy to upgrade"
- iPhone 6 release date, rumours, specs and features: when will the iPhone 6 come out in the UK?
- Killing the Surface Mini hit revenues, Microsoft reveals
- Amazon posts another loss - its biggest since 2012
- How Google Glass ruined my lunch hour
- Smartphone battery packs: can a USB power pack beat the festival battery blues?
- Windows Easy Transfer – not so "easy" in Windows 8.1
- Formula 1: what a difference virtualisation makes
- Office of the future: comfy chairs and tablets everywhere
- I went to Glastonbury and the only thing that got high was my smartphone
- Meet the robots helping teach children
- PaperLater: would you pay to print the internet?
- Amazon vs Kobo: how much to make the ebook switch?
- Phishing emails: how I nearly got caught out
- How to add in-app purchasing to an iPhone, Android or Windows app
- Remote-control ransomware: TeamViewer and software hardball
- Why laptops with serial ports matter to the Internet of Things
- Make your mobile battery last longer
- Small steps into handling Big Data
- Nexus 5: does it really run stock Android?
- How to get broadband to a garden office
- How to write your company's IT security policy
- Raspberry Pi and Wolfram: a must-have for every child
- Could you get by with Office Web Apps?