• Martin Thoma
  • Home
  • Categories
  • Tags
  • Archives
  • Support me

A.I. in Computer Games

Contents

  • Solved games
  • Computers win always
  • Unspecialized Game A.I.s
  • Super Mario A.I. Competition
  • DOTA: Dendi vs. OpenAI

Artificial Intelligences (A.I.s) are computer programs that are able to adjust their behaviour according to data they see. So A.I.s are able to adjust to the data a human player generates.

Game A.I.s
Game A.I.s

Solved games

There is a number of games which are definitely solved. That means the A.I. plays perfectly:

  • Tic-Tac-Toe
  • Connect Four: A Knowledge-based Approach of Connect-Four. Amsterdam, 1988. Victor Allis.
  • Checkers:

See also: Solved Game

Computers win always

A second category are games in which A.I.s always win against human players, but they don't have a perfect strategy. Or at least we have not proven that they have a perfect strategy:

  • Chess
  • Go on a 5×5 board
  • Reversi on a 4×4 board

Update: There are advances on the 19×19 field:

  • Paper
  • Nature: Mastering the game of Go with deep neural networks and tree search
  • YouTube by nature: The computer that mastered Go
  • Google Blog: AlphaGo: using machine learning to master the ancient game of Go

Unspecialized Game A.I.s

The following video is an explanation and demo of software Tom Murphy VII wrote that learns how to play a Nintendo Entertainment System game and then automatically plays it. It's called "learnfun" (for learn function).

You might want to skip to 6:13 for the demo:

Interesting parts:

  • 09:46 - Ridiculous Super Mario move
  • 14:20 - Super packman move
  • 15:57 - Tetris: The best move is not to play

Research paper published in SIGBOVIK 2013: "The first level of Super Mario Bros. is easy with lexicographic ordering a and time travel ...after that it gets a little tricky."

There is a follow-up video with Zelda, Punch-Out, Dr. Mario (10:27), Contra (12:10), Wall Street Kid (14:30) and Russian Attack (18:10):

Interesting parts:

  • 10:25 - Exploiting a Random number generator in Dr. Mario
  • 18:15 - Russian Attack: Finding a save spot
  • 20:58 - Russian Attack: Fight fast

And a third episode with Super Mario, Gradius (4:06), Mega Man 2 (8:30), Pro Wrestling, Color a Dinosaur, Nintendo Pinball (13:40), Cliffhanger (15:20), Arkanoid (16:33), Double Dare (19:22), Ice hockey (21:44):

Interesting parts:

  • 04:45: Playing Gradius like a YoLo-Pro
  • 05:42: Gradius - Insta-Kill the Boss
  • 10:04: Mega Man 2 - Manipulate the random number generator
  • 16:33: Arkanoid (Break Out) - Manipulate the random number generator

Super Mario A.I. Competition

DOTA: Dendi vs. OpenAI

Published

Jul 1, 2014
by Martin Thoma

Category

Machine Learning

Tags

  • AI 13
  • games 4
  • Machine Learning 81

Contact

  • Martin Thoma - A blog about Code, the Web and Cyberculture
  • E-mail subscription
  • RSS-Feed
  • Privacy/Datenschutzerklärung
  • Impressum
  • Powered by Pelican. Theme: Elegant by Talha Mansoor