CG:SKEELOGY
CG:SKEELOGY
CATEGORIES
   REELS
       + demo reels (2)
   PROJECTS
       + games (4)
       + VFX & animations (4)
   PROGRAMMING
       + simulations (8)
       + computer vision (4)
       + rigging & deformation (4)
       + computer graphics (3)
       + artificial intelligence (2)
       + game technologies (2)
   CG
       + rigs (7)
       + models (7)
       + effects & simulations (3)
   TUTORIALS
       + physics simulation (1)
   ME
       + honours & awards (8)
       + events (7)
       + updates (3)
FEATURED PROJECTS
Soft Body Tutorial: Program soft bodies in XNA!
Cloud Guardian: Shape the Orb to fix clouds!
Muskeelar: Muscle system for games
LATEST UPDATES
  + Now On Twitter   + CG:Skeelogy v1.1: The Web 2.0 Version   + Best Physics Knowledge Base Entry In Intel Havok Physics Contest!   + Community Voting Prize In Intel Havok Physics Contest   + Working at Double Negative in London
TAGS
ARCHIVES
 
 
 
CURRENTLY VIEWING
TRAINING NEURAL NETWORKS
Neural network used to show how decision making of computer agents can be learnt from sample data
DATE
TYPE
EFFORT
Oct 2006
Neural Networks
Solo
Training Neural Networks
@ programming > artificial intelligence
SECTION MENU
     + Training Neural Networks
     + Hierarchical A* Pathfinding

A neural network was used in this demo to show how decision making of computer agents can be learnt with sample data.

First, the sampling of data has to be done. The user will control the behaviour of an enemy robot, while the supposed player robot is controlled by the computer. When the supposed player robot moves around and attacks, your intelligent response as the “enemy robot” will be sampled by the A.I. system and fed into the neural network for training.

Once the sampling is done, the actual game is executed. The enemy robots will react according to the attacks of the player. The quality of their reactions is based on the quality of the training data. I did manage to get quite a good training data.

Below is a video that shows the actual game in action, after training.


Video showing how the enemy robots react to the player’s actions using neural networks only. No if-statements are used.

Notice these things about the trained robots in the video:

  1. They approach me when I’m near and stop to attack when they are in shooting distance. They approach me again when I back away.
  2. Once their HP is low, they know that they should flee instead of trying to attack again.
  3. Although they have started to flee, they try to attack me again when I’m not facing them. Once I point the cursor at them, they know that they should flee, even though I haven’t even started shooting. This implies that they are especially good at back attacks.

All the responses to different situations are handled solely by a single neural network without any if-statements. Note that the zig-zag fleeing manner is procedural and not done by the neural networks.

Note: Scene setup done by Goh Cheng Teng. Neural Networks provided by Andre Tong.

  • Share/Save/Bookmark
Tags: , ,

Related posts


Leave a comment:


Allows tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

 
CG:SKEELOGY
ABOUT ME
I have experience with physics simulation programming, character rigging and R&D on anatomical and deformable models. In my free time, I work on small personal projects such as casual games and tools development.
I am currently working at Double Negative Visual Effects in London.
MY OTHER SITES
SUBSCRIBE TO SITE
SHARE THIS SITE
Copyright © 2003-2010.
All works are original ones by Skeel, unless otherwise stated.