CG:SKEELOGY
CG:SKEELOGY
CATEGORIES
   VFX / CG
       + effects & simulations (7)
       + models (6)
       + rigs (7)
   PHOTOGRAPHY
       + film/lens effects (3)
       + HDR (2)
       + lomo (1)
       + macro (2)
       + panorama (3)
       + pinhole (1)
       + stereo (3)
   PROGRAMMING
       + artificial intelligence (2)
       + computer graphics (3)
       + computer vision (4)
       + game technologies (2)
       + rigging & deformation (4)
       + simulations (8)
   PROJECTS
       + games (4)
       + VFX & animations (4)
   REELS
       + demo reels (4)
   TUTORIALS
       + physics simulation (1)
   ME
       + events (7)
       + honours & awards (8)
       + movie credits (6)
       + updates (3)
FEATURED PROJECTS
Soft Body Tutorial: Program soft bodies in XNA!
Cloud Guardian: Shape the Orb to fix clouds!
Muskeelar: Muscle system for games
LATEST UPDATES
  + Showreel 2011   + Shape Matching in Houdini   + Melt SOP using VOP/VEX   + FX Reel 2011   + Burning Poster
TAGS
ARCHIVES
 
 
 
CURRENTLY VIEWING
TRAINING NEURAL NETWORKS
Neural network used to show how decision making of computer agents can be learnt from sample data
DATE
TYPE
EFFORT
Oct 2006
Neural Networks
Solo
Training Neural Networks
@ programming > artificial intelligence
SECTION MENU
     + Training Neural Networks
     + Hierarchical A* Pathfinding

A neural network was used in this demo to show how decision making of computer agents can be learnt with sample data.

First, the sampling of data has to be done. The user will control the behaviour of an enemy robot, while the supposed player robot is controlled by the computer. When the supposed player robot moves around and attacks, your intelligent response as the “enemy robot” will be sampled by the A.I. system and fed into the neural network for training.

Once the sampling is done, the actual game is executed. The enemy robots will react according to the attacks of the player. The quality of their reactions is based on the quality of the training data. I did manage to get quite a good training data.

Below is a video that shows the actual game in action, after training.


Video showing how the enemy robots react to the player’s actions using neural networks only. No if-statements are used.

Notice these things about the trained robots in the video:

  1. They approach me when I’m near and stop to attack when they are in shooting distance. They approach me again when I back away.
  2. Once their HP is low, they know that they should flee instead of trying to attack again.
  3. Although they have started to flee, they try to attack me again when I’m not facing them. Once I point the cursor at them, they know that they should flee, even though I haven’t even started shooting. This implies that they are especially good at back attacks.

All the responses to different situations are handled solely by a single neural network without any if-statements. Note that the zig-zag fleeing manner is procedural and not done by the neural networks.

Note: Scene setup done by Goh Cheng Teng. Neural Networks provided by Andre Tong.

  • Share/Save/Bookmark
Tags: , ,

Related posts


Leave a comment:


Allows tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

 
CG:SKEELOGY
ABOUT ME
Houdini FX TD
Double Negative
I am a Technical Director with strong interests in both the tech and artistic side of things. My life evolves round visual effects, photography, software engineering, tools programming and generally anything that looks and sounds cool.
I have done a variety of CG programming previously, including fluid simulations, muscle systems, soft/rigid bodies, raytracing etc. These theoretical and programming knowledge complement the visual works that I do as a TD in the VFX industry.
MY OTHER SITES
SUBSCRIBE TO SITE
SHARE THIS SITE
Copyright © 2003-2012.
All works are original ones by Skeel, unless otherwise stated.