CODEWITHSUNDEEP
artificial-intelligenceneural-networkgenetic-algorithmbots
Damir
Damir

Reputation: 56229

How to make bots to learn from experience

I am writing bot for one rts game.

I am using fuzzy logic to evaluate current position (mine and enemies') and to issue commands.

I have couple fuzzy variables: military_buildings, civilian_building, army_power, enemy_power and distance. I also have couple fuzzy linguistic values like VERY_GOOD, GOOD, NORMAL, BAD, VERY_BAD.

My next task is to make bots to learn, to avoid to all behave on same way. Any advice or idea how to solve this?

To use GA for tuning parameters (but I don't know ratings of players so I don't know if bot wins over a weak player or loses to a strong player).

Does anyone have experience with similar problems (I can change implementation and replace fuzzy logic if there is easier way to learn bots from experience)?

Upvotes: 1

Views: 498

Answers (3)

user_48349383
user_48349383

Reputation: 517

If I were you I would look at the AIIDE annual Starcraft Competition, it is sponsored in part by AAAI so there are some really high quality approaches to this problem. In particular if you are concerned with higher-level reasoning like resource management etc. Starcraft Competition Site Also, the competitors source code is all available open source so if you want to check out some other techniques I recommend it. FYI, most of the top competitors for this type of problem have historically used some variant of a Probabilistic State Machine Paper on Probabilistic FSMs, so this may make a good test bed for parameter tuning. FYI this is also the approach that some of the top Game AI middleware software uses for Game AI, like XAIT.

Upvotes: 0

Larry OBrien
Larry OBrien

Reputation: 8606

The idea of using GAs to tune the parameters to Fuzzy Linguistic Variables is a good one (I wish I thought of it!); the fuzzy logic gives you a nice continuous response curve while the GA will search through a large solution space. I think it's definitely a strategy worth pursuing; you should write up your results.

Upvotes: 2

Mihai Maruseac
Mihai Maruseac

Reputation: 21460

Have a look at reinforcement learning. Here are a quick preview and a book that can help you.

Based on your description, this is what I'd use :)

Upvotes: 3

Related Questions