CODEWITHSUNDEEP
artificial-intelligence
edgarmtze
edgarmtze

Reputation: 25058

What's the utility theory in artificial intelligence?

I have the book Artificial Intelligence: A Modern Approach (by Stuart Rusell). I am reading chapter 16, "Making simple decisions", but I do not get the main idea of the utility theory, can you provide a detailed example?

Upvotes: 11

Views: 28733

Answers (2)

Jose M Vidal
Jose M Vidal

Reputation: 9160

The main idea of utility theory is really simple: an agent's preferences over possible outcomes can be captured by a function that maps these outcomes to a real number; the higher the number the more that agent likes that outcome. The function is called a utility function.

For example, we could say that my utility for owning various items is:

u(apple) = 10
u(orange) = 12
u(basketball) = 4
u(macbookpro) = 45

Economists (usually) consider humans as utility-maximizing agents. That is, we are always trying to maximize our internal utility function.

Once you have these numbers, then you can mix them in with probabilities and talk about expected utilities, optimal strategies, discounted future rewards, and many other fun things.

If you want to learn more, pick up a textbook on game theory, or read the first chapter of this agents book.

Upvotes: 13

tenpn
tenpn

Reputation: 4716

Dave Mark has written a whole book on utility theory for game ai: http://www.amazon.com/Behavioral-Mathematics-Game-Dave-Mark/dp/1584506849/ref=sr_1_1?ie=UTF8&qid=1415095272&sr=8-1&keywords=dave+mark

He also has some public lectures up, along with Kevin Dill: http://intrinsicalgorithm.com/IAonAI/2013/02/both-my-gdc-lectures-on-utility-theory-free-on-gdc-vault/

Upvotes: 5

Related Questions