Class notes
College aantekeningen Multi-Agent Systems deel 2 (XM_0052), Master VU AI
- Course
- Institution
Lecture notes from lecture 7-9 for the course MAS, you no longer have to watch a lecture but mainly practice
[Show more]
Seller
Follow
MeldaMalkoc
Reviews received
Content preview
Lecture 7 (17 & 19 & 24 Nov)Exploration versus Exploitation
Context
sequential decision making
recurring themes:
States, actions, transitions, policy (how he is going to translate the state he is in into the actions he should
take), value functions (functions that assign value to states and allows to use them in next action);
Back-up, optimization (planning and searching)
In sequential decision making an agent tries to solve a sequential control problem by directly interacting with an
unknown environment
learning by trial and error, agent tries actions to learn their consequences
not supervised: no examples of correct or incorrect behavior; instead only rewards for actions tried
active learning: agent interacts with environment, agent has partial control over what data it will obtain for
learning
on-line learning: it must maximize performance during learning, not afterwards
in game theory it was just selfish agents without a mental state, but looking for the most rational action. From
now on we will look at agents that use mental states to move forward. We will first focus on 1 agent
Preliminaries: Recap of Probability Theory
Stochastic (or random) variables: abstract model the idea of randomly determined numerical outcome from a set of
outcomes.
X: Ω(′ outcomes′ ) →R
P(X=x) probability of x from the set X is ... → plotting this will give density function
Multi-Agent Systems 34
,Multi-Agent Systems 35
, By combining each line getting the mean of the row in the last column/sample mean:
adding more and more of X, it will go to a normal form.
Multi-Agent Systems 36
, the larger the sample the more picked about actual mean, and much more normal distribution:
Multi-Agent Systems 37
The benefits of buying summaries with Stuvia:
Guaranteed quality through customer reviews
Stuvia customers have reviewed more than 700,000 summaries. This how you know that you are buying the best documents.
Quick and easy check-out
You can quickly pay through credit card or Stuvia-credit for the summaries. There is no membership needed.
Focus on what matters
Your fellow students write the study notes themselves, which is why the documents are always reliable and up-to-date. This ensures you quickly get to the core!
Frequently asked questions
What do I get when I buy this document?
You get a PDF, available immediately after your purchase. The purchased document is accessible anytime, anywhere and indefinitely through your profile.
Satisfaction guarantee: how does it work?
Our satisfaction guarantee ensures that you always find a study document that suits you well. You fill out a form, and our customer service team takes care of the rest.
Who am I buying these notes from?
Stuvia is a marketplace, so you are not buying this document from us, but from seller MeldaMalkoc. Stuvia facilitates payment to the seller.
Will I be stuck with a subscription?
No, you only buy these notes for $7.55. You're not tied to anything after your purchase.
Can Stuvia be trusted?
4.6 stars on Google & Trustpilot (+1000 reviews)
67474 documents were sold in the last 30 days
Founded in 2010, the go-to place to buy study notes for 14 years now