100% satisfaction guarantee Immediately available after payment Both online and in PDF No strings attached
logo-home
(ML) is a type of artificial intelligence (AI) that allows software applications to become more accurate at predicting outcomes without being explicitly programmed to do so. Machine learning algorithms use historical data as input to predict new output va $7.99   Add to cart

Class notes

(ML) is a type of artificial intelligence (AI) that allows software applications to become more accurate at predicting outcomes without being explicitly programmed to do so. Machine learning algorithms use historical data as input to predict new output va

 2 views  0 purchase
  • Course
  • Institution

(ML) is a type of artificial intelligence (AI) that allows software applications to become more accurate at predicting outcomes without being explicitly programmed to do so. Machine learning algorithms use historical data as input to predict new output values.

Preview 2 out of 10  pages

  • May 26, 2023
  • 10
  • 2022/2023
  • Class notes
  • Sarala
  • All classes
avatar-seller
Bayesian Linear Regression

In the Bayesian viewpoint, we formulate linear regression using
probability distributions rather than point estimates. The response, y,
is not estimated as a single value, but is assumed to be drawn from a
probability distribution. The model for Bayesian Linear Regression
with the response sampled from a normal distribution is:




The output, y is generated from a normal (Gaussian) Distribution
characterized by a mean and variance. The mean for linear regression
is the transpose of the weight matrix multiplied by the predictor
matrix. The variance is the square of the standard deviation σ
(multiplied by the Identity matrix because this is a multi-dimensional
formulation of the model).


The aim of Bayesian Linear Regression is not to find the single “best”
value of the model parameters, but rather to determine the posterior
distribution for the model parameters. Not only is the response
generated from a probability distribution, but the model parameters
are assumed to come from a distribution as well. The posterior

, probability of the model parameters is conditional upon the training
inputs and outputs:




Here, P(β|y, X) is the posterior probability distribution of the model
parameters given the inputs and outputs. This is equal to the likelihood
of the data, P(y|β, X), multiplied by the prior probability of the
parameters and divided by a normalization constant. This is a simple
expression of Bayes Theorem, the fundamental underpinning of
Bayesian Inference:




Let’s stop and think about what this means. In contrast to OLS, we
have a posterior distribution for the model parameters that is
proportional to the likelihood of the data multiplied by
the prior probability of the parameters. Here we can observe the two
primary benefits of Bayesian Linear Regression.


1. Priors: If we have domain knowledge, or a guess for what the
model parameters should be, we can include them in our model,
unlike in the frequentist approach which assumes everything

The benefits of buying summaries with Stuvia:

Guaranteed quality through customer reviews

Guaranteed quality through customer reviews

Stuvia customers have reviewed more than 700,000 summaries. This how you know that you are buying the best documents.

Quick and easy check-out

Quick and easy check-out

You can quickly pay through credit card or Stuvia-credit for the summaries. There is no membership needed.

Focus on what matters

Focus on what matters

Your fellow students write the study notes themselves, which is why the documents are always reliable and up-to-date. This ensures you quickly get to the core!

Frequently asked questions

What do I get when I buy this document?

You get a PDF, available immediately after your purchase. The purchased document is accessible anytime, anywhere and indefinitely through your profile.

Satisfaction guarantee: how does it work?

Our satisfaction guarantee ensures that you always find a study document that suits you well. You fill out a form, and our customer service team takes care of the rest.

Who am I buying these notes from?

Stuvia is a marketplace, so you are not buying this document from us, but from seller hariharansv1810. Stuvia facilitates payment to the seller.

Will I be stuck with a subscription?

No, you only buy these notes for $7.99. You're not tied to anything after your purchase.

Can Stuvia be trusted?

4.6 stars on Google & Trustpilot (+1000 reviews)

81531 documents were sold in the last 30 days

Founded in 2010, the go-to place to buy study notes for 14 years now

Start selling
$7.99
  • (0)
  Add to cart