Class notes
Alle lectures content Data Mining for Businnes & Governance
- Course
- Institution
Document containing all the information for the Data Mining for Business & Governance course. This course is given in spring 2024.
[Show more]
Seller
Follow
matsvandersteen
Content preview
Module 1: Introductory ConceptsMissing values:
- Sometimes, we have instances that have missing values for some features.
- It is of paramount importance to deal with this situation before building any machine
learning or data mining model.
- Missing values might result from fields that are not always applicable, incomplete
measurements, lost values.
Imputation strategies for missing values
- The simplest strategy would be to remove the feature containing missing values. This
strategy is recommended when the majority of the instances have missing values for
that feature.
o However: There are situations in which we have a few features or the feature
we want to remove is deemed relevant.
- If we have scattered missing values and few features, we might want to remove the
instances having missing values.
o However: There are situations in which we have a limited number of
instances.
- The third strategy is the most popular. It consists of replacing the missing values for a
given feature with a representative value such as the mean, the median or the mode
of that feature.
o However: We need to be aware that we are introducing noise.
- Fancier strategies include estimating the missing values with a machine learning
model trained on the non-missing information.
o Remark: More about missing values will be covered in Statistics course.
Normalization
Between 0-1
,Standardization
With boundaries
Normalization vs Standardization
Correlation (question part of exam)
,X2 association measure
Symbolic feature = categorical feature like eye color
, Encoding categorical features
Some machine learning, data mining algorithms or platforms cannot operate with categorical
features → therefore we need to encode these features as numerical quantities.
1 Label encoding
- Assigning integer numbers to each category. It only makes sense if there is an ordinal
relationship among the categories.
o For example: Weekdays, months, rating etc.
2 One-hot encoding
Class imbalance
More accurate if you predict with the blue feature because of the more frequency.
The benefits of buying summaries with Stuvia:
Guaranteed quality through customer reviews
Stuvia customers have reviewed more than 700,000 summaries. This how you know that you are buying the best documents.
Quick and easy check-out
You can quickly pay through credit card or Stuvia-credit for the summaries. There is no membership needed.
Focus on what matters
Your fellow students write the study notes themselves, which is why the documents are always reliable and up-to-date. This ensures you quickly get to the core!
Frequently asked questions
What do I get when I buy this document?
You get a PDF, available immediately after your purchase. The purchased document is accessible anytime, anywhere and indefinitely through your profile.
Satisfaction guarantee: how does it work?
Our satisfaction guarantee ensures that you always find a study document that suits you well. You fill out a form, and our customer service team takes care of the rest.
Who am I buying these notes from?
Stuvia is a marketplace, so you are not buying this document from us, but from seller matsvandersteen. Stuvia facilitates payment to the seller.
Will I be stuck with a subscription?
No, you only buy these notes for $6.40. You're not tied to anything after your purchase.
Can Stuvia be trusted?
4.6 stars on Google & Trustpilot (+1000 reviews)
51683 documents were sold in the last 30 days
Founded in 2010, the go-to place to buy study notes for 15 years now