Summary
Summary of the methodology course for the premasters of DSS
- Course
- Institution
All the stuff covered in the course
[Show more]
Seller
Follow
adata
Reviews received
Content preview
1. A brief overview of data science and methodsData science definition
Data science is the art of turning data into actions. The data science is the practice of using
computational methods through real knowledge through data.
The terminology exists since 1960s.
The term data science as in the context of this course introduced in 1990s in statistics and
data mining communities.
It was first named as an independent discipline in 2001.
Data types
- Structured data: data is stored/processed/manipulated in a traditional relational
database management system (RDBMS). Examples of structured data include names,
dates, addresses, credit card numbers, stock information, geolocation, and more.
- Unstructured data: is information that is not arranged according to a pre-set data
model or schema, and therefore cannot be stored in a traditional relational database
or RDBMS. including Word documents, email messages, PowerPoint presentations,
survey responses, transcripts of call center interactions and posts from blogs and
social media sites. Other types of unstructured data include images, audio and video
files.
- Semi-structured data: structured by text that is useful for creating a form or order of
hierarchy, somewhere between structured data and unstructured data. A few
examples of semi-structured data sources are emails, XML and other markup
languages, binary executables, TCP/IP packets, zipped files, data integrated from
different sources, and web pages.
Sources of data
,Impact of data science in business
Data science is one of the driving forces in maintaining competitiveness in business world.
Organizations can achieve:
- 17 - 49 % increase in their productivity when they increase data usability by 10 %
- 11 – 42 % return on assets when they increase data access by 10 %
- 5 - 6 % performance improvement via data-driven decisions
The four key activities
The key activities of Data Science in an organization can be classified into four groups:
- Acquire: This step consists of obtaining the needed data
- Prepare: This step includes the preprocessing operations on the data (cleaning the
data)
- Analyze: The data is analyzed, and the results are interpreted at this step
- Act: In accordance with the results that are obtained in the previous step, actions are
taken
Effort vs activities
Data mining
Data mining aims to reveal patterns in data using machine learning, statistics and database
systems.
A more extensive definition: Data Mining is the process of extracting previously unknown
and potentially useful information from the data using mathematical, statistical, and
machine learning methods.
Cross Industry Standard Process for Data Mining (CRISP-DM)
Considering the variety of industries and variety of data that is generated, there is a need of
a structured approach to execute a data mining project (guidelines, step by step procedure)
CRISP-DM is a combined effort of different institutions in an EU project in late 1990s. It
breaks the whole data mining process into six phases.
CRISP-DM Phases
- Starting phase at Business
Understanding
- Process goes back and forth
1
, - BA and DA process influences each other
- Circulating process
Business Understanding:
- Understanding the business goal
- Situation assessment
- Translating the business goal to a data mining objective
- Development of a project plan (most important of the phases)
Data Understanding:
- Considering data requirements
- Initial data collection, exploration, and quality assessment
Data Preparation:
- Selection of required data
- Data cleaning
- Data transformation and enrichment (crucial step before modeling)
Modeling:
- Selection of the appropriate modeling technique
- Training and test set creation for evaluation
- Development and examination of alternative modeling algorithms
- Fine tuning the model parameters
Model Evaluation:
- Evaluation of the model in the context of the business success criteria
- Model approval
Deployment:
- Reporting of the findings
- Planning and development of deployment procedure
- Deployment of the model.
- Development of a maintenance or update plan
- Review of the project and planning the next steps
Approached followed CRISP-DM
CRISP-DM was followed by other approaches from different companies:
- IBM introduced ASUM-DM
- SAS introduced SEMMA
- Microsoft introduced TDSP (Team Data Science Process)
They can be considered as updated versions of CRISP-DM based on new demands.
2
, Team Data Science Process (TDSP)
TDSP is Microsoft’s new version of CRISP-DM.
Key components:
- A data science lifecycle definition
- A standardized project structures
- Infrastructure and resources recommended for data science projects
- Tools and utilities recommended for project execution
TDSP Infrastructure and Resources for Data Science Projects
TDSP provides recommendations for managing shared analytics and storage infrastructure
such as:
- Cloud file systems for storing datasets
- Databases
- Big Data (SQL or Spark) clusters
- Machine learning service
TDSP provides recommendations for R and Python
Data Science Trajectory
3
The benefits of buying summaries with Stuvia:
Guaranteed quality through customer reviews
Stuvia customers have reviewed more than 700,000 summaries. This how you know that you are buying the best documents.
Quick and easy check-out
You can quickly pay through credit card or Stuvia-credit for the summaries. There is no membership needed.
Focus on what matters
Your fellow students write the study notes themselves, which is why the documents are always reliable and up-to-date. This ensures you quickly get to the core!
Frequently asked questions
What do I get when I buy this document?
You get a PDF, available immediately after your purchase. The purchased document is accessible anytime, anywhere and indefinitely through your profile.
Satisfaction guarantee: how does it work?
Our satisfaction guarantee ensures that you always find a study document that suits you well. You fill out a form, and our customer service team takes care of the rest.
Who am I buying these notes from?
Stuvia is a marketplace, so you are not buying this document from us, but from seller adata. Stuvia facilitates payment to the seller.
Will I be stuck with a subscription?
No, you only buy these notes for $7.04. You're not tied to anything after your purchase.
Can Stuvia be trusted?
4.6 stars on Google & Trustpilot (+1000 reviews)
67096 documents were sold in the last 30 days
Founded in 2010, the go-to place to buy study notes for 14 years now