Beginner Topic 17 of 51 Emerging & Frontier Topics
Data Mining
Discovering patterns in large datasets.
How it works
Data mining discovers useful patterns in large datasets. Typical tasks are classification and regression to predict labels or values, clustering to group similar items, association rule mining such as market-basket analysis using support and confidence, anomaly detection for outliers and frequent pattern and sequence mining. Methods include decision trees, k-means, Apriori and neural networks. The process cleans and transforms data, applies algorithms, evaluates patterns for validity and usefulness and interprets them with domain experts. It overlaps with statistics, machine learning and databases.
Where it is used
Retailers find products bought together, banks detect fraud and telecoms predict customer churn.
Common pitfall
Searching enough data always turns up patterns by chance, so spurious findings occur, correlation is not causation and privacy can be violated by combining records. Validate on held-out data, correct for multiple testing and anonymize data.
Where it fits in the course
Data Mining is topic 17 of 51 in Emerging & Frontier Topics, rated Beginner. It follows Big Data. The next topic is Blockchain.
Practice and explore
- Open the interactive lesson, with a mini quiz.
- Take the Emerging & Frontier Topics quiz.
How to study this topic
- Read the explanation above and restate the definition in your own words.
- Open the interactive lesson and answer its mini quiz.
- Read the common pitfall, then write a short example that avoids it.
- Check your understanding in the Emerging & Frontier Topics quiz, and revisit the topic if you miss a question.
Frequently asked questions
What is Data Mining?
Where do people use Data Mining?
What is the most common mistake with Data Mining?
What should I learn before this topic?
How can I practice it?
Is Data Mining hard to learn?
How long does it take to learn Data Mining?
Which topics are related to Data Mining?
What should I study after Data Mining?
Related topics
- Big Data (Emerging & Frontier Topics)
- Blockchain (Emerging & Frontier Topics)
- Data Visualization (Emerging & Frontier Topics)
- Proof of Work and Proof of Stake (Emerging & Frontier Topics)
- Data Types (Programming Fundamentals)
- Data Types in SQL (Databases)
- Lock-Free Data Structures (Concurrency & Parallelism)