23AM01-MACHINE LEARNING

PREREQUISITE : Probability and Statistics, Data Warehousing and Data Mining 

COURSE OUTCOMES (COs): At the end of the course, student will be able to

 

CO1 : Understand development steps of model building and evaluation approaches. (Understand- L2)

CO2 : Apply Nearest Neighbor-based models to solve real-time regression and classification problems . (Apply -L3)

CO3 : Make use of supervised learning algorithms to solve classification problems. (Apply- L3) 

CO4 : Apply linear discriminants and perceptron classifiers to classify datasets. (Apply- L3)

CO5 : Apply various clustering techniques to solve complex problems. (Apply- L3)

UNIT-I:    Unit-1 PPT Link  Unit-1 Pdf 

Introduction to Machine Learning: Evolution of Machine Learning, Paradigms for ML, Learning by Rote, Learning by Induction, Reinforcement Learning, Types of Data, Matching, Stages in Machine Learning, Data Acquisition, Feature Engineering, Data Representation, Model Selection, Model Learning, Model Evaluation, Model Prediction, Search and Learning, Data Sets. 

UNIT-II:  Unit-2 PPT Link , Unit-2 Pdf Link, Proximity distance measures link

Nearest Neighbor-Based Models: Introduction to Proximity Measures, Distance Measures, Non-Metric Similarity Functions, Proximity Between Binary Patterns, Different Classification Algorithms Based on the Distance Measures ,K-Nearest Neighbor Classifier, Radius Distance Nearest Neighbor Algorithm, KNN Regression, Performance of Classifiers, Performance of Regression Algorithms. 

UNIT-III: Unit-3 PPT Link, Unit-3 Pdf Link

Models Based on Decision Trees: Decision Trees for Classification, Impurity Measures, Properties, Regression Based on Decision Trees, Bias–Variance Trade-off, Random Forests for Classification and Regression. The Bayes Classifier: Introduction to the Bayes Classifier, Bayes’ Rule and Inference, The Bayes Classifier and its Optimality, Multi-Class Classification, Class Conditional Independence and Naive Bayes Classifier (NBC) 

UNIT-IV: 

Linear Discriminants for Machine Learning: Introduction to Linear Discriminants, Linear Discriminants for Classification, Perceptron Classifier, Perceptron Learning Algorithm, Support Vector Machines, Linearly Non-Separable Case, Non-linear SVM, Kernel Trick, Logistic Regression, Linear Regression, Multi-Layer Perceptrons (MLPs), Backpropagation for Training an MLP. 

UNIT-V: 

Clustering : Introduction to Clustering, Partitioning of Data, Matrix Factorization, Clustering of Patterns, Divisive Clustering, Agglomerative Clustering, Partitional Clustering, K-Means Clustering, Soft Partitioning, Soft Clustering, Fuzzy C-Means Clustering, Rough Clustering, Rough K-Means Clustering Algorithm, Expectation Maximization-Based Clustering, Spectral Clustering. Text Books: 1. “Machine Learning Theory and Practice”, M N Murthy, V S Ananthanarayana, Universities Press (India), 2024

TEXTBOOKS: 

 T1 “Machine Learning Theory and Practice”, M N Murthy, V S Ananthanarayana, Universities Press (India), 2024. 

 REFERENCE BOOKS: 

 R1  “Machine Learning”, Tom M. Mitchell, McGraw-Hill Publication, 2017.

 R2   Peter Harington, “Machine Learning in Action”, Cengage, 1st edition, 2012 

 R3   Peter Flach, “Machine Learning: The art and science of algorithms that make sense of data”, Cambridge university press,2012.