Course detail
Machine Learning
FSI-VSC Acad. year: 2027/2028 Summer semester
The course provides an introduction to the fundamental principles and methods of machine learning, including neural networks. It focuses on methods for solving regression, classification, and clustering tasks, dimensionality reduction, and techniques for training and evaluating machine learning models. The course also includes practical applications of selected methods to solve problems using Python.
Language of instruction
Czech
Number of ECTS credits
5
Supervisor
Department
Entry knowledge
Basic knowledge of statistics, optimization, and programming is expected.
Rules for evaluation and completion of the course
The course is completed by a course credit and an examination.
To obtain the course credit, students must attend compulsory lectures and laboratory classes and successfully complete all assigned tasks. Missed lectures may be made up through independent study of the relevant material. Missed laboratory classes may be made up by attending a replacement session or completing an alternative assignment according to the instructor's instructions.
The examination is oral and assesses students' knowledge and understanding of the topics covered in the lecture syllabus. The final grade is determined by the student's performance in the oral examination in accordance with the grading scale specified in the BUT Study and Examination Regulations.
Aims
The aim of the course is to provide students with knowledge of the fundamental principles and methods of machine learning, including neural networks. Upon successful completion of the course, students will be able to explain the principles of selected methods, assess their assumptions and limitations, select an appropriate method for solving regression, classification, and clustering tasks, and apply it using Python. Students will also be able to evaluate the performance of trained models and apply basic dimensionality reduction techniques.
The study programmes with the given course
Programme N-AIŘ-P: Applied Computer Science and Control, Master's, compulsory
Type of course unit
Lecture
26 hours, compulsory
Syllabus
- Introduction to Machine Learning – basic learning paradigms and types of tasks, model development workflow, generalization, and cross-validation.
- Regression Methods – linear and polynomial regression, least squares method, gradient descent, regularization, and evaluation of regression models.
- Binary Classification – linear classification, logistic regression, regularization, loss functions, and evaluation of binary classifiers.
- Multiclass Classification – One-vs-Rest and One-vs-One strategies, multinomial logistic regression, softmax function, cross-entropy loss, and evaluation of multiclass classifiers.
- Instance-Based Learning – classification and regression using the k-nearest neighbors (k-NN) algorithm, distance metrics, and parameter selection.
- Probabilistic Classification – Bayes classifier, Gaussian discriminant analysis, and Naive Bayes classifier.
- Support Vector Machines (SVM) – principles of classification and regression, kernel functions.
- Regression and Classification Trees – decision tree construction, splitting criteria, the CART algorithm, and pruning.
- Ensemble Learning – bagging and boosting methods, random forests, AdaBoost, and Gradient Boosting.
- Neural Networks – structure and activation functions, forward propagation, backpropagation, training, and regularization.
- Dimensionality Reduction – principal component analysis (PCA), overview of other methods, and their applications in data processing and visualization.
- Clustering – the k-means algorithm, Gaussian mixture models and the EM algorithm, hierarchical and density-based clustering, and clustering quality evaluation.
- Review
Computer-assisted exercise
26 hours, compulsory
Syllabus
- Introduction to the programming environment, data preparation, and basic model evaluation procedures.
- Linear and polynomial regression using the least squares method and regularization.
- Binary classification of linearly separable data.
- Multiclass classification and evaluation of classification models.
- Classification and regression using the k-nearest neighbors method.
- Bayes classifier, Gaussian discriminant analysis, and Naive Bayes classifier.
- Classification of linearly and nonlinearly separable data using support vector machines.
- Application of decision trees to classification and regression tasks.
- Ensemble learning methods.
- Application of multilayer perceptrons to classification and regression tasks.
- Dimensionality reduction.
- Data clustering.
- Course credit assessment.