Course detail

Machine Learning

FSI-VSC Acad. year: 2027/2028 Summer semester

The course provides an introduction to the fundamental principles and methods of machine learning, including neural networks. It focuses on methods for solving regression, classification, and clustering tasks, dimensionality reduction, and techniques for training and evaluating machine learning models. The course also includes practical applications of selected methods to solve problems using Python.

Language of instruction

Czech

Number of ECTS credits

5

Entry knowledge

Basic knowledge of statistics, optimization, and programming is expected.

Rules for evaluation and completion of the course

The course is completed by a course credit and an examination.

To obtain the course credit, students must attend compulsory lectures and laboratory classes and successfully complete all assigned tasks. Missed lectures may be made up through independent study of the relevant material. Missed laboratory classes may be made up by attending a replacement session or completing an alternative assignment according to the instructor's instructions.

The examination is oral and assesses students' knowledge and understanding of the topics covered in the lecture syllabus. The final grade is determined by the student's performance in the oral examination in accordance with the grading scale specified in the BUT Study and Examination Regulations.

Aims

The aim of the course is to provide students with knowledge of the fundamental principles and methods of machine learning, including neural networks. Upon successful completion of the course, students will be able to explain the principles of selected methods, assess their assumptions and limitations, select an appropriate method for solving regression, classification, and clustering tasks, and apply it using Python. Students will also be able to evaluate the performance of trained models and apply basic dimensionality reduction techniques.

The study programmes with the given course

Programme N-AIŘ-P: Applied Computer Science and Control, Master's, compulsory

Type of course unit

 

Lecture

26 hours, compulsory

Syllabus


  1. Introduction to Machine Learning – basic learning paradigms and types of tasks, model development workflow, generalization, and cross-validation.

  2. Regression Methods – linear and polynomial regression, least squares method, gradient descent, regularization, and evaluation of regression models.

  3. Binary Classification – linear classification, logistic regression, regularization, loss functions, and evaluation of binary classifiers.

  4. Multiclass Classification – One-vs-Rest and One-vs-One strategies, multinomial logistic regression, softmax function, cross-entropy loss, and evaluation of multiclass classifiers.

  5. Instance-Based Learning – classification and regression using the k-nearest neighbors (k-NN) algorithm, distance metrics, and parameter selection.

  6. Probabilistic Classification – Bayes classifier, Gaussian discriminant analysis, and Naive Bayes classifier.

  7. Support Vector Machines (SVM) – principles of classification and regression, kernel functions.

  8. Regression and Classification Trees – decision tree construction, splitting criteria, the CART algorithm, and pruning.

  9. Ensemble Learning – bagging and boosting methods, random forests, AdaBoost, and Gradient Boosting.

  10. Neural Networks – structure and activation functions, forward propagation, backpropagation, training, and regularization.

  11. Dimensionality Reduction – principal component analysis (PCA), overview of other methods, and their applications in data processing and visualization.

  12. Clustering – the k-means algorithm, Gaussian mixture models and the EM algorithm, hierarchical and density-based clustering, and clustering quality evaluation.

  13. Review


Computer-assisted exercise

26 hours, compulsory

Syllabus


  1. Introduction to the programming environment, data preparation, and basic model evaluation procedures.

  2. Linear and polynomial regression using the least squares method and regularization.

  3. Binary classification of linearly separable data.

  4. Multiclass classification and evaluation of classification models.

  5. Classification and regression using the k-nearest neighbors method.

  6. Bayes classifier, Gaussian discriminant analysis, and Naive Bayes classifier.

  7. Classification of linearly and nonlinearly separable data using support vector machines.

  8. Application of decision trees to classification and regression tasks.

  9. Ensemble learning methods.

  10. Application of multilayer perceptrons to classification and regression tasks.

  11. Dimensionality reduction.

  12. Data clustering.

  13. Course credit assessment.