Data Dependent Convergence Guarantees for Regression Problems in Neural Networks

Piccini, Jacopo (2021) Data Dependent Convergence Guarantees for Regression Problems in Neural Networks. [Laurea magistrale], Università di Bologna, Corso di Studio in Aerospace engineering / ingegneria aerospaziale [LM-DM270] - Forli'
Documenti full-text disponibili:
[img] Documento PDF (Thesis)
Disponibile con Licenza: Creative Commons: Attribuzione - Non commerciale - Non opere derivate 4.0 (CC BY-NC-ND 4.0)

Download (1MB)

Abstract

It has been recently demonstrated that the artificial neural networks’ (ANN) learning under gradient descent method, can be studied using neural tangent kernel (NTK). This thesis’ goal is to show how techniques related to control theory, can be applied to model and improve the hyperparameters training dynamics. Moreover, it will be proven how by using methods from linear parameter varying (LPV) theory can allow the exact representation of the learning dynamics over its whole domain. The first part of the thesis is dedicated to the modelling and analysis of the system. The modelling of simple ANNs is hereby suggested and a method to expand this approach to larger networks is proposed. After the first part, the LPV system model’s different properties are analysed using different methods. After the modelling and analysis phase, the focus will be shifted on how to improve the neural network both in terms of stability and performances. This improvement is achieved by using state feedback on the LPV system. After setting up the control architecture, controllers based on different methods, such as optimal control and robust control, are then synthesized and their performances are compared.

Abstract
Tipologia del documento
Tesi di laurea (Laurea magistrale)
Autore della tesi
Piccini, Jacopo
Relatore della tesi
Correlatore della tesi
Scuola
Corso di studio
Ordinamento Cds
DM270
Parole chiave
Control theory, Artificial Neural Networks, ANNs, Linear Parameter Varying System Model, LPV, feedback, robust control, optimal control, LQR, LQI, Neural Tangent Kernel, NTK
Data di discussione della Tesi
14 Ottobre 2021
URI

Altri metadati

Statistica sui download

Gestione del documento: Visualizza il documento

^