Output feedback reinforcement learning control for linear systems / Syed Ali Asad Rizvi, Zongli Lin.
Rizvi, Syed Ali Asad.; Lin, Zongli, 1964-
2023
TJ216
Available Online

Linked e-resources

Linked Resource Online Access
Concurrent users Unlimited
Authorized users Authorized users
Document Delivery Supplied Can lend chapters, not whole ebooks

Details

Title Output feedback reinforcement learning control for linear systems / Syed Ali Asad Rizvi, Zongli Lin.
Author Rizvi, Syed Ali Asad.
ISBN 9783031158582 (electronic bk.)
303115858X (electronic bk.)
3031158571
9783031158575
DOI https://doi.org/10.1007/978-3-031-15858-2
Imprint Cham : Birkhäuser, 2023.
Language English
Description 1 online resource (304 p.).
Other Standard Identifiers 10.1007/978-3-031-15858-2 doi
Call Number TJ216
Dewey Decimal Classification 629.8/3
Summary This monograph explores the analysis and design of model-free optimal control systems based on reinforcement learning (RL) theory, presenting new methods that overcome recent challenges faced by RL. New developments in the design of sensor data efficient RL algorithms are demonstrated that not only reduce the requirement of sensors by means of output feedback, but also ensure optimality and stability guarantees. A variety of practical challenges are considered, including disturbance rejection, control constraints, and communication delays. Ideas from game theory are incorporated to solve output feedback disturbance rejection problems, and the concepts of low gain feedback control are employed to develop RL controllers that achieve global stability under control constraints. Output Feedback Reinforcement Learning Control for Linear Systems will be a valuable reference for graduate students, control theorists working on optimal control systems, engineers, and applied mathematicians.
Note 3.4.5 Exploration Bias Immunity of the Output Feedback Learning Algorithms
Bibliography, etc. Note Includes bibliographical references and index.
Access Note Access limited to authorized users.
Source of Description Online resource; title from PDF title page (SpringerLink, viewed December 12, 2022).
Added Author Lin, Zongli, 1964-
Series Control engineering (Birkhäuser)
Available in Other Form Output Feedback Reinforcement Learning Control for Linear Systems
Linked Resources Online Access
Record Appears in Online Resources > Ebooks
All Resources
Intro
Preface
Contents
Notation and Acronyms
1 Introduction to Optimal Control and Reinforcement Learning
1.1 Introduction
1.2 Optimal Control of Dynamic Systems
1.2.1 Dynamic Programming Method
1.2.2 The Linear Quadratic Regulation Problem
1.2.3 Iterative Numerical Methods
1.3 Reinforcement Learning Based Optimal Control
1.3.1 Principles of Reinforcement Learning
1.3.2 Reinforcement Learning for Automatic Control
1.3.3 Advantages of Reinforcement Learning Control
Optimality and Adaptivity
Model-Free Control
Large Spectrum of Applications

1.3.4 Limitations of Reinforcement Learning Control
1.3.5 Reinforcement Learning Algorithms
1.4 Recent Developments and Challenges in Reinforcement Learning Control
1.4.1 State Feedback versus Output Feedback Designs
1.4.2 Exploration Signal/Noise and Estimation Bias
1.4.3 Discounted versus Undiscounted Cost Functions
1.4.4 Requirement of a Stabilizing Initial Policy
1.4.5 Optimal Tracking Problems
1.4.6 Reinforcement Learning in Continuous-Time
1.4.7 Disturbance Rejection
1.4.8 Distributed Reinforcement Learning
1.5 Notes and References

2 Model-Free Design of Linear Quadratic Regulator
2.1 Introduction
2.2 Literature Review
2.3 Discrete-Time LQR Problem
2.3.1 Iterative Schemes Based on State Feedback
2.3.2 Model-Free Output Feedback Solution
2.3.3 State Parameterization of Discrete-Time Linear Systems
2.3.4 Output Feedback Q-function for LQR
2.3.5 Output Feedback Based Q-learning for the LQR Problem
2.3.6 Numerical Examples
2.4 Continuous-Time LQR Problem
2.4.1 Model-Based Iterative Schemes for the LQR Problem
2.4.2 Model-Free Schemes Based on State Feedback

2.4.3 Model-Free Output Feedback Solution
2.4.4 State Parameterization
2.4.5 Learning Algorithms for Continuous-Time Output Feedback LQR Control
2.4.6 Exploration Bias Immunity of the Output Feedback Learning Algorithms
2.4.7 Numerical Examples
2.5 Summary
2.6 Notes and References
3 Model-Free H∞ Disturbance Rejection and Linear Quadratic Zero-Sum Games
3.1 Introduction
3.2 Literature Review
3.3 Discrete-Time Zero-Sum Game and H∞ Control Problem
3.3.1 Model-Based Iterative Algorithms

3.3.2 State Parameterization of Discrete-Time Linear Systems Subject to Disturbances
3.3.3 Output Feedback Q-function for Zero-Sum Game
3.3.4 Output Feedback Based Q-learning for Zero-Sum Game and H∞ Control Problem
3.3.5 A Numerical Example
3.4 Continuous-Time Zero-Sum Game and H∞ Control Problem
3.4.1 Model-Based Iterative Schemes for Zero-Sum Game and H∞ Control Problem
3.4.2 Model-Free Schemes Based on State Feedback
3.4.3 State Parameterization
3.4.4 Learning Algorithms for Output Feedback Differential Zero-Sum Game and H∞ Control Problem

Browse Subjects

Show more subjects...

Statistics

from
to
Export