Multi-Armed Bandits: Theory and Applications to Online Learning in Networks

Author:   Qing Zhao ,  R. Srikant
Publisher:   Morgan & Claypool Publishers
ISBN:  

9781681736372


Pages:   147
Publication Date:   30 November 2019
Format:   Hardback
Availability:   Manufactured on demand   Availability explained
We will order this item for you from a manufactured on demand supplier.

Our Price $113.00 Quantity:  
Add to Cart

Share |

Multi-Armed Bandits: Theory and Applications to Online Learning in Networks


Add your own review!

Overview

Multi-armed bandit problems pertain to optimal sequential decision making and learning in unknown environments. Since the first bandit problem posed by Thompson in 1933 for the application of clinical trials, bandit problems have enjoyed lasting attention from multiple research communities and have found a wide range of applications across diverse domains. This book covers classic results and recent development on both Bayesian and frequentist bandit problems. We start in Chapter 1 with a brief overview on the history of bandit problems, contrasting the two schools—Bayesian and frequentis —of approaches and highlighting foundational results and key applications. Chapters 2 and 4 cover, respectively, the canonical Bayesian and frequentist bandit models. In Chapters 3 and 5, we discuss major variants of the canonical bandit models that lead to new directions, bring in new techniques, and broaden the applications of this classical problem. In Chapter 6, we present several representative application examples in communication networks and social-economic systems, aiming to illuminate the connections between the Bayesian and the frequentist formulations of bandit problems and how structural results pertaining to one may be leveraged to obtain solutions under the other.

Full Product Details

Author:   Qing Zhao ,  R. Srikant
Publisher:   Morgan & Claypool Publishers
Imprint:   Morgan & Claypool Publishers
Weight:   0.001kg
ISBN:  

9781681736372


ISBN 10:   1681736373
Pages:   147
Publication Date:   30 November 2019
Audience:   Professional and scholarly ,  Professional & Vocational
Format:   Hardback
Publisher's Status:   Active
Availability:   Manufactured on demand   Availability explained
We will order this item for you from a manufactured on demand supplier.

Table of Contents

Preface Acknowledgments Introduction Bayesian Bandit Model and Gittins Index Variants of the Bayesian Bandit Model Frequentist Bandit Model Variants of the Frequentist Bandit Model Application Examples Bibliography Author's Biography

Reviews

Author Information

Qing Zhao is a Joseph C. Ford Professor of Engineering at Cornell University. Prior to that, she was a Professor in the ECE Department at University of California, Davis. She received a Ph.D. in Electrical Engineering from Cornell in 2001. Her research interests include sequential decision theory, stochastic optimization, machine learning, and algorithmic theory with applications in infrastructure, communications, and social-economic networks. She is a Fellow of IEEE, a Distinguished Lecturer of the IEEE Signal Processing Society, a Marie Sklodowska-Curie Fellow of the European Union Research and Innovation program, and a Jubilee Chair Professor of Chalmers University during her 2018-2019 sabbatical leave. She received the 2010 IEEE Signal Processing Magazine Best Paper Award and the 2000 Young Author Best Paper Award from IEEE Signal Processing Society. R. Srikant received his B.Tech. from the Indian Institute of Technology, Madras in 1985, his M.S. and Ph.D. from the University of Illinois at Urbana-Champaign in 1988 and 1991, respectively, all in Electrical Engineering. He was a Member of Technical Staff at AT&T Bell Laboratories from 1991 to 1995. He is currently with the University of Illinois at Urbana-Champaign, where he is the Fredric G. and Elizabeth H. Nearing Endowed Professor of Electrical and Computer Engineering and a Professor in the Coordinated Science Lab.

Tab Content 6

Author Website:  

Customer Reviews

Recent Reviews

No review item found!

Add your own review!

Countries Available

All regions
Latest Reading Guide

wl

Shopping Cart
Your cart is empty
Shopping cart
Mailing List