Sanghi Nimish - Deep Reinforcement Learning With Python. RLHF For Chatbots And Large Language Models (Second Edition).pdf

(17833 KB) Pobierz

Deep Reinforcement

Learning with Python

RLHF for Chatbots and Large

Language Models

Second Edition

Nimish Sanghi

Deep Reinforcement Learning with Python: RLHF for Chatbots and Large Language

Models, Second Edition

Nimish Sanghi

Bangalore, India

ISBN-13 (pbk): 979-8-8688-0272-0

https://doi.org/10.1007/979-8-8688-0273-7

ISBN-13 (electronic): 979-8-8688-0273-7

This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of the

material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation,

broadcasting, reproduction on microfilms or in any other physical way, and transmission or information

storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now

known or hereafter developed.

Trademarked names, logos, and images may appear in this book. Rather than use a trademark symbol with

every occurrence of a trademarked name, logo, or image we use the names, logos, and images only in an

editorial fashion and to the benefit of the trademark owner, with no intention of infringement of the

trademark.

The use in this publication of trade names, trademarks, service marks, and similar terms, even if they are not

identified as such, is not to be taken as an expression of opinion as to whether or not they are subject to

proprietary rights.

While the advice and information in this book are believed to be true and accurate at the date of publication,

neither the authors nor the editors nor the publisher can accept any legal responsibility for any errors or

omissions that may be made. The publisher makes no warranty, express or implied, with respect to the

material contained herein.

Managing Director, Apress Media LLC: Welmoed Spahr

Acquisitions Editor: Celestin Suresh John

Development Editor: James Markham

Editorial Assistant: Gryffin Winkler

Copy Editor: Kezia Endsley

Cover designed by eStudioCalamar

Cover image designed by Freepik (www.freepik.com)

Distributed to the book trade worldwide by Springer Science+Business Media New York, 1 New York Plaza,

Suite 4600, New York, NY 10004-1562, USA. Phone 1-800-SPRINGER, fax (201) 348-4505, e-mail orders-

ny@springer-sbm.com, or visit www.springeronline.com. Apress Media, LLC is a California LLC and the sole

member (owner) is Springer Science + Business Media Finance Inc (SSBM Finance Inc). SSBM Finance Inc

is a

Delaware

corporation.

For information on translations, please e-mail booktranslations@springernature.com; for reprint,

paperback, or audio rights, please e-mail bookpermissions@springernature.com.

Apress titles may be purchased in bulk for academic, corporate, or promotional use. eBook versions and

licenses are also available for most titles. For more information, reference our Print and eBook Bulk Sales

web page at http://www.apress.com/bulk-sales.

Any source code or other supplementary material referenced by the author in this book is available to

readers on GitHub. For more detailed information, please visit https://www.apress.com/gp/services/

source-code.

If disposing of this product, please recycle the paper

This book is dedicated to my wife Suman, and our kids,

Harsh and Yash, who selflessly sacrificed our shared moments

to allow these pages to come to life.

Table of Contents

About the Author ½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½xv

About the Technical Reviewer ½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½xvii

Acknowledgments ½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½xix

Introduction ½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½xxi

Chapter 1: Introduction to Reinforcement Learning ½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½½ 1

Reinforcement Learning 1

Machine Learning Branches 3

Supervised Learning 4

Unsupervised Learning 5

Reinforcement Learning 6

Emerging Sub-branches 7

Core Elements of RL 12

Deep Learning with Reinforcement Learning 13

Examples and Case Studies 14

Autonomous Vehicles 14

Robots 15

Recommendation Systems 15

Finance and Trading 15

Healthcare 16

Large Language Models and Generative AI 16

Game Playing 16

Libraries and Environment Setup 17

Local Install (Recommended for a Local Option) 17

Local Install with VS Code 23

Running on Google Colab (Recommended for a Cloud Option) 26

Plik z chomika:

george.mouflon

Sanghi Nimish - Deep Reinforcement Learning With Python. RLHF For Chatbots And Large Language Models (Second Edition).pdf

Plik z chomika:

Inne pliki z tego folderu:

Inne foldery tego chomika: