Teoriya Veroyatnostei i ee Primeneniya
RUS  ENG    JOURNALS   PEOPLE   ORGANISATIONS   CONFERENCES   SEMINARS   VIDEO LIBRARY   PACKAGE AMSBIB  
General information
Latest issue
Archive
Impact factor
Guidelines for authors
Submit a manuscript

Search papers
Search references

RSS
Latest issue
Current issues
Archive issues
What is RSS


Teor. Veroyatnost. i Primenen.:
Year:
Volume:
Issue:
Page:
Find




Personal entry:
Login:
Password:
Save password
Enter
Forgotten password?
Register

Teoriya Veroyatnostei i ee Primeneniya, 2019, Volume 64, Issue 3, Pages 442–455
DOI: https://doi.org/10.4213/tvp5303 (Mi tvp5303) 		 
This article is cited in 1 scientific paper (total in 1 paper)

Gittins index for simple family of Markov bandit processes with switching cost and no discounting

M. P. Savelov

Novosibirsk State University
Full-text PDF (467 kB) Citations (1)
References:
PDF
HTML
DOI: https://doi.org/10.4213/tvp5303
Abstract: We consider the multiarmed bandit problem (the problem of Markov bandits) with switching penalties and no discounting in case when state spaces of all bandits are finite. An optimal strategy should have the largest average reward per unit time on an infinite time horizon. For this problem it is shown that an optimal strategy can be specified by a Gittins index under the natural assumption that the switching penalties are nonnegative.
Keywords: multicomponent systems, Gittins index, simple family of alternative Markov bandit processes, multiarmed bandit problem, Markov decision process, controlled Markov processes, long run average return, no discounting, switching penalties, optimal strategy.
Funding agency Grant number
Russian Science Foundation 17-11-01173
This work was supported by the Russian Science Foundation (grant 17-11-01173).
Received: 26.03.2019
Accepted: 20.06.2019
English version:
Theory of Probability and its Applications, 2019, Volume 64, Issue 3, Pages 355–364
DOI: https://doi.org/10.1137/S0040585X97T989544
Bibliographic databases:
Document Type: Article
Language: Russian
Citation: M. P. Savelov, “Gittins index for simple family of Markov bandit processes with switching cost and no discounting”, Teor. Veroyatnost. i Primenen., 64:3 (2019), 442–455; Theory Probab. Appl., 64:3 (2019), 355–364
Citation in format AMSBIB
\Bibitem{Sav19}
\by M.~P.~Savelov
\paper Gittins index for simple family of Markov bandit processes with switching cost and no discounting
\jour Teor. Veroyatnost. i Primenen.
\yr 2019
\vol 64
\issue 3
\pages 442--455
\mathnet{http://mi.mathnet.ru/tvp5303}
\crossref{https://doi.org/10.4213/tvp5303}
\mathscinet{http://mathscinet.ams.org/mathscinet-getitem?mr=3988268}
\zmath{https://zbmath.org/?q=an:07122182}
\elib{https://elibrary.ru/item.asp?id=38590352}
\transl
\jour Theory Probab. Appl.
\yr 2019
\vol 64
\issue 3
\pages 355--364
\crossref{https://doi.org/10.1137/S0040585X97T989544}
\isi{https://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=Publons&SrcAuth=Publons_CEL&DestLinkType=FullRecord&DestApp=WOS_CPL&KeyUT=000492370500002}
\scopus{https://www.scopus.com/record/display.url?origin=inward&eid=2-s2.0-85074360690}
Linking options:
  • https://www.mathnet.ru/eng/tvp5303
  • https://doi.org/10.4213/tvp5303
  • https://www.mathnet.ru/eng/tvp/v64/i3/p442
    • This publication is cited in the following 1 articles:
    Citing articles in Google Scholar: Russian citations, English citations
    Related articles in Google Scholar: Russian articles, English articles
    		Теория вероятностей и ее применения Theory of Probability and its Applications
    Statistics & downloads:
    Abstract page:397
    Full-text PDF :86
    References:41
    First page:24
     
      Contact us:
    		  Terms of Use  Registration to the website  Logotypes © Steklov Mathematical Institute RAS, 2024