bibtype C - Conference Paper (international conference)
ARLID 0410872
utime 20240103182245.3
mtime 20060210235959.9
ISBN 80-248-0153-1
title (primary) (eng) Some remarks on the variance in Markov chains with rewards
publisher
place Ostrava
name Technical University
pub_time 2002
specification
page_count 6 s.
serial
title Proceedings of the 20th International Conference Mathematical Methods in Economics 2002
page_num 231-236
editor
name1 Ramík
name2 J.
keyword Markov reward chains
keyword asymptotic behaviour
keyword mean variance penalization
author (primary)
ARLID cav_un_auth*0101196
name1 Sladký
name2 Karel
institution UTIA-B
full_dept Department of Econometrics
fullinstit Ústav teorie informace a automatizace AV ČR, v. v. i.
author
ARLID cav_un_auth*0101193
name1 Sitař
name2 Milan
institution UTIA-B
fullinstit Ústav teorie informace a automatizace AV ČR, v. v. i.
COSATI 12B
COSATI 05D
cas_special
project
project_id GA402/02/1015
agency GA ČR
ARLID cav_un_auth*0000527
project
project_id GA402/01/0539
agency GA ČR
ARLID cav_un_auth*0008959
research CEZ:AV0Z1075907
abstract (eng) We consider a discrete time Markov reward process with finite state space and assume that the rewards associated with the transitions are random variables with known probability distributions and finite first and second moments. We are interested in properties of cumulative reward earned in the subsequent transitions of the Markov chain. Explicit formulas for expected values and variance of the cumulative (random) reward are obtained for finite and infinite horizon models.
action
ARLID cav_un_auth*0212937
name Mathematical Methods in Economics 2002 /20./
place Ostrava
country CZ
dates 03.09.2002-05.09.2002
RIV BB
department E
permalink http://hdl.handle.net/11104/0130959
ID_orig UTIA-B 20020086
arlyear 2002
mrcbU10 2002
mrcbU10 Ostrava Technical University
mrcbU12 80-248-0153-1
mrcbU63 Proceedings of the 20th International Conference Mathematical Methods in Economics 2002 231 236
mrcbU67 Ramík J. 340