bibtype J - Journal Article
ARLID 0490178
utime 20240103220111.8
mtime 20180611235959.9
SCOPUS 84857716089
WOS 000300845900001
DOI 10.1109/TIT.2011.2178139
title (primary) (eng) On Bregman Distances and Divergences of Probability Measures
specification
page_count 12 s.
media_type P
serial
ARLID cav_un_epca*0256723
ISSN 0018-9448
title IEEE Transactions on Information Theory
volume_id 58
volume 3 (2012)
page_num 1277-1288
publisher
name Institute of Electrical and Electronics Engineers
keyword classification
keyword divergences
keyword Bregman distances
author (primary)
ARLID cav_un_auth*0213977
name1 Stummer
name2 W.
country DE
author
ARLID cav_un_auth*0101218
full_dept (cz) Stochastická informatika
full_dept Department of Stochastic Informatics
department (cz) SI
department SI
name1 Vajda
name2 Igor
institution UTIA-B
fullinstit Ústav teorie informace a automatizace AV ČR, v. v. i.
source
url http://library.utia.cas.cz/separaty/2012/SI/vajda-0490178.pdf
cas_special
research CEZ:AV0Z1075907
abstract (eng) This paper introduces scaled Bregman distances of probability distributions which admit nonuniform contributions of observed events. They are introduced in a general form covering not only the distances of discrete and continuous stochastic observations, but also the distances of random processes and signals. It is shown that the scaled Bregman distances extend not only the classical ones studied in the previous literature, but also the information divergence and the related wider class of convex divergences of probability measures. An information-processing theorem is established too, but only in the sense of invariance w.r.t. statistically sufficient transformations and not in the sense of universal monotonicity. Pathological situations where coding can increase the classical Bregman distance are illustrated by a concrete example. In addition to the classical areas of application of the Bregman distances and convex divergences such as recognition, classification, learning, and evaluation of proximity of various features and signals, the paper mentions a new application in 3-D exploratory data analysis. Explicit expressions for the scaled Bregman distances are obtained in general exponential families, with concrete applications in the binomial, Poisson, and Rayleigh families, and in the families of exponential processes such as the Poisson and diffusion processes including the classical examples of the Wiener process and geometric Brownian motion.
result_subspec WOS
RIV IN
FORD0 20000
FORD1 20200
FORD2 20205
reportyear 2019
num_of_auth 2
inst_support RVO:67985556
permalink http://hdl.handle.net/11104/0284542
confidential S
mrcbT16-e COMPUTERSCIENCEINFORMATIONSYSTEMS|ENGINEERINGELECTRICALELECTRONIC
mrcbT16-f 3.069
mrcbT16-g 0.517
mrcbT16-h 9.2
mrcbT16-i 0.05617
mrcbT16-j 1.378
mrcbT16-k 28851
mrcbT16-l 497
mrcbT16-q 176
mrcbT16-s 2.468
mrcbT16-y 29.65
mrcbT16-x 3.82
mrcbT16-4 Q1
mrcbT16-B 92.68
mrcbT16-C 89.574
mrcbT16-D Q1*
mrcbT16-E Q1*
arlyear 2012
mrcbU14 84857716089 SCOPUS
mrcbU24 PUBMED
mrcbU34 000300845900001 WOS
mrcbU63 cav_un_epca*0256723 IEEE Transactions on Information Theory 0018-9448 1557-9654 Roč. 58 č. 3 2012 1277 1288 Institute of Electrical and Electronics Engineers