bibtype |
J -
Journal Article
|
ARLID |
0490178 |
utime |
20240103220111.8 |
mtime |
20180611235959.9 |
SCOPUS |
84857716089 |
WOS |
000300845900001 |
DOI |
10.1109/TIT.2011.2178139 |
title
(primary) (eng) |
On Bregman Distances and Divergences of Probability Measures |
specification |
page_count |
12 s. |
media_type |
P |
|
serial |
ARLID |
cav_un_epca*0256723 |
ISSN |
0018-9448 |
title
|
IEEE Transactions on Information Theory |
volume_id |
58 |
volume |
3 (2012) |
page_num |
1277-1288 |
publisher |
name |
Institute of Electrical and Electronics Engineers |
|
|
keyword |
classification |
keyword |
divergences |
keyword |
Bregman distances |
author
(primary) |
ARLID |
cav_un_auth*0213977 |
name1 |
Stummer |
name2 |
W. |
country |
DE |
|
author
|
ARLID |
cav_un_auth*0101218 |
full_dept (cz) |
Stochastická informatika |
full_dept |
Department of Stochastic Informatics |
department (cz) |
SI |
department |
SI |
name1 |
Vajda |
name2 |
Igor |
institution |
UTIA-B |
fullinstit |
Ústav teorie informace a automatizace AV ČR, v. v. i. |
|
source |
|
cas_special |
research |
CEZ:AV0Z1075907 |
abstract
(eng) |
This paper introduces scaled Bregman distances of probability distributions which admit nonuniform contributions of observed events. They are introduced in a general form covering not only the distances of discrete and continuous stochastic observations, but also the distances of random processes and signals. It is shown that the scaled Bregman distances extend not only the classical ones studied in the previous literature, but also the information divergence and the related wider class of convex divergences of probability measures. An information-processing theorem is established too, but only in the sense of invariance w.r.t. statistically sufficient transformations and not in the sense of universal monotonicity. Pathological situations where coding can increase the classical Bregman distance are illustrated by a concrete example. In addition to the classical areas of application of the Bregman distances and convex divergences such as recognition, classification, learning, and evaluation of proximity of various features and signals, the paper mentions a new application in 3-D exploratory data analysis. Explicit expressions for the scaled Bregman distances are obtained in general exponential families, with concrete applications in the binomial, Poisson, and Rayleigh families, and in the families of exponential processes such as the Poisson and diffusion processes including the classical examples of the Wiener process and geometric Brownian motion. |
result_subspec |
WOS |
RIV |
IN |
FORD0 |
20000 |
FORD1 |
20200 |
FORD2 |
20205 |
reportyear |
2019 |
num_of_auth |
2 |
inst_support |
RVO:67985556 |
permalink |
http://hdl.handle.net/11104/0284542 |
confidential |
S |
mrcbT16-e |
COMPUTERSCIENCEINFORMATIONSYSTEMS|ENGINEERINGELECTRICALELECTRONIC |
mrcbT16-f |
3.069 |
mrcbT16-g |
0.517 |
mrcbT16-h |
9.2 |
mrcbT16-i |
0.05617 |
mrcbT16-j |
1.378 |
mrcbT16-k |
28851 |
mrcbT16-l |
497 |
mrcbT16-q |
176 |
mrcbT16-s |
2.468 |
mrcbT16-y |
29.65 |
mrcbT16-x |
3.82 |
mrcbT16-4 |
Q1 |
mrcbT16-B |
92.68 |
mrcbT16-C |
89.574 |
mrcbT16-D |
Q1* |
mrcbT16-E |
Q1* |
arlyear |
2012 |
mrcbU14 |
84857716089 SCOPUS |
mrcbU24 |
PUBMED |
mrcbU34 |
000300845900001 WOS |
mrcbU63 |
cav_un_epca*0256723 IEEE Transactions on Information Theory 0018-9448 1557-9654 Roč. 58 č. 3 2012 1277 1288 Institute of Electrical and Electronics Engineers |
|