bibtype J - Journal Article
ARLID 0559729
utime 20250310150020.9
mtime 20220808235959.9
SCOPUS 85132945410
WOS 000827395000014
DOI 10.1016/j.knosys.2022.108875
title (primary) (eng) Transferring model structure in Bayesian transfer learning for Gaussian process regression
specification
page_count 12 s.
media_type P
serial
ARLID cav_un_epca*0257173
ISSN 0950-7051
title Knowledge-Based System
volume_id 251
publisher
name Elsevier
keyword Bayesian transfer learning (BTL)
keyword Multitask learning
keyword Local and global modelling
keyword Fully probabilistic design
keyword Incomplete modelling
keyword Gaussian process regression
author (primary)
ARLID cav_un_auth*0370767
name1 Papež
name2 Milan
institution UTIA-B
full_dept (cz) Adaptivní systémy
full_dept (eng) Department of Adaptive Systems
department (cz) AS
department (eng) AS
country CZ
fullinstit Ústav teorie informace a automatizace AV ČR, v. v. i.
author
ARLID cav_un_auth*0370768
name1 Quinn
name2 Anthony
institution UTIA-B
full_dept (cz) Adaptivní systémy
full_dept Department of Adaptive Systems
department (cz) AS
department AS
country IE
fullinstit Ústav teorie informace a automatizace AV ČR, v. v. i.
source
url http://library.utia.cas.cz/separaty/2022/AS/papez-0559729.pdf
source
url https://www.sciencedirect.com/science/article/pii/S095070512200418X?via%3Dihub
cas_special
project
project_id GA18-15970S
agency GA ČR
country CZ
ARLID cav_un_auth*0362986
abstract (eng) Bayesian transfer learning (BTL) is defined in this paper as the task of conditioning a target probability distribution on a transferred source distribution. The target globally models the interaction between the source and target, and conditions on a probabilistic data predictor made available by an independent local source modeller. Fully probabilistic design is adopted to solve this optimal decision-making problem in the target. By successfully transferring higher moments of the source, the target can reject unreliable source knowledge (i.e. it achieves robust transfer). This dual-modeller framework means that the source’s local processing of raw data into a transferred predictive distribution – with compressive possibilities – is enriched by (the possible expertise of) the local source model. In addition, the introduction of the global target modeller allows correlation between the source and target tasks – if known to the target – to be accounted for. Important consequences emerge. Firstly, the new scheme attains the performance of fully modelled (i.e. conventional) multitask learning schemes in (those rare) cases where target model misspecification is avoided. Secondly, and more importantly, the new dual-modeller framework is robust to the model misspecification that undermines conventional multitask learning. We thoroughly explore these issues in the key context of interacting Gaussian process regression tasks. Experimental evidence from both synthetic and real data settings validates our technical findings: that the proposed BTL framework enjoys robustness in transfer while also being robust to model misspecification.
result_subspec WOS
RIV BD
FORD0 10000
FORD1 10200
FORD2 10201
reportyear 2023
num_of_auth 2
mrcbC52 2 R hod 4 4rh 4 20250310142813.8 4 20250310150020.9
inst_support RVO:67985556
permalink https://hdl.handle.net/11104/0333424
confidential S
article_num 108875
mrcbC86 n.a. Article Computer Science Artificial Intelligence
mrcbC91 C
mrcbT16-e COMPUTERSCIENCEARTIFICIALINTELLIGENCE
mrcbT16-j 1.443
mrcbT16-s 2.065
mrcbT16-D Q2
mrcbT16-E Q1
arlyear 2022
mrcbTft \nSoubory v repozitáři: papez-0559729.pdf
mrcbU14 85132945410 SCOPUS
mrcbU24 PUBMED
mrcbU34 000827395000014 WOS
mrcbU63 cav_un_epca*0257173 Knowledge-Based System 0950-7051 1872-7409 Roč. 251 č. 1 2022 Elsevier