| bibtype |
A -
Abstract
|
| ARLID |
0640701 |
| utime |
20260203091543.9 |
| mtime |
20251031235959.9 |
| DOI |
10.5281/zenodo.15854639 |
| title
(primary) (eng) |
Fault Detection Using Reinforcement Learning |
| specification |
| page_count |
1 s. |
| media_type |
E |
|
| serial |
| title
|
Quantum Information and Decision Making in Life Sciences: Book of Abstracts |
| part_title |
Fault Detection Using Reinforcement Learning |
| page_num |
20-20 |
| publisher |
| place |
Prague |
| name |
Czech University of Life Sciences Prague |
| year |
2025 |
|
| editor |
| name1 |
Guy |
| name2 |
Tatiana Valentine |
|
| editor |
| name1 |
Pelikán |
| name2 |
Martin |
|
| editor |
| name1 |
Kárný |
| name2 |
Miroslav |
|
| editor |
|
| editor |
| name1 |
Ružejnikov |
| name2 |
Jurij |
|
| editor |
|
|
| keyword |
Reinforcement Learning |
| keyword |
Fault Detection |
| keyword |
Markov Decision Processes |
| author
(primary) |
| ARLID |
cav_un_auth*0483444 |
| name1 |
Jedlička |
| name2 |
Adam |
| institution |
UTIA-B |
| full_dept (cz) |
Adaptivní systémy |
| full_dept (eng) |
Department of Adaptive Systems |
| department (cz) |
AS |
| department (eng) |
AS |
| country |
CZ |
| share |
100 |
| fullinstit |
Ústav teorie informace a automatizace AV ČR, v. v. i. |
|
| source |
|
| cas_special |
| project |
| project_id |
CA21169 |
| agency |
EU-COST |
| country |
XE |
| ARLID |
cav_un_auth*0452289 |
|
| abstract
(eng) |
A wide variety of tasks including modeling biological problems can be modeled by Markov Decision Process (MDP). Reinforcement learning (RL) is an approach to solving MDP. In RL the agent learns to make the optimal actions by using feedback (reinforcement) signal. Due to its ability to handle dynamic environments with high uncertainty, RL has been successfully applied to various biological problems: generating novel molecular structures in drug discovery [1], predicting protein folding [2], etc. A very basic application of MDP terms in the example of the task of discovering new drugs mentioned earlier is as follows. A generative model (agent) learns a series of actions to create new molecules (states) for maximizing a score given by a predefined score function. RL is applied similarly in an example of genome assembly and other tasks in biology. Apart from these tasks, RL can also be used for so-called fault detection. Fault detection (FD) refers to a problem, where there are two or more processes that follow a different mathematical model (for example change of parameter) and the task is to determine which process is followed at the given time (which process generated the data). An example of the utility of FD in biology is highlighted in [3], where a fault is monitored in the "Cad System in E-coli" (CSEC) model. CSEC models localization and dynamics of the pH sensor and transcriptional regulator CadC in cells. Another example is mentioned in [4], where a water treatment process is monitored for faults in order to ensure its stability. It is important to mention, that neither of the above-mentioned articles relating to the usage of FD in biology does not use RL to find faults as it is not a widely used approach. However, while not widely used, it might perform better in certain cases with large datasets. The proposed poster will i) introduce some basic FD methods ii) briefly introduce mechanisms of RL and outline its use for CSEC model [5]. |
| action |
| ARLID |
cav_un_auth*0491465 |
| name |
DYNALIFE 2025 : Conference on QUANTUM INFORMATION AND DECISION MAKING IN LIFE SCIENCES |
| dates |
20250428 |
| mrcbC20-s |
20250429 |
| place |
Prague |
| country |
CZ |
|
| RIV |
BB |
| FORD0 |
10000 |
| FORD1 |
10100 |
| FORD2 |
10101 |
| reportyear |
2026 |
| num_of_auth |
1 |
| presentation_type |
PO |
| permalink |
https://hdl.handle.net/11104/0371109 |
| cooperation |
| ARLID |
cav_un_auth*0322033 |
| name |
Česká zemědělská univerzita v Praze, Provozně ekonomická fakulta |
| institution |
PEF ČZU |
| country |
CZ |
|
| confidential |
S |
| arlyear |
2025 |
| mrcbU02 |
A2 |
| mrcbU14 |
SCOPUS |
| mrcbU24 |
PUBMED |
| mrcbU34 |
WOS |
| mrcbU63 |
Quantum Information and Decision Making in Life Sciences: Book of Abstracts Quantum Information and Decision Making in Life Sciences: Book of Abstracts Fault Detection Using Reinforcement Learning Czech University of Life Sciences Prague 2025 Prague 20 20 |
| mrcbU67 |
Guy Tatiana Valentine 340 |
| mrcbU67 |
Pelikán Martin 340 |
| mrcbU67 |
Kárný Miroslav 340 |
| mrcbU67 |
Gaj Aleksej 340 |
| mrcbU67 |
Ružejnikov Jurij 340 |
| mrcbU67 |
Ruman Marko 340 |
|