TY - JOUR
T1 - Refactoring the Monolith Workflow into Independent Micro-Workflows to Support Stream Processing
AU - Alaasam, Ameer Basim Abdulameer
AU - Radchenko, Gleb
AU - Tchernykh, Andrei Nikolaevitch
PY - 2021
Y1 - 2021
N2 - In modern scientific computing, the scientific workflow (SWF) is considered an essential tool for the description and implementation of complex applications. The workflow application is described as a directed acyclic graph (DAG) of tasks (vertices) with I/O data flow (edges) between them. However, this approach does not support the ability to handle data streams from different IoT sources, nor does it support independent deployment and scaling of individual computing tasks. One approach to optimizing a SWF is to partition it into multiple stages, but the implementation is complicated by the tight coupling relationship between the vertices. In the article, we propose Micro-Workflows (MWF) algorithms which automatically separate the partitioned monolith workflow into a set of independent smaller workflows called MWF by refactoring the edges between the vertices.
AB - In modern scientific computing, the scientific workflow (SWF) is considered an essential tool for the description and implementation of complex applications. The workflow application is described as a directed acyclic graph (DAG) of tasks (vertices) with I/O data flow (edges) between them. However, this approach does not support the ability to handle data streams from different IoT sources, nor does it support independent deployment and scaling of individual computing tasks. One approach to optimizing a SWF is to partition it into multiple stages, but the implementation is complicated by the tight coupling relationship between the vertices. In the article, we propose Micro-Workflows (MWF) algorithms which automatically separate the partitioned monolith workflow into a set of independent smaller workflows called MWF by refactoring the edges between the vertices.
UR - https://link.springer.com/article/10.1134/S0361768821080077
U2 - 10.1134/S0361768821080077
DO - 10.1134/S0361768821080077
M3 - Article
SN - 0361-7688
VL - 47
SP - 591
EP - 600
JO - Programming and Computer Software
JF - Programming and Computer Software
ER -