Emerging frameworks for advancing scientific workflows research, development, and education

Henri Casanova; Ewa Deelman; Sandra Gesing; Michael D. Hildreth; Stephen Hudson; William Koch; Jeffrey Larson; Mary Ann McDowell; Natalie Meyers; John-Luke Navarro; George Papadimitriou; Ryan Tanaka; Ian J. Taylor; Douglas Thain; Stefan M. Wild; Rosa Filgueira; Rafael Ferreira da Silva

doi:10.1109/WORKS54523.2021.00015

Emerging frameworks for advancing scientific workflows research, development, and education

Henri Casanova, Ewa Deelman, Sandra Gesing, Michael D. Hildreth, Stephen Hudson, William Koch, Jeffrey Larson, Mary Ann McDowell, Natalie Meyers, John-Luke Navarro, George Papadimitriou, Ryan Tanaka, Ian J. Taylor, Douglas Thain, Stefan M. Wild, Rosa Filgueira, Rafael Ferreira da Silva

School of Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Lightning talks of the Workflows in Support of Large-Scale Science (WORKS) workshop are a venue where the workflow community (researchers, developers, and users) can discuss work in progress, emerging technologies and frameworks, and training and education materials. This paper summarizes the WORKS 2021 lightning talks, which cover four broad topics: (i) libEnsemble, a Python library to coordinate the concurrent evaluation of dynamic ensembles of calculations; (ii) Edu WRENCH, a set of online pedagogic modules that provides simulation-driven hands-on activity in the browser; (iii) VisDict, an envisioned visual dictionary framework that will translate terms, jargon, and concepts between research domains and workflow providers; and (iv) Pegasus Kickstart, a lightweight tool for capturing workflow tasks' performance, including performance metrics from Nvidia GPUs.

Original language	English
Title of host publication	Proceedings of WORKS21
Subtitle of host publication	16th Workshop on Workflows in Support of Large-scale Science
Editors	Rafael Ferreira da Silva, Rosa Filgueira
Place of Publication	Piscataway, NJ
Publisher	IEEE
Pages	74-80
Number of pages	7
ISBN (Electronic)	9781665411363
ISBN (Print)	9781665411370
DOIs	https://doi.org/10.1109/WORKS54523.2021.00015
Publication status	Published - 28 Dec 2021
Event	The International Conference for High Performance Computing, Networking, Storage and Analysis - America's Center, St. Louis, United States Duration: 14 Oct 2021 → 19 Oct 2021 http://sc21.supercomputing.org

Conference

Conference	The International Conference for High Performance Computing, Networking, Storage and Analysis
Abbreviated title	SC21
Country/Territory	United States
City	St. Louis
Period	14/10/21 → 19/10/21
Internet address	http://sc21.supercomputing.org

Keywords

GPU
Monitoring
Scientific workflows
Training and education
Ensembles
Python
Concurrent computing
Numerical optimization
Simulation
Nvidia

Access to Document

10.1109/WORKS54523.2021.00015

Cite this

Casanova, H., Deelman, E., Gesing, S., Hildreth, M. D., Hudson, S., Koch, W., Larson, J., McDowell, M. A., Meyers, N., Navarro, J.-L., Papadimitriou, G., Tanaka, R., Taylor, I. J., Thain, D., Wild, S. M., Filgueira, R., & Silva, R. F. D. (2021). Emerging frameworks for advancing scientific workflows research, development, and education. In R. F. da Silva, & R. Filgueira (Eds.), Proceedings of WORKS21: 16th Workshop on Workflows in Support of Large-scale Science (pp. 74-80). IEEE. https://doi.org/10.1109/WORKS54523.2021.00015

@inproceedings{b9e722c946f14cd6911801b66ead69d5,

title = "Emerging frameworks for advancing scientific workflows research, development, and education",

abstract = "Lightning talks of the Workflows in Support of Large-Scale Science (WORKS) workshop are a venue where the workflow community (researchers, developers, and users) can discuss work in progress, emerging technologies and frameworks, and training and education materials. This paper summarizes the WORKS 2021 lightning talks, which cover four broad topics: (i) libEnsemble, a Python library to coordinate the concurrent evaluation of dynamic ensembles of calculations; (ii) Edu WRENCH, a set of online pedagogic modules that provides simulation-driven hands-on activity in the browser; (iii) VisDict, an envisioned visual dictionary framework that will translate terms, jargon, and concepts between research domains and workflow providers; and (iv) Pegasus Kickstart, a lightweight tool for capturing workflow tasks' performance, including performance metrics from Nvidia GPUs.",

keywords = "GPU, Monitoring, Scientific workflows, Training and education, Ensembles, Python, Concurrent computing, Numerical optimization, Simulation, Nvidia",

author = "Henri Casanova and Ewa Deelman and Sandra Gesing and Hildreth, {Michael D.} and Stephen Hudson and William Koch and Jeffrey Larson and McDowell, {Mary Ann} and Natalie Meyers and John-Luke Navarro and George Papadimitriou and Ryan Tanaka and Taylor, {Ian J.} and Douglas Thain and Wild, {Stefan M.} and Rosa Filgueira and Silva, {Rafael Ferreira da}",

year = "2021",

month = dec,

day = "28",

doi = "10.1109/WORKS54523.2021.00015",

language = "English",

isbn = "9781665411370",

pages = "74--80",

editor = "{da Silva}, {Rafael Ferreira} and Rosa Filgueira",

booktitle = "Proceedings of WORKS21",

publisher = "IEEE",

note = "The International Conference for High Performance Computing, Networking, Storage and Analysis, SC21 ; Conference date: 14-10-2021 Through 19-10-2021",

url = "http://sc21.supercomputing.org",

}

Casanova, H, Deelman, E, Gesing, S, Hildreth, MD, Hudson, S, Koch, W, Larson, J, McDowell, MA, Meyers, N, Navarro, J-L, Papadimitriou, G, Tanaka, R, Taylor, IJ, Thain, D, Wild, SM, Filgueira, R & Silva, RFD 2021, Emerging frameworks for advancing scientific workflows research, development, and education. in RF da Silva & R Filgueira (eds), Proceedings of WORKS21: 16th Workshop on Workflows in Support of Large-scale Science. IEEE, Piscataway, NJ, pp. 74-80, The International Conference for High Performance Computing, Networking, Storage and Analysis, St. Louis, Missouri, United States, 14/10/21. https://doi.org/10.1109/WORKS54523.2021.00015

Emerging frameworks for advancing scientific workflows research, development, and education. / Casanova, Henri; Deelman, Ewa; Gesing, Sandra et al.
Proceedings of WORKS21: 16th Workshop on Workflows in Support of Large-scale Science. ed. / Rafael Ferreira da Silva; Rosa Filgueira. Piscataway, NJ: IEEE, 2021. p. 74-80.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Emerging frameworks for advancing scientific workflows research, development, and education

AU - Casanova, Henri

AU - Deelman, Ewa

AU - Gesing, Sandra

AU - Hildreth, Michael D.

AU - Hudson, Stephen

AU - Koch, William

AU - Larson, Jeffrey

AU - McDowell, Mary Ann

AU - Meyers, Natalie

AU - Navarro, John-Luke

AU - Papadimitriou, George

AU - Tanaka, Ryan

AU - Taylor, Ian J.

AU - Thain, Douglas

AU - Wild, Stefan M.

AU - Filgueira, Rosa

AU - Silva, Rafael Ferreira da

PY - 2021/12/28

Y1 - 2021/12/28

N2 - Lightning talks of the Workflows in Support of Large-Scale Science (WORKS) workshop are a venue where the workflow community (researchers, developers, and users) can discuss work in progress, emerging technologies and frameworks, and training and education materials. This paper summarizes the WORKS 2021 lightning talks, which cover four broad topics: (i) libEnsemble, a Python library to coordinate the concurrent evaluation of dynamic ensembles of calculations; (ii) Edu WRENCH, a set of online pedagogic modules that provides simulation-driven hands-on activity in the browser; (iii) VisDict, an envisioned visual dictionary framework that will translate terms, jargon, and concepts between research domains and workflow providers; and (iv) Pegasus Kickstart, a lightweight tool for capturing workflow tasks' performance, including performance metrics from Nvidia GPUs.

AB - Lightning talks of the Workflows in Support of Large-Scale Science (WORKS) workshop are a venue where the workflow community (researchers, developers, and users) can discuss work in progress, emerging technologies and frameworks, and training and education materials. This paper summarizes the WORKS 2021 lightning talks, which cover four broad topics: (i) libEnsemble, a Python library to coordinate the concurrent evaluation of dynamic ensembles of calculations; (ii) Edu WRENCH, a set of online pedagogic modules that provides simulation-driven hands-on activity in the browser; (iii) VisDict, an envisioned visual dictionary framework that will translate terms, jargon, and concepts between research domains and workflow providers; and (iv) Pegasus Kickstart, a lightweight tool for capturing workflow tasks' performance, including performance metrics from Nvidia GPUs.

KW - GPU

KW - Monitoring

KW - Scientific workflows

KW - Training and education

KW - Ensembles

KW - Python

KW - Concurrent computing

KW - Numerical optimization

KW - Simulation

KW - Nvidia

UR - https://doi.org/10.1109/WORKS54523.2021

U2 - 10.1109/WORKS54523.2021.00015

DO - 10.1109/WORKS54523.2021.00015

M3 - Conference contribution

SN - 9781665411370

SP - 74

EP - 80

BT - Proceedings of WORKS21

A2 - da Silva, Rafael Ferreira

A2 - Filgueira, Rosa

PB - IEEE

CY - Piscataway, NJ

T2 - The International Conference for High Performance Computing, Networking, Storage and Analysis

Y2 - 14 October 2021 through 19 October 2021

ER -

Emerging frameworks for advancing scientific workflows research, development, and education

Abstract

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this