Scheduling Data-IntensiveWorkflows onto Storage-Constrained Distributed Resources
The work
| Authors | Arun Ramakrishnan; Gurmeet Singh; Henan Zhao; Ewa Deelman; Rizos Sakellariou; Karan Vahi; Kent Blackburn; David Meyers; M. Samidi |
|---|---|
| Editors | |
| Type | misc |
| Year | 2007 |
| Citekey | ramakrishnan2007scheduling |
Where it appeared
| Published in | IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) |
|---|---|
| Pages | 401--409 |
Identifiers
| DOI | 10.1109/ccgrid.2007.101 |
|---|---|
| OpenAlex | W2153829863 |
Access
| Landing page | https://doi.org/10.1109/ccgrid.2007.101 |
|---|
From OpenAlex, which stores abstracts as an index of words and their positions: what is shown is rebuilt from that, and reads fluently whether or not it is what the author wrote.
Abstract
In this paper we examine the issue of optimizing disk usage and of scheduling large-scale scientific workflows onto distributed resources where the workflows are data- intensive, requiring large amounts of data storage, and where the resources have limited storage resources. Our approach is two-fold: we minimize the amount of space a workflow requires during execution by removing data files at runtime when they are no longer required and we schedule the workflows in a way that assures that the amount of data required and generated by the workflow fits onto the individual resources. For a workflow used by gravitational- wave physicists, we were able to improve the amount of storage required by the workflow by up to 57 %. We also designed an algorithm that can not only find feasible solutions for workflow task assignment to resources in disk- space constrained environments, but can also improve the overall workflow performance.
How it got here
| How it got here | agent via openalex |
|---|---|
| Added | 2026-10-29 05:50 UTC |
| Not denied by | a person 2026-10-29 17:12 UTC |
Cite it as
@misc{ramakrishnan2007scheduling,
title = {Scheduling Data-IntensiveWorkflows onto Storage-Constrained Distributed Resources},
author = {Arun Ramakrishnan and Gurmeet Singh and Henan Zhao and Ewa Deelman and Rizos Sakellariou and Karan Vahi and Kent Blackburn and David Meyers and M. Samidi},
year = {2007},
journal = {IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid)},
pages = {401--409},
doi = {10.1109/ccgrid.2007.101},
}
This record lives at https://refs.drheap.org/ramakrishnan2007scheduling/ and will keep doing so.