An approach to cluster system task flow monitoring, analysis, and visualization
Keywords:parallel computing, monitoring, tasks flow, computing cluster
Big cluster systems are spreading wide, so that the efficiency of use of such systems is a very actual task for now. In order to solve this task, it is needed to identify the efficiency problems appearing during the task execution, to notify users about appeared problems, and to suggest possible ways to resolve them. This can be achieved by the continuous monitoring of running tasks and by data analysis. This paper discusses an approach to solve these tasks and describes a working prototype.
- Hewitt E. Cassandra: the definitive guide. Cambridge: O’Reilly Media, 2010.
- White T. Hadoop: the definitive guide. Cambridge: O’Reilly Media, 2009.
- Pig project (http://pig.apache.org/).