Table of Contents
T2.2. GRID monitoring tools
Task coordinator : Yu. Ryabov, belonging to team: PNPI
Objectives :
Creation of a tool providing users with access to detailed application information in the framework of the GRID paradigm and test it in LCG. Thisshould improve the standard monitoring facilities in existing GRID middleware which allow controlling jobs very roughly. While an application job during its processing records specific information which may be important or even crucial for the user, the delivery of such specific information to users through theGRID is not possible in existing GRIDs.
Development of monitoring tools that produce integrated characteristics by use of statistical information gathered from various GRID elements. This service should improve the LCG usability, performance, quality of service, etc.
Methodology :
Use the knowledge about principles of GRID operation and architecture. Apply the modern programming technique based on Object-Oriented approach and database management.
Knowledge of GRID architecture and interaction of the GRID components is a key point to reach the objectives.
Task Input:
The task is depending on : Deployment of LCG for creating Russian GRID segment
Experience in programming C/C++ languages and scripting languages Shell and Perl. Experience in design and development of large program system in GRID environment.
Result, milestones :
RESULTS EXPECTED:
Publication in national and international journals, reports on the conferences.
Milestones of the task research program are indicated in the subtask description.
DELIVERABLES:
Program code and User manual.
T2.1. Monitoring of application jobs
Subtask coordinator : A. Kryukov, belonging to team: SINP-MSU
Other participants: V. Edneral, L. Stepanova and V. Kalyaev (all SINP-MSU), A. Minaenko and A. Filine (both IHEP), A. Soukharev (BINP), N. Smirnov (INFN-Padova)
Objectives :
Standard monitoring facilities in existing GRID middleware allow controlling jobs very roughly. User is able to inquire only if the job is scheduled, started, finished and canceled. However, during processing the application job records specific information, and this information could be important or even crucial for the user. It is not a problem to get this information if the job is started locally. However, the delivery of such specific information to users through the GRID is not possible in existing GRIDs. We propose to create a tool providing users with access to this specific application information in the framework of the GRID paradigm and test it in LCG.
Methodology :
Use the knowledge about principles of GRID operation and architecture. Apply the modern programming technique based on Object-Oriented approach and database management.
Task Input:
Experience in programming C/C++ languages and scripting languages Shell and Perl. The subtask members have an good experience in design and development of large program system in GRID environment.
Result, milestones :
MILESTONES:
- Study of requirements of application for their monitoring and design general scheme of tools, Feb. 2004 - June 2004;
- Development preliminary version of tools, July 2004 - Dec. 2004;
- Testing and preparing final version of tools, writing User manual, Jan. 2005 - Nov. 2005
RESULTS EXPECTED:
Publication in national and international journals, reports on conferences.
DELIVERABLES:
Program code and User manual.
T2.2. Monitoring of the GRID infrastructure state
Subtask coordinator : Yu. Ryabov, belonging to team: PNPI
Other participants: S. Oleshko and A. Kiryanov (both PNPI), V. Pose (JINR), V. Kolosov (ITEP), Yu. Lazin (IHEP)
Objectives :
Development of monitoring tools that produce integrated characteristics by use of statistical information gathered from various GRID elements. It will be based on an existing GRID information services and will be added with online databases, web-based interfaces, advanced analysis and prediction algorithms for resource qualification. This service should improve the LCG usability, performance, quality of service, etc.
Methodology :
Investigation of the real time GRID resource attributes changes (the GRID resource 'behavior' in different conditions). Development of the database structure. Software will be written on highly portable languages (perl, sql). Web-based user interface will be developed. Use of link Russia-CERN and personal visits for communications with IT team.
Task Input:
Initial developments will be made on existing GRID (EDG) testbeds. Later on we shall use Russian segment of the LCG infrastructure.
Result, milestones :
MILESTONES
- Study of the types of the monitoring information which is needed to be gathered. Development of architecture of monitoring tools, July 2004 - Dec 2004;
- Development of first version of the tools, Jan. 2005 - May 2005;
- Testing and preparing final version of the tools. Writing User manual, June 2005 - Dec. 2005.
RESULTS EXPECTED:
The result of our activity is the complete software suite for statistical monitoring which will include the monitoring agents, database, statistical analysis program and several front-ends (web interface, APIs). Statistical information could be used by GRID end-users and resource brokers to qualify the elements by durability and accessibility for GRID applications as well as for a long-term estimation of the resource load.
DELIVERABLES:
As deliverables we plan computer programs, database with the monitoring data, report and publications.