Dark Data clearance
From GridPP Wiki
This Page details the plan for clearing dark data
Contents
- 1 Plan
- 2 Evaluate workload between VO and sysadmin
- 3 Current Capabilities
- 4 Ascertain What VO needs from site admin
- 5 Common Format of file from Site
- 6 Site produces
- 7 Convert to format for VO to use?
- 8 Agree schedule for cleanup with VOs/Site Admins
- 9 What work is already being done in other clouds?
- 10 Central co-ordination?
Plan
Evaluate workload between VO and sysadmin
- Speak to VOs about their needs/plans
- ATLAS
- CMS
- Other VOs
Current Capabilities
- What tools do VO already have?
- ATLAS
- CMS
- Other VOS
- What tools/scripts do sys-admin have?
- What is missing?
Ascertain What VO needs from site admin
- Already agreed list of SURLs?
Common Format of file from Site
- Agreed on syncat?
- Alternatives
- Method to create file from SE
- DPM
- StoRM
- dCache
- CASTOR
Site produces
Convert to format for VO to use?
- If different from generally agreed format.
- Converison tool creation
- Who does conversion.
Agree schedule for cleanup with VOs/Site Admins
- Single/rolling campaign
- Periodicity?
- ATLAS
- CMS
- Other VOs
- Once a year
