HPSS User Forum 2017

16 Oct 2017, 08:00 → 20 Oct 2017, 15:00 Asia/Tokyo

Seminar Hall (KEK Building K03)

Takashi Sasaki (KEK)

HPSS User Forum 2017

HUF2017 will take place from Monday October 16th to Friday October 20th, 2017 in KEK, Tsukuba - Japan.

The HPSS User Forum (HUF) is the annual gathering of the HPSS community, bringing together new and existing HPSS users from around the globe to discuss best practices for managing, operating, monitoring and supporting HPSS installations. Attendees will include technologists, researchers, faculty, postdocs, business and industry representatives involved in the development, implementation, and management of HPSS software.

 

 

Slides huf_information.pdf

Monday, 16 October

08:00 → 09:00 Registration

09:00 → 10:00 Joint Plenary: Common session of HEPiX, HUF and LHCOPN/LHCONE

Joint session with HEPiX

Convener: Atsushi Manabe (KEK/CRC)

09:00 Welcome to KEK

Speaker: Yasuhiro Okada (KEK)

Slides hepix2017fall-okada.pdf

09:20 Logistics information

Speakers: Takashi Sasaki (KEK), Tomoaki Nakamura (KEK)

Slides 2017-10-16_TomoakiNakamura.pdf

09:30 The HEPiX workshop series

Slides 2017-10-16-IntroductionToHEPiX.pdf

09:40 LHCOPN and LHCONE

Speaker: Edoardo Martelli (CERN)

Slides HEPIX17-20171016-LHCOPNE-introduction.pdf

09:50 The HPSS User Forum

Speaker: Jim Gerry (IBM)

Slides HUF-Intro.pdf

10:00 → 10:30 Keynote

10:00 Particulate magnetic tape for data storage and future technologies

Enterprise tape drives are widely used at major laboratories in the world, such as CERN, US DoE Labs, KEK and so on as well as data centers in commercial companies. Demands on capacity and speed of I/O inflate infinitely in the tape market. Not only drive technology but also media technology is the key for answering such future requirements. Fujifilm is the world-leading company in the market of magnetic tape media, and has played a major role for evolution of tape technologies in decades. Secure digital data storage sustainable in very long duration with lower costs is the concern of data centers. Particulate magnetic tapes on linear tape storage systems have been widely used for data backup and archival because of their low TCO, long-term stability, and high reliability. However, in order to meet the further demand, expanding the recording capacity of tape storage is essential. Currently, tape cartridges with a capacity of up to 10 TB are available commercially, and the future roadmap of tape storage systems shows to expand the cartridge capacity to 120 TB. To realize this, technologies to increase the areal density of magnetic tape are required. For this purpose, high-density recording studies using barium ferrite (BaFe) magnetic particles have been carried out. The latest study demonstrated an areal density of 123 Gb/in2, corresponding to a 220 TB cartridge capacity in 2015. Furthermore, fine strontium ferrite (SrFe) magnetic particles, which are almost half the size of the current BaFe particles, were also developed; therefore, magnetic tapes are the most effective data storage media to continue enhancing the recording capacity at a low TCO in long-term future.

Speaker: Mr Masahito Oyanagi (Recording Media Research Laboratories, Fujifilm Corporation)

Slides Fujifilm.pdf

10:30 → 11:00 Coffee break

11:00 → 12:30 HPSS updates

Convener: Koichi MURAKAMI

11:00 HPSS Support Update

Speaker: Thuy Tran (IBM)

Slides HUF_2017_Deployment_&_Support,_final.pdf

11:30 HPSS Software Development Update [Restricted]

Speaker: Michael Meseke (IBM)

12:30 → 14:00 Lunch

13:30 → 13:55 Sponsor session

13:30 Sony Optical Archive

Speaker: Horst Schellong (Sony Optical Archive)

Slides Sony-OAI.pdf

14:00 → 15:30 HPSS planning

Convener: Koichi MURAKAMI

14:00 Planning for HPSS 7.5.1

Speaker: Jon Procknow

Slides HPSS751UpgradeHUF2017final.pdf

14:45 HPSS 7.5.2 Feature Deep Dive

Speaker: Michael Meseke (IBM)

Slides HPSS_752_Update_Final.pdf

15:30 → 16:00 Coffee break

16:00 → 17:00 Site reports

Convener: Koichi MURAKAMI

16:00 NCAR Tools to Help Manage HPSS

In this presentation, we'll share details about several tools that NCAR has developed over the years that help us manage HPSS and that may help other sites. The tools include ones for monitoring, tracking tapes and managing the disk cache. The presentation will describe the tools and how they've helped NCAR.

Speaker: William Anderson (National Center for Atmospheric Research)

Slides HUF-2017.pdf HUF-2017.pptx

16:30 HSI/HTAR Support Transition Update

LBNL/NERSC has entered into a transitional support agreement with Gleicher Enterprises, LLC, on behalf of the HPSS Collaboration, to provide continued user support for HSI and HTAR. This talk will give an overview of the transitional HSI/HTAR support model. Topics include a description of the current agreement with LBNL/NERSC, how to get HSI/HTAR support under this agreement, and terms of the proposed HSI/HTAR support transition to the HPSS TC.

Speaker: Nicholas Balthaser (Lawrence Berkeley National Lab/NERSC)

Slides HSI_HTAR-support-update-HUF2017.pdf

19:00 → 22:00 Banquet

Jananese traditional cuisine

Convener: Prof. Takashi Sasaki

Tuesday, 17 October

08:30 → 09:00 Registration

09:00 → 09:45 DB2 and QRep

Convener: Koichi MURAKAMI

09:00 Future Planning Considerations for DB2 and QRep [Restricted]

Speaker: Dave BoomerDave (IBM)

09:45 → 10:30 Sponsor session

Convener: Koichi MURAKAMI

09:45 Spectra Logic

Speaker: Matthew T. Starr (Spectra Logic)

10:30 → 11:00 Coffee break

11:00 → 12:30 HPSS advanced & web

Convener: Koichi MURAKAMI

11:00 HPSS Treefrog interface for data management and integration with heterogenous storage

Speaker: Alan Giddens (IBM)

Slides TreeFrog_HUF_2017_Final.pdf

12:00 HPSS Collaboration Website Review

Speaker: Jim Gerry (IBM)

Slides HPSS_web_site.pdf HPSS_web_site.pptx

12:30 → 14:00 Lunch

13:30 → 13:55 Sponsor session

13:30 DDN

Speaker: Ray Akimoto (DDN)

Slides HUF2017_Public.pdf

14:00 → 15:30 Site reports

Convener: Koichi MURAKAMI

14:00 Feedback on TREQS-2, the new IN2P3 prestaging tools

IN2P3 Computing Center is one of the 14 major datacenters for the storage and the processing of the CERN – LHC physics data. IN2P3 also provides such resources and support for the most important physics and astrophysics experiments (VIRGO, CTA, LSST). Most of the data are stored on tapes on HPSS. To sustain efficiently the recalls activities between HPSS and DCache/Xrootd disks, IN2P3 developed in 2009 a staging product. This product is called TReqs, for Tape Request Scheduler. In 2015 we started a full rewrite of the software in order to improve the performances and the functionalities. TREQS 2 has been in production at IN2P3 for many months. This presentation will focus on the functionality of TREQS-2, the way use it it is used in production and the evolution plan for the next years.

Speaker: Pierre-Emmanuel Brinette (IN2P3)

Slides HUF_2017_IN2P3_TREQS2_Final.pdf

14:30 Globus Online services HPSS

Globus Online is a powerful, reliable, and secure file transfer service with the underlying technology of GridFTP. A simple web interface lets users select the source and destination endpoints and the data movement directions as user’s will. Globus Online supports variety of storage formats. With specific designed HPSS Data Storage Interface (DSI) module, it can move data between disk and HPSS storage, as well as between different HPSS storage through the network. This presentation will provide a user case Proof of Concept, using Globus Online as a HPSS client interface to transfer data crossing multi endpoints on the ESnet test facilities.

Speaker: Guangwei Che (BNL)

Slides Globus_online_service_HPSS-BNL.pdf

15:30 → 16:00 Coffee break

16:00 → 17:00 BOF

Convener: Francis Dequenne (ECMWF)

Wednesday, 18 October

08:00 → 18:00 Excursion: Nikko tour

Nikko tour

Convener: Koichi MURAKAMI

Thursday, 19 October

08:30 → 09:00 Registration

09:00 → 10:30 Burning issues

Convener: Jon PROCKNOW (IBM)

09:00 HUF Burning Issues Review

Speaker: Jon Procknow (IBM)

Slides HUF_2017_BI_Update_Final.pdf

09:45 Discussion

10:30 → 11:00 Coffee break

11:00 → 12:30 HPSS logging & Tape products

Convener: Koichi MURAKAMI

11:00 Deep Dive for HPSS 7.5.2 Logging

Speakers: Jon Procknow (IBM), Michael Meseke (IBM)

Slides CR375_2017_Final.pdf

11:40 IBM tapee product updates

Speakers: Ed Childers (IBM), Lee Jesionowski (IBM)

Slides IBM_Tape_Products_for_HUF_2017_-_20171019.pdf

12:30 → 14:00 Lunch

13:30 → 13:55 Sponsor session

13:30 Lenovo Enterprise Solutions

Speaker: Noriyasu Murata (Lenovo Enterprise Solutions)

Slides Lenovo-Web.PDF

14:00 → 15:30 Site reports

Convener: Koichi MURAKAMI

14:00 JAXA Site Presentation -Reliability of Data Management-

In recent years, large and/or unknown storage failures have occurred on JAXA's supercomputer. In HUF2015 we reported silent data corruption on JAXA supercomputer file system. This year we experienced file system failures on supercomputer file system two times, one HPSS cache disk failure, and one-pair HPSS tape read error. Are these storage system reliable? Should we change our system design and/or operation policy?

Speaker: Naoyuki Fujita (JAXA)

Slides HUF2017_JAXA_Updated.pdf

14:30 KEK site report

Speaker: Koichi Murakami (KEK)

Slides KEK_HUF2017.pdf

15:30 → 16:00 Coffee break

19:00 → 22:00 Banquet

Jananese traditional cuisine

Convener: Prof. Takashi Sasaki

Friday, 20 October

09:00 → 10:30 Future discussion

Convener: Koichi MURAKAMI

09:00 HPSS Collaboration Development Executive Committee Overview

This talk will briefly review the 25 year history of the HPSS Collaboration, the role of the HPSS Executive and Technical Committees, the DOE development laboratories' high-performance computing five year plans, and HPSS plans for the next five years.

Speaker: Richard Watson (Lawrence Livermore National Laboratory)

Slides HUF2017_EC_Talk_Final.pdf

09:30 Discission

10:30 → 11:00 Coffee break

11:00 → 12:00 Closing remark

Convener: Koichi MURAKAMI

11:00 HUF2018

11:10 Closing

Speaker: Takashi Sasaki (KEK)

12:00 → 13:00 Lunch

13:00 → 14:30 KEK facility visit