.png)
+ Welcome to the Community Workshop on Practical Reproducibility in HPC
+Join us for a full-day workshop exploring practical + reproducibility in High-Performance Computing (HPC) featuring + keynotes from Torsten Hoefler, Professor of Computer Science at ETH + Zurich, and Kate Keahey, Senior Computer Scientist at Argonne + National Labratory. This event aims to bridge the gap between + theoretical reproducibility and its real-world application in HPC + research.
+Date: Monday, November 18, 2024
+Location: Terminus 330, Atlanta, GA
+Time: 8:30 AM - 6:30 PM ET
+About the Workshop
+There is widespread agreement that adopting practices enabling or facilitating reproducibility of computational results can lead to more robust science and increased scientific productivity. In particular, enabling practical reproducibility, i.e., a practice whereby reproducing results rather than just reading about them becomes a mainstream method of scientific exploration, has the potential to provide a boost to scientific exchange. At the same time, the tools, services, and approaches that best support reproducibility are still a topic of open community debate.
+This workshop aims to provide a forum for this debate and bridge the gap between theoretical reproducibility and its practical application in HPC research. We will bring together researchers, practitioners, and stakeholders to discuss challenges, platforms, tools, and community-driven strategies in reproducible HPC experiments. Sponsored by the NSF-funded Chameleon platform and REPETO project, we aim to foster community practices that make reproducibility a part of mainstream research and education activities in computer science.
+Key Themes
+-
+
- Discuss challenges in HPC reproducibility and artifact evaluation +
- Share experiences and best practices from multiple stakeholder vantage points (authors, reviewers, chairs) +
- Explore innovative solutions for reproducible HPC experiments and enabling platforms +
- Foster community practices that integrate reproducibility into mainstream research and education +
- Establish a repository of exemplar reproducibility artifacts in HPC +
Keynote Highlight: "Reproducing Performance - The Good, the Bad, and the Ugly"
+Torsten Hoefler, Professor of Computer Science at ETH Zurich
+Abstract
+Containers and Jupyter notebooks are useful tools for reproducing computational results of any packaged application. However, if the execution performance or efficiency is the science result, matters are more complex. It may not be sufficient to package codes in containers. In fact, containers may disturb the performance results and reproducibility. We outline a set of techniques to facilitate performance reproducibility in various settings. Some performance results may be linked to specific computer architectures or even specific system configurations that may not be accessible to other researchers or even the original team after a software update. We outline techniques to help researchers interpret results on the original system even if it is practically impossible to reproduce the original results. We discuss such techniques both in the context of pure performance but also in the context of the emerging field of data science and artificial intelligence that often allows for a performance-accuracy tradeoff. All-in-all, our work provides a set of guidelines to follow to support reproducible science of performance and benchmarking.
+Who Should Attend
+-
+
- HPC researchers and practitioners +
- Participants in SC's Reproducibility Initiative +
- Educators interested in reproducibility in HPC education +
- Students and early-career researchers in HPC +
- Anyone interested in advancing reproducibility in computational science +
Workshop Schedule (Tentative)
+Keynote Speakers
+The workshop will feature keynotes on the state of reproducibility in HPC from our distinguished speakers. Additionally, panel discussions with authors and reviewers who have participated in the SC Reproducibility Initiative will share their experiences in creating, evaluating, and ranking HPC artifacts to support reproducibility.
+
+ Kate Keahey
+Kate Keahey is a Senior Computer Scientist at Argonne National Laboratory whose work has been pivotal in making cloud computing accessible and practical for scientific research. Her focus on developing platforms like Chameleon has directly addressed challenges in reproducibility by providing researchers with consistent and shareable computing environments. Her pioneering work on Nimbus and Science Clouds has created the infrastructure for scientists to easily replicate experiments and share data, fostering transparency and collaboration. Her advocacy for open science aligns with the core principles of reproducibility, promoting the availability of data and software for scrutiny and reuse. Kate's expertise in cloud infrastructure and her dedication to open science make her insights invaluable for this workshop. Her work directly contributes to creating practical solutions for reproducible research in HPC, particularly by leveraging cloud technologies for accessible and replicable computational environments.
+
+ Torsten Hoefler
+Torsten Hoefler is a Full Professor of Computer Science at ETH Zurich, whose research is dedicated to advancing high-performance computing. His work on scalable communication systems and performance modeling directly impacts the reproducibility of large-scale computations. His contributions to MPI standards and performance optimization tools have made it easier for researchers to create portable and efficient code, facilitating reproducibility across different HPC systems. His emphasis on open-source software development aligns with the goals of reproducibility, encouraging transparency and collaboration in the HPC community. Torsten's research is directly relevant to addressing the challenges of reproducibility in HPC. His work on performance modeling and communication standards provides practical solutions for ensuring that complex computations can be reliably replicated and validated. His advocacy for open-source tools further supports the transparency and accessibility that are essential for reproducible research.
+See You in Atlanta!
+
+ 
+ Address
+330 Marietta St NW, Atlanta, GA 30313
+The workshop will be held at Terminus 330, a state-of-the-art venue in the heart of Atlanta, GA, conveniently located right around the corner from the Georgia World Congress Center where SC24 is being held (November 17-22, 2024).
+Our Sponsors
+
+ 
+ 
+ About the REPETO Project
+The REPETO (pronounce to rhyme with Geppetto) project is an NSF-funded research coordination network (RCN) that promotes the concept of practical reproducibility. This practice aims to package experiments in a way that allows cost-effective repetition, making them as accessible for exploring research as reading papers is today.
+Key aspects of the REPETO project include:
+-
+
- Focus on experiments in the computer science community +
- Understanding the cost/benefit equation of reproducibility for these experiments +
- Identifying factors that make reproducibility difficult or infeasible +
- Fostering community practices to integrate reproducibility into mainstream research and education activities in computer science +
About the Chameleon Testbed
+Chameleon is an NSF-funded, large-scale, deeply programmable experimental platform for Computer Science systems research. It provides a configurable environment that can support a wide range of experimental needs, from bare metal reconfiguration to support for reproducible software environments. Chameleon allows researchers to explore transformative concepts in cloud computing, distributed computing, networking, and machine learning, enabling them to experiment with novel cloud architectures and pursue new applications of cloud computing. With its unique features and commitment to openness, Chameleon plays a crucial role in advancing computer science research and education.
+
+ Registration Details
+Early Bird Registration (until Oct. 1, 2024): $50
+Regular Registration (October 2 - November 1, 2024): $70
+All registration fees will cover event-related costs. Limited sponsorships are available to cover partial costs for presenters from under-resourced institutions. Please indicate your interest during registration.
+Note: Seats are limited. Register early to secure your spot and take advantage of the early bird discount!
+Contact Information
+For any questions or concerns, please contact the event coordinator:
+Marc Richardson
Email: mtrichardson@uchicago.edu