Mixed Precisions

ISC21 Workshop: Numerical Algorithms and Libraries for Exascale (NAL-X)

-

ISC21 KAUST Frankfurt Germany Time CET

Abstract With the hardware technology scaling and the trend on heterogeneous chip design, the existing numerical algorithms and software framework may break down due to load imbalance. There is currently a fundamental mismatch between the underlying hardware architecture with high thread concurrency and the software deployment of numerical libraries, which relies on the traditional bulk synchronous programming model. Numerical software should first squeeze performance out of single node by efficiently running on manycore architectures with processor counts sharing a common memory in the

Heterogeneity in Hardware: Opportunities and Challenges for Software and Applications (SC21 Panel)

-

SC21 Saint Louis MO USA

Heterogeneity in Hardware: Opportunities and Challenges for Software and Applications SC21 Panel Time: Tuesday, 16 November 2021, 10:30am - 12pm CST Location: 225-226 (America's Center, St. Louis, MO USA) Abstract With the end of Moore’s Law, the community has witnessed new hardware trends to increase performance. Today, it is not only the traditional x86 and accelerators that are part of computing systems, but also ARM, FPGAs and dedicated processors for DL workloads that equip now pioneering HPC systems. By the end of this decade, we are moving towards an era of extreme scale with “extreme

Mixed Feelings About Mixed Precisions: Birds of a Feather at SC22!

1 min read ·
Abstract: Come and share your experiences with the state-of-the-art of mixed-precision techniques! By wisely trading off accuracy, we can mitigate data movement overheads and increase performance of applications, including real-time adaptive optics simulations on ground-based telescopes and genome-wide association study for agricultural genomics. No free lunch, however: these optimizations require support from the software/hardware ecosystem and strong numerical validation. For instance, the tile Cholesky factorization is a fundamental matrix algorithm in solving covariance problems that

Mixed Feelings About Mixed Precisions: Birds of a Feather at SC23!

1 min read ·
Abstract What if we have been oversolving in computational science and engineering for decades? Are low precision arithmetic formats only for AI workloads? How can HPC applications exploit mixed-precision hardware features? This BoF invites the HPC community at large interested in applying mixed precisions into their workflows and discussing the impact on time-to-solution, memory footprint, data motion, and energy consumption. Experts from scientific applications/software libraries/hardware architectures will briefly provide the context on this trendy topic, share their own perspectives, and