Structure of Applications and Infrastructure in Convergence of High Performance Computing and Big Data : Part A

Two major trends in computing systems are the growth in high performance computing (HPC) with an international exascale initiative, and the big data phenomenon with an accompanying cloud infrastructure of well publicized dramatic and increasing size and sophistication. In studying and linking these trends one needs to consider multiple aspects: hardware, software, applications/algorithms and even broader issues like business model and education. In this talk we study in detail a convergence approach for software and applications / algorithms and show what hardware architectures it suggests. We give examples of data analytics running on HPC systems including details on persuading Java to run fast. Some details can be found at http://dsc.soic.indiana.edu/publications/HPCBigDataConvergence.pdf http://hpc-abds.org/kaleidoscope/

HPCMPIBig DataExascaleABDS
1.0x

Structure of Applications and Infrastructure in Convergence of High Performance Computing and Big Data : Part A

Created 1 year ago

Duration 0:35:25
lesson view count 4
Two major trends in computing systems are the growth in high performance computing (HPC) with an international exascale initiative, and the big data phenomenon with an accompanying cloud infrastructure of well publicized dramatic and increasing size and sophistication. In studying and linking these trends one needs to consider multiple aspects: hardware, software, applications/algorithms and even broader issues like business model and education. In this talk we study in detail a convergence approach for software and applications / algorithms and show what hardware architectures it suggests. We give examples of data analytics running on HPC systems including details on persuading Java to run fast. Some details can be found at http://dsc.soic.indiana.edu/publications/HPCBigDataConvergence.pdf http://hpc-abds.org/kaleidoscope/
Select the file type you wish to download