Golden Rules in HPC

1.      Even with multi-terabyte local disk sub-systems and multi-petabyte archives, I/O can become a bottleneck in HPC.

2.      Users download 10x more data than needed

3.      While data volumes grow,network bandwidth does not at the same rate, and hence serving such data efficiently is a challenge. Therefore, service flexibility like subsetting and other processing on server side prior to their shipping is more and more considered indispensable.

4.      Server must mediate between access patterns.

5.      80% of all data have some spatial connotation.

6.      Arrays at the heart of large-scale scientific data analytics, along withgraphs (incl meshes), sets, trees.