COL718 : High-Performance Computing : References

Papers and Links

• The Rise of Worse is Better by Richard P. Gabriel.
• The Cathedral and the Bazaar, by Eric S. Raymond.
• Intel Software Developer ISA Manual
• ARM Instruction set
• ARM A64 vector instructions
• Measuring Instruction Latency and Throughput [latThpt.zip taken from here].
• Agner Fog's Instruction Tables
• The tail at scale, by Jeffrey Dean and Luiz André Barroso.
• Interesting talk by Christos Kozyrakis. Talks about OS abstractions, Power-performance (throughput/latency) tradeoffs, In-memory computing, Disaggregation (remote memory, remote NICs, remote storage).
• Benchmarking C++ Code, Bryce Adelstein-Lelbach at CppCon 2015. Talks about benchmarking best practices.
  • Why you may see variance in computer performance
  • Mean-median test: easy normality test
  • Time-based benchmarking: using x86 TSC, C++11 Chrono, more ideas
  • Memory benchmarking: googleperftools/TCMalloc (MALLOCSTATS), more ideas
  • x86 hardware performance counters: Intel VTune Amplifier
  • Intel Vectorization Adviser
  • Stateful Performance Tests
  • FlexVec: auto-vectorization for irregular loops (recent paper to potentially discuss in lecture).
  
  
  
• How to get consistent results when benchmarking on Linux?
• Scalar Evolution - Demystified

Documents/Papers discussed in class

• Intel Haswell Specification
• Hyper-Threading Technology Architecture and Microarchitecture
• Exploiting superword level parallelism with multimedia instruction sets

• QEMU, a Fast and Portable Dynamic Translator, Fabrice Bellard, USENIX Annual Technical Conference 2005.
• A Comparison of Software and Hardware Techniques for x86 Virtualization, K. Adams, O. Agesen. ASPLOS 2006.
• Memory Resource management in VMware ESX Server, Carl Waldspurger. OSDI 2002.
• Accelerating Two-Dimensional Page Walks for Virtualized Systems, R. Bhargava, B. Serebrin, F. Spadini, S. Manne. ASPLOS 08.
• Virtualizing I/O Devices on VMware Workstation's Hosted Virtual Machine Monitor, Sugerman et al. USENIX 2001.

Books, slides

• "Computer Architecture: A Quantitative Approach, 3rd Edition", by John L. Hennessy (Author), David A. Patterson (Author)
• Computer Organisation and Architecture by Smruti Ranjan Sarangi
• Smruti Sarangi's slides:
  • OOO-I, OOO-II, OOO-III.
• Compilers: Principles, Techniques, and Tools, by A.V. Aho, M.S. Lam, R. Sethi, J.D. Ullman (available in IITD library) [ PDF ]