Advanced Operating Systems – Fall 2005
Performance is a key criterion in the design, procurement, and use of computer systems. The goal of computer system engineers, scientists, analysts, and users is to get the highest performance for a given cost. This course introduces a basic knowledge of performance evaluation terminology and techniques. This course deals with the scientific methods applied to computing, workload characterization, forecasting of performance and quality metrics of systems, uses of analytic and simulation models, design of experiments, interpretation and presentation of experimental results, probability theory, queueing theory and operational laws.
Text Book :
- “The Art of Computer Systems Performance Analysis,” Raj Jain, John Wiley, 1991
- Exam (50%), Presentation (50%)
Week 1 : Introduction
Week 2 : Overview of performance evaluation (Chapter 1, 2, 3)
Week 4 : Measurement techniques : monitors, data presentation, ratio games (Chapter 7, 10, 11)
Week 5 : Paper presentation
- “Trace Based Analysis of File System Effects on Disk I/O,” S. Narayan, et al
- “An Introduction to Disk Drive Modeling,” C. Ruemmler and J. Wilkes, IEEE Computer 27/3, 1994
Week 6 : Probability and Statistics (Chapter 12)
Week 7 : Comparing systems (Chapter 13)
Week 8 : Paper presentation
- “A Performance Comparison of NFS and iSCSI for IP-Networked Storage,” In Proceedings of the USENIX Conference on FAST(File And Storage Technology), March 2004.
- “The measured Performance of Personal Computer Operating Systems,” In Proceedings of the 1996 USENIX Conference, 1996
Week 9 : Simulation technique (Chapter 24, 25)
Week 10 : Random-variate generation, commonly-used distributions (Chapter 28, 29)
Week 11 : Paper presentation
- “Tracefs: A File System to Trace Them All,” In Proceedings of the USENIX Conference on FAST(File And Storage Technology), March 2004.
- “Accurate and Efficient Replaying of File System Traces,” In Proceedings of the USENIX Conference on FAST(File And Storage Technology), December 2005.
Week 12 : Queueing theory (Chapter 30, 31)
Week 13 : Operational laws (Chapter 33)
Week 14 : Paper presentation
- “SPECweb2005 Design Document”, “SPECweb2005 User’s Guide,” http://www.spec.org/web2005/
- “SPECmail2001 Mail Server Benchmark Architecture White Paper,” http://www.spec.org/mail2001/docs/whitepaper.html
Week 15 : Review
Week 16 : final exam