C++ Low Latency: Multithreading and Hotpath Optimizations (Generative AI LLM Programming) by David Spuler
English | March 28, 2025 | ISBN: N/A | ASIN: B0F2SNYS3L | 362 pages | EPUB | 1.28 Mb
English | March 28, 2025 | ISBN: N/A | ASIN: B0F2SNYS3L | 362 pages | EPUB | 1.28 Mb
Run faster! This book is about speeding up C++ for low latency programming in multithreaded environments and sequential code in C++ backends.
Main applications:
- AI LLM Inference Backends
- High-Frequency Trading (HFT)
- Game Engines
- C++ Multithreading optimizations
- General C++ efficiency tweaks
Part I: Introduction to Low Latency
1. Low Latency Programming
2. Multithreading Optimizations
3. Hardware Acceleration
4. System Optimizations
Part II: Multithreading Optimizations
5. False Sharing
6. Branch Prediction
7. Lock Contention
8. Hotpath Optimizations
9. Slowpath Removal
10. Cache Warming
Part III: C++ Optimizations
11. Timing and Benchmarking
12. Bitwise Operations
13. Floating-Point Arithmetic
14. Arithmetic Optimizations
15. Compile-Time Optimizations
16. Pointer Arithmetic
17. Algorithm Speedups
18. Memory Optimizations
19. Loop Vectorization
20. AVX Intrinsics
21. Parallel Data Structures
22. Lookup Tables & Precomputation
Appendix 1: C++ Slug Catalog