Software optimization resources

Software optimization resources

See also my blog

Contents

• Optimization manuals
• Vector class library
• Test programs for measuring clock cycles in C++ and assembly code
• Object file converter and disassembler
• Subroutine library
• CPUID manipulation program
• Links

---

Optimization manuals

This series of five manuals describes everything you need to know about optimizing code for x86 and x86-64 family microprocessors, including optimization advices for C++ and assembly language, details about the microarchitecture and instruction timings of most Intel, AMD and VIA processors, and details about different compilers and calling conventions.

Operating systems covered: DOS, Windows, Linux, BSD, Mac OS X Intel based, 32 and 64 bits.

Note that these manuals are not for beginners.

1. Optimizing software in C++: An optimization guide for Windows, Linux and Mac platforms

This is an optimization manual for advanced C++ programmers. Topics include: The choice of platform and operating system. Choice of compiler and framework. Finding performance bottlenecks. The efficiency of different C++ constructs. Multi-core systems. Parallelization with vector operations. CPU dispatching. Efficient container class templates. Etc. 
 
File name: optimizing_cpp.pdf, size: 890654, last modified: 2012-Feb-29.
Download. 
 

2. Optimizing subroutines in assembly language: An optimization guide for x86 platforms

This is an optimization manual for advanced assembly language programmers and compiler makers. Topics include: C++ instrinsic functions, inline assembly and stand-alone assembly. Linking optimized assembly subroutines into high level language programs. Making subroutine libraries compatible with multiple compilers and operating systems. Optimizing for speed or size. Memory access. Loops. Vector programming (XMM, YMM, SIMD). CPU-specific optimization and CPU dispatching. 
 
File name: optimizing_assembly.pdf, size: 873059, last modified: 2012-Feb-29.
Download. 
 

3. The microarchitecture of Intel, AMD and VIA CPUs: An optimization guide for assembly programmers and compiler makers

This manual contains details about the internal working of various microprocessors from Intel, AMD and VIA. Topics include: Out-of-order execution, register renaming, pipeline structure, execution unit organization and branch prediction algorithms for each type of microprocessor. Describes many details that cannot be found in manuals from microprocessor vendors or anywhere else. The information is based on my own research and measurements rather than on official sources. This information will be useful to programmers who want to make CPU-specific optimizations as well as to compiler makers and students of microarchitecture. 
 
File name: microarchitecture.pdf, size: 1447646, last modified: 2012-Feb-29.
Download. 
 

4. Instruction tables: Lists of instruction latencies, throughputs and micro-operation breakdowns for Intel, AMD and VIA CPUs

Contains detailed lists of instruction latencies, execution unit throughputs, micro-operation breakdown and other details for all common application instructions of most microprocessors from Intel, AMD and VIA. Intended as an appendix to the preceding manuals. Available as pdf file and as spreadsheet (ods format). 
 
File name: instruction_tables.pdf, size: 620032, last modified: 2012-Feb-29.
Download. 
 
File name: instruction_tables.ods, size: 212290, last modified: 2012-Feb-29.
Download. 
 

5. Calling conventions for different C++ compilers and operating systems

This document contains details about data representation, function calling conventions, register usage conventions, name mangling schemes, etc. for many different C++ compilers and operating systems. Discusses compatibilities and incompatibilities between different C++ compilers. Includes information that is not covered by the official Application Binary Interface standards (ABI's). The information provided here is based on my own research and therefore descriptive rather than normative. Intended as a source of reference for programmers who want to make function libraries compatible with multiple compilers or operating systems and for makers of compilers and other development tools who want their tools to be compatible with existing tools. 
 
File name: calling_conventions.pdf, size: 415677, last modified: 2012-Feb-29.
Download. 
 

All five manuals

Download all the above manuals together in one zip file. 
 
File name: optimization_manuals.zip, size: 3551099, last modified: 2012-Feb-29.
Download. 
 

If you don't know how to read the .pdf files click here.

---

C++ vector class library

This is a collection of C++ classes, functions and operators that makes it easier to use the the vector instructions (Single Instruction Multiple Data instructions) of modern CPUs without using assembly language. Supports the SSE2, SSE3, SSSE3, SSE4.1, SSE4.2, AVX, AVX2, XOP and FMA instruction sets. Can compile for different instruction sets from the same source code. Description and instructions.

File name: vectorclass.zip, size: 478732, last modified: 2012-Aug-01.
Download.

---

Test programs for measuring clock cycles and performance monitoring

Test programs that I have used for my research. Can measure clock cycles and performance monitor counters such as cache misses, branch mispredictions, resource stalls etc. in a small piece of code in C, C++ or assembly. Supports Windows and Linux, 32 and 64 bit mode, multiple threads.

For experts only. Useful for analyzing small pieces of code but not for profiling a whole program.

File name: testp.zip, size: 450865, last modified: 2012-Mar-02.
Download.

---

Object file converter

This utility can be used for converting object files between COFF/PE, OMF, ELF and Mach-O formats for all 32-bit and 64-bit x86 platforms. Can modify symbol names in object files. Can build, modify and convert function libraries across platforms. Can dump object files and executable files. Also includes a very good disassembler supporting the SSE4, AVX, AVX2, FMA and XOP instruction sets. Source code included (GPL). Manual.

File name: objconv.zip, size: 742855, last modified: 2012-Aug-31.
Download.

---

Subroutine library

This is a library of optimized subroutines coded in assembly language. The functions in this library can be called from C, C++ and other compiled high-level languages. Supports many different compilers under Windows, Linux, BSD and Mac OS X operating systems, 32 and 64 bits. This library contains faster versions of common C/C++ memory and string functions, fast functions for string search and string parsing, fast integer division and integer vector division, as well as several useful functions not found elsewhere.

The package contains library files in many different file formats, C++ header file and assembly language source code. Gnu general public license applies. Manual.

File name: asmlib.zip, size: 468639, last modified: 2012-Jul-08.
Download.

---

CPUID manipulation program for VIA

This is a program that can change the CPUID vendor string, family and model number on VIA Nano processors. See my blog for a discussion of the purpose of this program.

File name: cpuidfake.zip, size: 67593, last modified: 2010-Aug-08.
Download.

---

Useful assembly links

Agner's CPU blog www.agner.org/optimize/blog

Masm Forum www.masmforum.com

ASM Community Messageboard www.asmcommunity.net/board/

Linux Assembly www.linuxassembly.org

Hutch's Assembly pages www.movsd.com

Iczelion's Win32 Assembly Homepage win32assembly.online.fr/

CPU-id tools and information www.cpuid.com

likwid performance measuring tools for Linux code.google.com/p/likwid

Programmer's heaven assembler zone Programmers' Heaven

X-bit Labs articles on microprocessors www.xbitlabs.com/articles/cpu/

Virtual sandpile x86 Processor information www.sandpile.org

intel-assembler programmers guides and manuals www.intel-assembler.it

Online computer books www.computer-books.us/assembler.php

Instruction latency listings instlatx64.atw.hu/

FASM assembler and messageboard flatassembler.net

YASM assembler www.tortall.net/projects/yasm

NASM assembler sourceforge.net/projects/nasm

JWASM assembler www.japheth.de

Newsgroup: comp.lang.asm.x86

Intel resources

Reference manuals and other documents can be found at Intel's web site. Intel's web site is refurnished so often that any link I could provide here to specific documents would be broken after a few months. I will therefore recommend that you use the search facilities atdeveloper.intel.com and search for "Software Developer's Manual" and "Optimization Reference Manual".

AMD resources

www.amd.com/us-en/Processors/TechnicalResources/0,,30_182_739,00.html

Microsoft resources

MASM manuals msdn.microsoft.com

921357