Updated on November 20, 2026

An in-order CPU starts instructions in the order it receives them. An out-of-order CPU can start a later instruction first if the earlier one is waiting and the later one has everything it needs. This helps the processor stay busy instead of leaving its execution units idle.
In-Order and Out-of-Order Execution Compared
| What Happens | In-Order Execution | Out-of-Order Execution |
|---|---|---|
| An instruction is waiting for data | Later instructions from that stream may have to wait too. | The CPU can run a later instruction if it’s ready and allowed to proceed. |
| An instruction needs a result from earlier work | The dependent instruction waits for that result. | The dependent instruction still waits. Other independent work can proceed. |
| The CPU has several execution units | It can overlap work in its pipeline and may start several ready instructions in order. | It can select ready instructions from a window of work and assign them to available units. |
| Design trade-off | Simpler scheduling hardware can help keep area and power use down. | Tracking and scheduling more work takes more hardware, but can improve performance when there’s independent work to do. |
A Simple Example of Why Order Matters
Suppose the CPU receives these three instructions.
A. Load a value from memory.
B. Add 1 to the value from A.
C. Add two other numbers that are already available.
If the memory load takes time, B must wait. An in-order processor may also have to hold C because it comes after B. An out-of-order processor can start C while it waits for A. The result of B still depends on the value from A.
How the CPU Preserves the Program’s Results
Many out-of-order CPUs track instructions after they start and retire them in program order. Retirement is when the CPU makes the finished results part of the program’s official state. This lets it do independent work early while preserving the expected results and reporting exceptions at the right point. See Intel’s processor optimization reference.
When Out-of-Order Execution Helps Most
It helps when the CPU can find enough ready instructions while other work is delayed. If each instruction depends on the previous one, there is less work to move around. Cache behavior, the workload, and the rest of the processor design also affect performance. Our CPI and IPC guide explains how to describe the number of instructions a CPU completes per clock cycle.
Frequently Asked Questions
Does Out-of-Order Execution Make Every Program Faster?
The gain depends on what the program is doing. Independent instructions give a CPU more opportunities to keep working while something else waits.
Can an In-Order Processor Work on More Than One Instruction at a Time?
Yes. A pipeline can work on different stages of several instructions at once. Some in-order cores can also start more than one ready instruction in a cycle.
What Is a Data Dependency?
An instruction has a data dependency when it needs a value produced by an earlier instruction. The CPU has to wait for that value before doing the dependent work.
Does a Program Need to Be Rewritten for an Out-of-Order CPU?
Programs use the rules of their instruction set. A compatible CPU handles the internal scheduling, and a compiler may tune instruction order for a particular chip.