Branchless Matrix to Quaternion Conversion

(EDIT: This article is a more in-depth writeup of an algorithm that I developed around 2005, and first posted to Martin Baker’s Euclidean Space website. That time was the height of the Intel NetBurst architecture, which was notorious for its deep pipeline and high branch misprediction penalty. Hence the motivation to develop a branch-free matrix to quaternion conversion routine. What follows is the complete derivation and analysis of this idea.)

The original routine to convert a matrix to a quaternion was given by Ken Shoemake [1] and is very branchy, as is tests for 4 different cases. There is a way to eliminate these branches and arrive at a completely branch-free code and highly parallelizable code. The trade off is the introduction of 3 additional square roots. Jump the analysis section and the end of this article, or continue fist with the math bits.

Trade 3 roots for a branch

When a quaternion is converted to a matrix, the terms that finally end up in the matrix can be added and subtracted to arrive at a wealth of identities. The elements in the matrix diagonal are related to the quaternion elements by

    \begin{align*} r &= \frac{1}{2}\sqrt{1+m_{00}+m_{11}+m_{22}}, \\ i &= \frac{1}{2}\sqrt{1+m_{00}-m_{11}-m_{22}}, \\ j &= \frac{1}{2}\sqrt{1-m_{00}+m_{11}-m_{22}}, \\ k &= \frac{1}{2}\sqrt{1-m_{00}-m_{11}+m_{22}}. \end{align*}

The off-diagonal matrix elements are related to the quaternion elements by

    \begin{align*} i &= \frac{1}{4r}(m_{21}-m_{12}) , & i &= \frac{1}{4j}(m_{10}+m_{01}) , \\ j &= \frac{1}{4r}(m_{02}-m_{20}) , & j &= \frac{1}{4k}(m_{21}+m_{12}) , \\ k &= \frac{1}{4r}(m_{10}-m_{01}) , & k &= \frac{1}{4i}(m_{20}+m_{02}) . \end{align*}

It is obvious that there are multiple paths to restore the quaternion from a matrix. One could first restore r from the diagonal elements, and then use the off-diagonal elements to restore i, j and k. Or first restore i from the diagonal elements, and then use the off-diagonal for the rest, etc. The standard, branchy conversion code just does that. Can we eliminate the branches and just use the diagonal elements for everything? In theory, yes, the only thing missing would be the signs.

void BranchlessMatrixToQuaternion( float out[4], float in[3][3] )
    out[0] = .5 * sqrt( max( 0, 1 + in[0][0] + in[1][1] + in[2][2] ) ); // r
    out[1] = .5 * sqrt( max( 0, 1 + in[0][0] - in[1][1] - in[2][2] ) ); // i
    out[2] = .5 * sqrt( max( 0, 1 - in[0][0] + in[1][1] - in[2][2] ) ); // j
    out[3] = .5 * sqrt( max( 0, 1 - in[0][0] - in[1][1] + in[2][2] ) ); // k
    out[1] = copysign( out[1], in[2][1] - in[1][2] ); // i
    out[2] = copysign( out[2], in[0][2] - in[2][0] ); // j
    out[3] = copysign( out[3], in[1][0] - in[0][1] ); // k


Mathematically, if the matrix \mathbf{M} has a determinant of one, then 1 + \mathrm{tr}(\mathbf{M}) cannot be negative, and all four square roots are defined. In practice there can be rounding errors, so to be safe the terms are clamped with max( 0, ... ) before the square roots are taken. The off diagonal elements are only used to restore the missing signs. Since only the signs matter, the division by r can be lifted! (The function copysign is supposed to transfer the sign bit from one floating point number to another, and your compiler should do a decent job and reduce it to some sequence of bitwise and/or instructions. Clang and GCC do this on x86 with SSE floating point. See the comment section for a discussion about this.)

Compared with the original conversion code, there are four square roots instead of one square root and one division, but there aren’t any branches. The code pipelines well (all the square roots can run in parallel, followed by all the copysigns).

Operation Counts

In the following table of operation counts, I have included a max( 0, ... ) safeguard also in the Shoemake algorithm (the original doesn’t have this). The copysign is regarded as a single operation.

Shoemake Branchless
add/sub/mul/max 11..13 23
div/sqrt 2 4
floating point
1..3 0
branch 1..3 0
copysign 0 3
steps in longest
dependency chain
8..15 6

Let’s assume the latency of sqrt and div as 15 cycles (single precision), the latency of a branch as 2 cycles with a misprediction penalty of 15 cycles, and the average latency of everything else as 3 cycles. These numbers are in the ballpark of Intel Wolfdale resp. AMD Jaguar processors [2]. Depending on whether the execution is assumed to be either perfectly serial and in-order (a simple addition of all the latencies), or assumed to be perfectly parallel and out-of-order (the sum of the latencies in the longest dependency chain), we get the cycle counts shown in the table below. The reality should be anywhere between these extremes.

Shoemake Branchless
perfectly serial (in-order) 68..129 138
perfectly parallel (out of order) 49..88 30

Numerical Stability

The catch of the branchless algorithm is that the singularity at the rotation angle of 180° is still there. Although the division by r was lifted and so a division by zero cannot occur, it now appears as random signs from catastrophic cancellation. Take for example, a 180° rotation around the x-y diagonal,

    \[\begin{bmatrix} 0 & 1 & \epsilon \\ 1 & 0 & -\epsilon \\ -\epsilon & \epsilon & -1 \end{bmatrix}.\]

In an ideal world, when the rotation angle travels through a small neighborhood around the point of 180°, the value of \epsilon vanishes and changes sign. The i and j components of the resulting quaternion should then flip signs simultaneously too. In reality however, with just the tiniest amount of rounding error, these signs are quasi random. The behavior can be described like this:

just before 180°
(consistent signs)
at 180°
(random signs)
just after 180°
(consistent signs)
[ 0 \;\; +i \;\; +j \;\; 0 ] [ 0 \;\; \pm i \;\; \pm j \;\; 0 ] [ 0 \;\; -i \;\; -j \;\; 0 ]


A configuration which provokes the singularity described above is surprisingly common as an exchange of coordinate axes (conversion from Z-up to Y-up, for example). Where the branchless algorithm shines however is the conversion of local animation keys. These rarely cross a 180° rotation angle. In one use case for me, the skeleton is the skeleton of a plant and the animation is driven by physics, and I know or can make sure that a rotation of 180° simply doesn’t occur.

Given this knowledge, the branchless conversion code is recommended over the standard one, under the condition that the rotation angle does not cross 180°.

[1] Ken Shoemake, “Quaternions”,

[2] Instruction Tables at Agner Optimization

2 thoughts on “Branchless Matrix to Quaternion Conversion

  1. On PPC architectures, I would recommend *not* doing copysign() with bit operations, because that incurs a LHS penalty. On those architectures, you are better of implementing copysign() using fabs() and a floating-point select.

    Like the branchless version, will come in handy in the future!

Leave a Reply

Your email address will not be published.

Time limit is exhausted. Please reload the CAPTCHA.