1 != 1

And suddenly the problem comes in to focus!

It was not, as previously thought, a problem with the lens distortion or pixel shape. Or any other mythical unexplained reason. No, just a simple mix up with with the normalisation of the vectors.

If the image is not equal in height and width, then 1 X != 1 Y.