ok this one was challenging! i guess SEM has an orthographic camera model, ended up getting posed as a very narrow FOV perspective cam and having some alignment errors as a result.
if there was calibration data available for the ray bundles it could potentially help (though the