Calculate real world coordinates given camera intrisinc, extrinsic, trimesh

Question

I am struggling to map pixel coordinates to world coordinates. From what i've found on google, apparently I have to use the camera intrinsic/extrinsic (I have them).

Can you explain me how to use the rotation matrix & the translation vector to map from pixel to realworld? I am using the camera settings from trimesh

Thanks in advance