A few questions

[nemtiax]

A few questions

[fkluger]

Thanks a lot for your feedback, always appreciated!

Modifying evaluate.py for inference on individual images should be relatively trivial, but I haven't done that yet. I am, however, planning to add a separate demo script for that purpose. (Might take a little while though, because of other priorities.) Right now the main purpose of the code is to reproduce the results from the paper on the NYU dataset.

The gt in the path indicates that the results were computed using the 'ground truth' depth, i.e. the depth maps provided by the NYU dataset. For RGB input, you have to run python evaluate.py --depth_model bts, and the results are then stored in results/eval/test/bts/.....

The 9-tuple consists of [a_x, a_y, a_z, r_1, r_2, r_3, t_x, t_y, t_z].
a = [a_x, a_y, a_z] is the size of the cuboid.
r = [r_1, r_2, r_3] (rotation) and t = [t_x, t_y, t_z] (translation) refers to the pose of the cuboid, with r being the angle-axis notation of the rotation, so you are basically right. The angle-axis notation only has three values, as r/norm(r) denotes the axis of rotation, and norm(r) is the angle.
You can convert r into a rotation matrix R using the torchgeometry lib for example:
R = tgm.angle_axis_to_rotation_matrix(r)
A 3D point x is then transformed into the cuboid centric coordinate frame via R(x-t), i.e. R @ (x-t) in Python.

[vibe007]

It would be super helpful to see a side-by-side render of the test image and predicted cuboids when testing the code (for example, the images you have in the paper)! Right now I'm just getting pkls...