Comments (2)
Thanks a lot for your feedback, always appreciated!
Modifying evaluate.py
for inference on individual images should be relatively trivial, but I haven't done that yet. I am, however, planning to add a separate demo script for that purpose. (Might take a little while though, because of other priorities.) Right now the main purpose of the code is to reproduce the results from the paper on the NYU dataset.
The gt
in the path indicates that the results were computed using the 'ground truth' depth, i.e. the depth maps provided by the NYU dataset. For RGB input, you have to run python evaluate.py --depth_model bts
, and the results are then stored in results/eval/test/bts/....
.
The 9-tuple consists of [a_x, a_y, a_z, r_1, r_2, r_3, t_x, t_y, t_z].
a = [a_x, a_y, a_z] is the size of the cuboid.
r = [r_1, r_2, r_3] (rotation) and t = [t_x, t_y, t_z] (translation) refers to the pose of the cuboid, with r being the angle-axis notation of the rotation, so you are basically right. The angle-axis notation only has three values, as r/norm(r) denotes the axis of rotation, and norm(r) is the angle.
You can convert r into a rotation matrix R using the torchgeometry lib for example:
R = tgm.angle_axis_to_rotation_matrix(r)
A 3D point x is then transformed into the cuboid centric coordinate frame via R(x-t), i.e. R @ (x-t)
in Python.
from cuboids_revisited.
It would be super helpful to see a side-by-side render of the test image and predicted cuboids when testing the code (for example, the images you have in the paper)! Right now I'm just getting pkls...
from cuboids_revisited.
Related Issues (1)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cuboids_revisited.