Titus-executor build problems

[tguvdamm]

Titus-executor build problems

[tguvdamm]

I managed to continue the execution of make build-standalone, the version supplied for gox by apt isn't the most recent version.
Then, I had to change an included file from attr/xattr.h to sys/xattr.h, as the former one is deprecated.
However, now the code stops building at the following lines:

In file included from /usr/include/libnl3/netlink/socket.h:16:0,
                 from /users/tguvdamm/go/src/github.com/Netflix/titus-executor/inject-metadataproxy/titus-inject-metadataproxy.c:20:
/usr/include/libnl3/netlink/handlers.h:51:15: error: ‘struct nlmsgerr’ declared inside parameter list will not be visible outside of this definition or declaration [-Werror]
        struct nlmsgerr *nlerr, void *arg);
               ^~~~~~~~
/usr/include/libnl3/netlink/handlers.h:50:43: error: ‘struct sockaddr_nl’ declared inside parameter list will not be visible outside of this definition or declaration [-Werror]
 typedef int (*nl_recvmsg_err_cb_t)(struct sockaddr_nl *nla,
                                           ^~~~~~~~~~~
/usr/include/libnl3/netlink/handlers.h:135:18: error: ‘struct sockaddr_nl’ declared inside parameter list will not be visible outside of this definition or declaration [-Werror]
           struct sockaddr_nl *,
                  ^~~~~~~~~~~
cc1: all warnings being treated as errors

This does not seems like a version mismatch anymore.

[sargun]

Sorry, I didn't see your response. What version of libnl are you compiling with? Also, what version of the operating system are you compiling with?

The code has to be compiled on Xenial, AFAIK. And the libnl version in Xenial is a little old. You can see here: https://github.com/Netflix/titus-executor/blob/master/hack/builder/Dockerfile -- we pull in a newer version of libnl during compilation.

[tguvdamm]

Thanks for replying.

I was working with the apt version of libnl, which was 2.29. I replaced it with version 3.2.27 mentioned in the Dockerfile and switched to an Ubuntu 16 OS: lsb_release -a output:

Distributor ID: Ubuntu
Description: Ubuntu 16.04.5 LTS
Release: 16.04
Codename: xenial

The make build-standalone now continues until titus-nsenter.c:

[ 25%] Building C object CMakeFiles/titus-nsenter.dir/titus-nsenter.c.o
/users/tguvdamm/go/src/github.com/Netflix/titus-executor/inject/titus-nsenter.c:                        
35:13: error: ‘CLONE_NEWCGROUP’ undeclared here (not in a function)
   .nstype = CLONE_NEWCGROUP,
             ^

[sargun]

Huh. That's really interesting. Your libc kernel headers are not up to date. Can you tell me what version of "libc6-dev" you have?

[tguvdamm]

I updated and upgraded apt before starting installing Titus:
libc6-dev is already the newest version (2.23-0ubuntu10).

[sargun]

Maybe try to build in Ubuntu bionic?

…

Sent from my iPhone On Nov 16, 2018, at 09:08, tguvdamm <[email protected]> wrote: I updated and upgraded apt before starting installing Titus: libc6-dev is already the newest version (2.23-0ubuntu10). — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#193 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAtyRJr0wZ611GBSESMoKNqqS_qLtTwKks5uvvEEgaJpZM4YM5Nn> .

[tguvdamm]

On bionic, this problem doesn't occur, but there's a library missing. It should belong to the libnl package, which is now the correct one, though.

[ 50%] Building C object CMakeFiles/titus-inject-metadataproxy.dir/titus-inject-metadataproxy.c.o
/users/tguvdamm/go/src/github.com/Netflix/titus-executor/inject-metadataproxy/titus-inject-metadataproxy.c:20:10: fatal error: netlink/socket.h: No such file or directory
 #include <netlink/socket.h>
          ^~~~~~~~~~~~~~~~~~
compilation terminated.
CMakeFiles/titus-inject-metadataproxy.dir/build.make:62: recipe for target 'CMakeFiles/titus-inject-metadataproxy.dir/titus-inject-metadataproxy.c.o' failed

[sargun]

Huh, that's weird. How did you install the new libnl package?

[tguvdamm]

I copied the instructions (approximately) from the Dockerfile and executed those:

wget https://github.com/thom311/libnl/releases/download/libnl3_4_0/libnl-3.4.0.tar.gz
tar -xvzf libnl-3.4.0.tar.gz
cd libnl-3.4.0
sudo ./configure
sudo make
sudo make install

[alekar]

Closing this issue since t has been inactive for over an year.