Adding AMD support (via Qemu? )

[darlinghq]

Adding AMD support (via Qemu? )

[LubosD]

Which binaries? I thought AMD was keeping up with Intel.

[thopiekar]

I tested some binaries from Xcode on my AMD PhenomIII and they were not working. I can give it another try or is there any binary that I can download and test?

[LubosD]

Could you tell me what binaries exactly were you trying? I'd like to know just for future reference and testing.

[thopiekar]

Looks like something was going wrong when copying the files from my OSX VM.
Are mach-o files usually executable on linux-amd64? Just noticed I didn't need to run dyld (without binfmt!).

By the way:
This happens when executing Xcode (the UI): - Got a seg. fault

thopiekar@home:/home/thopiekar/Projekte/Xcode/Xcode.app/Contents/MacOS$ dyld Xcode 
*** buffer overflow detected ***: dyld terminated
======= Backtrace: =========
/lib/x86_64-linux-gnu/libc.so.6(__fortify_fail+0x5c)[0x7f258203008c]
/lib/x86_64-linux-gnu/libc.so.6(+0x111020)[0x7f258202f020]
/lib/x86_64-linux-gnu/libc.so.6(+0x1115c4)[0x7f258202f5c4]
/usr/lib/darling/libdyld.so(_ZN7Darling8MachOMgr21detectSysRootFromPathESs+0x42)[0x7f2583159552]
dyld(main+0x44c)[0x4027dc]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0x7f2581f3fde5]
dyld[0x4022c0]
======= Memory map: ========
00400000-00406000 r-xp 00000000 08:02 158500                             /usr/bin/dyld
00605000-00606000 r--p 00005000 08:02 158500                             /usr/bin/dyld
00606000-00607000 rw-p 00006000 08:02 158500                             /usr/bin/dyld
00826000-00847000 rw-p 00000000 00:00 0                                  [heap]
7f2581f1e000-7f25820db000 r-xp 00000000 08:02 1441833                    /lib/x86_64-linux-gnu/libc-2.17.so
7f25820db000-7f25822db000 ---p 001bd000 08:02 1441833                    /lib/x86_64-linux-gnu/libc-2.17.so
7f25822db000-7f25822df000 r--p 001bd000 08:02 1441833                    /lib/x86_64-linux-gnu/libc-2.17.so
7f25822df000-7f25822e1000 rw-p 001c1000 08:02 1441833                    /lib/x86_64-linux-gnu/libc-2.17.so
7f25822e1000-7f25822e6000 rw-p 00000000 00:00 0 
7f25822e6000-7f25822fb000 r-xp 00000000 08:02 1447847                    /lib/x86_64-linux-gnu/libgcc_s.so.1
7f25822fb000-7f25824fa000 ---p 00015000 08:02 1447847                    /lib/x86_64-linux-gnu/libgcc_s.so.1
7f25824fa000-7f25824fb000 r--p 00014000 08:02 1447847                    /lib/x86_64-linux-gnu/libgcc_s.so.1
7f25824fb000-7f25824fc000 rw-p 00015000 08:02 1447847                    /lib/x86_64-linux-gnu/libgcc_s.so.1
7f25824fc000-7f25825ff000 r-xp 00000000 08:02 1441819                    /lib/x86_64-linux-gnu/libm-2.17.so
7f25825ff000-7f25827fe000 ---p 00103000 08:02 1441819                    /lib/x86_64-linux-gnu/libm-2.17.so
7f25827fe000-7f25827ff000 r--p 00102000 08:02 1441819                    /lib/x86_64-linux-gnu/libm-2.17.so
7f25827ff000-7f2582800000 rw-p 00103000 08:02 1441819                    /lib/x86_64-linux-gnu/libm-2.17.so
7f2582800000-7f25828e6000 r-xp 00000000 08:02 131933                     /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.18
7f25828e6000-7f2582ae5000 ---p 000e6000 08:02 131933                     /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.18
7f2582ae5000-7f2582aed000 r--p 000e5000 08:02 131933                     /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.18
7f2582aed000-7f2582aef000 rw-p 000ed000 08:02 131933                     /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.18
7f2582aef000-7f2582b04000 rw-p 00000000 00:00 0 
7f2582b04000-7f2582b1b000 r-xp 00000000 08:02 1441835                    /lib/x86_64-linux-gnu/libpthread-2.17.so
7f2582b1b000-7f2582d1b000 ---p 00017000 08:02 1441835                    /lib/x86_64-linux-gnu/libpthread-2.17.so
7f2582d1b000-7f2582d1c000 r--p 00017000 08:02 1441835                    /lib/x86_64-linux-gnu/libpthread-2.17.so
7f2582d1c000-7f2582d1d000 rw-p 00018000 08:02 1441835                    /lib/x86_64-linux-gnu/libpthread-2.17.so
7f2582d1d000-7f2582d21000 rw-p 00000000 00:00 0 
7f2582d21000-7f2582d24000 r-xp 00000000 08:02 1441834                    /lib/x86_64-linux-gnu/libdl-2.17.so
7f2582d24000-7f2582f23000 ---p 00003000 08:02 1441834                    /lib/x86_64-linux-gnu/libdl-2.17.so
7f2582f23000-7f2582f24000 r--p 00002000 08:02 1441834                    /lib/x86_64-linux-gnu/libdl-2.17.so
7f2582f24000-7f2582f25000 rw-p 00003000 08:02 1441834                    /lib/x86_64-linux-gnu/libdl-2.17.so
7f2582f25000-7f2582f36000 r-xp 00000000 08:02 17831870                   /usr/lib/darling/libmach-o.so.1.0.0
7f2582f36000-7f2583135000 ---p 00011000 08:02 17831870                   /usr/lib/darling/libmach-o.so.1.0.0
7f2583135000-7f2583136000 r--p 00010000 08:02 17831870                   /usr/lib/darling/libmach-o.so.1.0.0
7f2583136000-7f2583137000 rw-p 00011000 08:02 17831870                   /usr/lib/darling/libmach-o.so.1.0.0
7f2583137000-7f2583169000 r-xp 00000000 08:02 17831872                   /usr/lib/darling/libdyld.so
7f2583169000-7f2583368000 ---p 00032000 08:02 17831872                   /usr/lib/darling/libdyld.so
7f2583368000-7f2583369000 r--p 00031000 08:02 17831872                   /usr/lib/darling/libdyld.so
7f2583369000-7f258336a000 rw-p 00032000 08:02 17831872                   /usr/lib/darling/libdyld.so
7f258336a000-7f258338d000 r-xp 00000000 08:02 1441822                    /lib/x86_64-linux-gnu/ld-2.17.so
7f258355e000-7f2583568000 rw-p 00000000 00:00 0 
7f2583589000-7f258358c000 rw-p 00000000 00:00 0 
7f258358c000-7f258358d000 r--p 00022000 08:02 1441822                    /lib/x86_64-linux-gnu/ld-2.17.so
7f258358d000-7f258358f000 rw-p 00023000 08:02 1441822                    /lib/x86_64-linux-gnu/ld-2.17.so
7fff0688d000-7fff068ae000 rw-p 00000000 00:00 0                          [stack]
7fff0694c000-7fff0694e000 r-xp 00000000 00:00 0                          [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]
Abgebrochen (Speicherabzug geschrieben)

[LubosD]

In general, all apps should work on AMD64 unless they contain Intel-specific instructions. This could be resolved in the future by adding SIGILL handlers that would rewrite code as needed.

This backtrace suggests that there is an overrun problem in MachOMgr::detectSysRootFromPath(), which I'll take a look at right away.

[LubosD]

And no, Linux cannot load Mach-O executables :-)

[thopiekar]

Well, I'm not kiding.. Just working out of the box..
Using here a outdated version as new builds are in progress..

thopiekar@home:/home/thopiekar/Projekte/Xcode/Xcode.app/Contents/Developer/usr/bin$ ls
actool                  g++                 git-upload-pack    iprofiler  ndisasm       sdp            svnversion
agvtool                 gatherheaderdoc     gnumake            ld         opendiff      SetFile        TextureAtlas
amlint                  gcc                 hdxml2manxml       lldb       projectInfo   SplitForks     UnRezWack
atos                    gcov                headerdoc2html     make       ResMerger     svn            xcodebuild
BuildStrings            GetFileInfo         ibtool             mapc       resolveLinks  svnadmin       xcrun
convertRichTextToAscii  git                 ibtool3            MergePef   Rez           svndumpfilter  xcsdevicesnifferd
CpMac                   git-cvsserver       ibtoold            mksdk      RezDet        svnlook        xcsproxyservice
DeRez                   git-receive-pack    ictool             momc       RezWack       svnrdump       xctest
desdp                   git-shell           ImageUnitAnalyzer  MvMac      scntool       svnserve       xed
docsetutil              git-upload-archive  instruments        nasm       sdef          svnsync        xml2man
thopiekar@home:/home/thopiekar/Projekte/Xcode/Xcode.app/Contents/Developer/usr/bin$ file gcc 
gcc: Mach-O fat file with 2 architectures
thopiekar@home:/home/thopiekar/Projekte/Xcode/Xcode.app/Contents/Developer/usr/bin$ gcc
gcc: fatal error: no input files
compilation terminated.
thopiekar@home:/home/thopiekar/Projekte/Xcode/Xcode.app/Contents/Developer/usr/bin$ dyld gcc
*** buffer overflow detected ***: dyld terminated
======= Backtrace: =========
/lib/x86_64-linux-gnu/libc.so.6(__fortify_fail+0x5c)[0x7f929486c08c]
/lib/x86_64-linux-gnu/libc.so.6(+0x111020)[0x7f929486b020]
/lib/x86_64-linux-gnu/libc.so.6(+0x1115c4)[0x7f929486b5c4]
/usr/lib/darling/libdyld.so(_ZN7Darling8MachOMgr21detectSysRootFromPathESs+0x42)[0x7f9295995552]
dyld(main+0x44c)[0x4027dc]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0x7f929477bde5]
dyld[0x4022c0]
======= Memory map: ========
00400000-00406000 r-xp 00000000 08:02 158500                             /usr/bin/dyld
00605000-00606000 r--p 00005000 08:02 158500                             /usr/bin/dyld
00606000-00607000 rw-p 00006000 08:02 158500                             /usr/bin/dyld
01b13000-01b34000 rw-p 00000000 00:00 0                                  [heap]
7f929475a000-7f9294917000 r-xp 00000000 08:02 1441833                    /lib/x86_64-linux-gnu/libc-2.17.so
7f9294917000-7f9294b17000 ---p 001bd000 08:02 1441833                    /lib/x86_64-linux-gnu/libc-2.17.so
7f9294b17000-7f9294b1b000 r--p 001bd000 08:02 1441833                    /lib/x86_64-linux-gnu/libc-2.17.so
7f9294b1b000-7f9294b1d000 rw-p 001c1000 08:02 1441833                    /lib/x86_64-linux-gnu/libc-2.17.so
7f9294b1d000-7f9294b22000 rw-p 00000000 00:00 0 
7f9294b22000-7f9294b37000 r-xp 00000000 08:02 1447847                    /lib/x86_64-linux-gnu/libgcc_s.so.1
7f9294b37000-7f9294d36000 ---p 00015000 08:02 1447847                    /lib/x86_64-linux-gnu/libgcc_s.so.1
7f9294d36000-7f9294d37000 r--p 00014000 08:02 1447847                    /lib/x86_64-linux-gnu/libgcc_s.so.1
7f9294d37000-7f9294d38000 rw-p 00015000 08:02 1447847                    /lib/x86_64-linux-gnu/libgcc_s.so.1
7f9294d38000-7f9294e3b000 r-xp 00000000 08:02 1441819                    /lib/x86_64-linux-gnu/libm-2.17.so
7f9294e3b000-7f929503a000 ---p 00103000 08:02 1441819                    /lib/x86_64-linux-gnu/libm-2.17.so
7f929503a000-7f929503b000 r--p 00102000 08:02 1441819                    /lib/x86_64-linux-gnu/libm-2.17.so
7f929503b000-7f929503c000 rw-p 00103000 08:02 1441819                    /lib/x86_64-linux-gnu/libm-2.17.so
7f929503c000-7f9295122000 r-xp 00000000 08:02 131933                     /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.18
7f9295122000-7f9295321000 ---p 000e6000 08:02 131933                     /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.18
7f9295321000-7f9295329000 r--p 000e5000 08:02 131933                     /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.18
7f9295329000-7f929532b000 rw-p 000ed000 08:02 131933                     /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.18
7f929532b000-7f9295340000 rw-p 00000000 00:00 0 
7f9295340000-7f9295357000 r-xp 00000000 08:02 1441835                    /lib/x86_64-linux-gnu/libpthread-2.17.so
7f9295357000-7f9295557000 ---p 00017000 08:02 1441835                    /lib/x86_64-linux-gnu/libpthread-2.17.so
7f9295557000-7f9295558000 r--p 00017000 08:02 1441835                    /lib/x86_64-linux-gnu/libpthread-2.17.so
7f9295558000-7f9295559000 rw-p 00018000 08:02 1441835                    /lib/x86_64-linux-gnu/libpthread-2.17.so
7f9295559000-7f929555d000 rw-p 00000000 00:00 0 
7f929555d000-7f9295560000 r-xp 00000000 08:02 1441834                    /lib/x86_64-linux-gnu/libdl-2.17.so
7f9295560000-7f929575f000 ---p 00003000 08:02 1441834                    /lib/x86_64-linux-gnu/libdl-2.17.so
7f929575f000-7f9295760000 r--p 00002000 08:02 1441834                    /lib/x86_64-linux-gnu/libdl-2.17.so
7f9295760000-7f9295761000 rw-p 00003000 08:02 1441834                    /lib/x86_64-linux-gnu/libdl-2.17.so
7f9295761000-7f9295772000 r-xp 00000000 08:02 17831870                   /usr/lib/darling/libmach-o.so.1.0.0
7f9295772000-7f9295971000 ---p 00011000 08:02 17831870                   /usr/lib/darling/libmach-o.so.1.0.0
7f9295971000-7f9295972000 r--p 00010000 08:02 17831870                   /usr/lib/darling/libmach-o.so.1.0.0
7f9295972000-7f9295973000 rw-p 00011000 08:02 17831870                   /usr/lib/darling/libmach-o.so.1.0.0
7f9295973000-7f92959a5000 r-xp 00000000 08:02 17831872                   /usr/lib/darling/libdyld.so
7f92959a5000-7f9295ba4000 ---p 00032000 08:02 17831872                   /usr/lib/darling/libdyld.so
7f9295ba4000-7f9295ba5000 r--p 00031000 08:02 17831872                   /usr/lib/darling/libdyld.so
7f9295ba5000-7f9295ba6000 rw-p 00032000 08:02 17831872                   /usr/lib/darling/libdyld.so
7f9295ba6000-7f9295bc9000 r-xp 00000000 08:02 1441822                    /lib/x86_64-linux-gnu/ld-2.17.so
7f9295d9a000-7f9295da4000 rw-p 00000000 00:00 0 
7f9295dc5000-7f9295dc8000 rw-p 00000000 00:00 0 
7f9295dc8000-7f9295dc9000 r--p 00022000 08:02 1441822                    /lib/x86_64-linux-gnu/ld-2.17.so
7f9295dc9000-7f9295dcb000 rw-p 00023000 08:02 1441822                    /lib/x86_64-linux-gnu/ld-2.17.so
7fff1e23b000-7fff1e25c000 rw-p 00000000 00:00 0                          [stack]
7fff1e27e000-7fff1e280000 r-xp 00000000 00:00 0                          [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]
+Abgebrochen (Speicherabzug geschrieben)

[LubosD]

Umm, I fail to see the problem in detectSysRootFromPath(). The only libc call in there is realpath() and I think I am using it correctly, so maybe there is an issue in realpath()?

[LubosD]

If you just run "gcc", then it will not use the "gcc" binary from the local directory. You need to use "./gcc".

[thopiekar]

uups ^^ yes, it is not executable..
Don't know maybe an old problem.. Updated packages on the go: https://code.launchpad.net/~thopiekar/+recipe/darling

[thopiekar]

ok, still present on latest code..

[LubosD]

Would you try this patch? https://gist.github.com/LubosD/8443328

[thopiekar]

thopiekar@home:/home/thopiekar/Projekte/Xcode/Xcode.app/Contents/Developer/usr/bin$ dyld ./ld 
*** buffer overflow detected ***: dyld terminated
======= Backtrace: =========
/lib/x86_64-linux-gnu/libc.so.6(__fortify_fail+0x5c)[0x7f7a1074308c]
/lib/x86_64-linux-gnu/libc.so.6(+0x111020)[0x7f7a10742020]
/lib/x86_64-linux-gnu/libc.so.6(+0x1115c4)[0x7f7a107425c4]
/usr/lib/darling/libdyld.so(_ZN7Darling8MachOMgr21detectSysRootFromPathESs+0x5c)[0x7f7a1186c57c]
dyld(main+0x44c)[0x4027dc]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0x7f7a10652de5]
dyld[0x4022c0]
======= Memory map: ========
00400000-00406000 r-xp 00000000 08:02 166656                             /usr/bin/dyld
00605000-00606000 r--p 00005000 08:02 166656                             /usr/bin/dyld
00606000-00607000 rw-p 00006000 08:02 166656                             /usr/bin/dyld
0115b000-0117c000 rw-p 00000000 00:00 0                                  [heap]
7f7a10631000-7f7a107ee000 r-xp 00000000 08:02 1441833                    /lib/x86_64-linux-gnu/libc-2.17.so
7f7a107ee000-7f7a109ee000 ---p 001bd000 08:02 1441833                    /lib/x86_64-linux-gnu/libc-2.17.so
7f7a109ee000-7f7a109f2000 r--p 001bd000 08:02 1441833                    /lib/x86_64-linux-gnu/libc-2.17.so
7f7a109f2000-7f7a109f4000 rw-p 001c1000 08:02 1441833                    /lib/x86_64-linux-gnu/libc-2.17.so
7f7a109f4000-7f7a109f9000 rw-p 00000000 00:00 0 
7f7a109f9000-7f7a10a0e000 r-xp 00000000 08:02 1447847                    /lib/x86_64-linux-gnu/libgcc_s.so.1
7f7a10a0e000-7f7a10c0d000 ---p 00015000 08:02 1447847                    /lib/x86_64-linux-gnu/libgcc_s.so.1
7f7a10c0d000-7f7a10c0e000 r--p 00014000 08:02 1447847                    /lib/x86_64-linux-gnu/libgcc_s.so.1
7f7a10c0e000-7f7a10c0f000 rw-p 00015000 08:02 1447847                    /lib/x86_64-linux-gnu/libgcc_s.so.1
7f7a10c0f000-7f7a10d12000 r-xp 00000000 08:02 1441819                    /lib/x86_64-linux-gnu/libm-2.17.so
7f7a10d12000-7f7a10f11000 ---p 00103000 08:02 1441819                    /lib/x86_64-linux-gnu/libm-2.17.so
7f7a10f11000-7f7a10f12000 r--p 00102000 08:02 1441819                    /lib/x86_64-linux-gnu/libm-2.17.so
7f7a10f12000-7f7a10f13000 rw-p 00103000 08:02 1441819                    /lib/x86_64-linux-gnu/libm-2.17.so
7f7a10f13000-7f7a10ff9000 r-xp 00000000 08:02 131933                     /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.18
7f7a10ff9000-7f7a111f8000 ---p 000e6000 08:02 131933                     /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.18
7f7a111f8000-7f7a11200000 r--p 000e5000 08:02 131933                     /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.18
7f7a11200000-7f7a11202000 rw-p 000ed000 08:02 131933                     /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.18
7f7a11202000-7f7a11217000 rw-p 00000000 00:00 0 
7f7a11217000-7f7a1122e000 r-xp 00000000 08:02 1441835                    /lib/x86_64-linux-gnu/libpthread-2.17.so
7f7a1122e000-7f7a1142e000 ---p 00017000 08:02 1441835                    /lib/x86_64-linux-gnu/libpthread-2.17.so
7f7a1142e000-7f7a1142f000 r--p 00017000 08:02 1441835                    /lib/x86_64-linux-gnu/libpthread-2.17.so
7f7a1142f000-7f7a11430000 rw-p 00018000 08:02 1441835                    /lib/x86_64-linux-gnu/libpthread-2.17.so
7f7a11430000-7f7a11434000 rw-p 00000000 00:00 0 
7f7a11434000-7f7a11437000 r-xp 00000000 08:02 1441834                    /lib/x86_64-linux-gnu/libdl-2.17.so
7f7a11437000-7f7a11636000 ---p 00003000 08:02 1441834                    /lib/x86_64-linux-gnu/libdl-2.17.so
7f7a11636000-7f7a11637000 r--p 00002000 08:02 1441834                    /lib/x86_64-linux-gnu/libdl-2.17.so
7f7a11637000-7f7a11638000 rw-p 00003000 08:02 1441834                    /lib/x86_64-linux-gnu/libdl-2.17.so
7f7a11638000-7f7a11649000 r-xp 00000000 08:02 17837496                   /usr/lib/darling/libmach-o.so.1.0.0
7f7a11649000-7f7a11848000 ---p 00011000 08:02 17837496                   /usr/lib/darling/libmach-o.so.1.0.0
7f7a11848000-7f7a11849000 r--p 00010000 08:02 17837496                   /usr/lib/darling/libmach-o.so.1.0.0
7f7a11849000-7f7a1184a000 rw-p 00011000 08:02 17837496                   /usr/lib/darling/libmach-o.so.1.0.0
7f7a1184a000-7f7a1187c000 r-xp 00000000 08:02 17837505                   /usr/lib/darling/libdyld.so
7f7a1187c000-7f7a11a7b000 ---p 00032000 08:02 17837505                   /usr/lib/darling/libdyld.so
7f7a11a7b000-7f7a11a7c000 r--p 00031000 08:02 17837505                   /usr/lib/darling/libdyld.so
7f7a11a7c000-7f7a11a7d000 rw-p 00032000 08:02 17837505                   /usr/lib/darling/libdyld.so
7f7a11a7d000-7f7a11aa0000 r-xp 00000000 08:02 1441822                    /lib/x86_64-linux-gnu/ld-2.17.so
7f7a11c6e000-7f7a11c78000 rw-p 00000000 00:00 0 
7f7a11c9c000-7f7a11c9f000 rw-p 00000000 00:00 0 
7f7a11c9f000-7f7a11ca0000 r--p 00022000 08:02 1441822                    /lib/x86_64-linux-gnu/ld-2.17.so
7f7a11ca0000-7f7a11ca2000 rw-p 00023000 08:02 1441822                    /lib/x86_64-linux-gnu/ld-2.17.so
7fffd2d00000-7fffd2d21000 rw-p 00000000 00:00 0                          [stack]
7fffd2d8d000-7fffd2d8f000 r-xp 00000000 00:00 0                          [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]
Abgebrochen (Speicherabzug geschrieben)