problems building gcc4 via smartos-live using gmake world

[tritondatacenter]

problems building gcc4 via smartos-live using gmake world

well, let me ask a different way, is there a base level of the following files that is known to build successfully
on smartos:1.6.3? or perhaps since by default 'master' is being used, is there a file with the latest known working git revisions I can borrow to at least start out with? I'm running a freshly installed 20121004 SmartOS.

cd /root
pkgin -y install wget ; hash -r
wget https://download.joyent.com/pub/build/fake-subset.tbz2
wget https://download.joyent.com/pub/build/setup-build-zone
wget https://download.joyent.com/pub/build/setup-build-zone.xml
chmod +x setup-build-zone
./setup-build-zone
svccfg import setup-build-zone.xml

and

git clone https://github.com/joyent/smartos-live
cd smartos-live
cp sample.configure.smartos configure.smartos
./configure
gmake world && gmake live

[rmustacc]

I assume you didn't meant to close this, but this is exactly what we do and it works fine for us. Someone will have to reproduce it. Unfortunately with the parallel make it isn't exactly obvious why gcc failed to build for you and why, for example, I don't see it. It could be that's an issue with parallelism that having more or fewer cores makes the situation more obvious.

Indeed, it is an error that I closed it, not really used to github yet.
For the moment, until the clone of the production server comes in for build/testing (a supermicro H8SGL-F with an AMD 62xx or hopefully 63xx), I'm using a meager Athlon X2 with now 8G.
As I have had issues trying to 'bootstrap' using jonathan perkins environment using gcc4.4, I've been meaning to ask Rich Lowe if perhaps it could be the compiler, given some of the messages (also found in the attached log file)
like ../../gcc-4.4.4-32/gcc/c-common.c:4754:4: warning: unknown conversion type character 'J' in format [-Wformat].

seems indeed to be a resource problem, since upgrading memory and upgrading the zone as such:

[root@04-4b-80-80-80-03 ~]# vmadm get 85b828de-e12e-4540-9e69-476901d197ca
{
  "zonename": "85b828de-e12e-4540-9e69-476901d197ca",
  "zonepath": "/zones/85b828de-e12e-4540-9e69-476901d197ca",
  "autoboot": true,
  "brand": "joyent",
  "limit_priv": "default",
  "fs_allowed": "ufs,pcfs,tmpfs",
  "create_timestamp": "2012-10-09T19:46:44.629Z",
  "image_uuid": "01b2c898-945f-11e1-a523-af1afbe22822",
  "cpu_shares": 100,
  "zfs_io_priority": 100,
  "max_lwps": 2000,
  "max_physical_memory": 6144,
  "max_locked_memory": 6144,
  "max_swap": 6144,
  "billing_id": "00000000-0000-0000-0000-000000000000",
  "owner_uuid": "00000000-0000-0000-0000-000000000000",
  "tmpfs": 3072,
  "hostname": "devzone",
  "dns_domain": "local",
  "alias": "devzone",
  "nics": [
    {
      "interface": "net0",
      "mac": "c2:71:69:f8:53:60",
      "nic_tag": "admin",
      "gateway": "192.168.0.3",
      "primary": true,
      "ip": "192.168.0.150",
      "netmask": "255.255.255.0"
    }
  ],
  "uuid": "85b828de-e12e-4540-9e69-476901d197ca",
  "last_modified": "2012-10-09T19:47:32.000Z",
  "server_uuid": "",
  "zoneid": 1,
  "zone_state": "running",
  "state": "running",
  "quota": 15,
  "zfs_root_recsize": 131072,
  "zfs_filesystem": "zones/85b828de-e12e-4540-9e69-476901d197ca",
  "zpool": "zones",
  "customer_metadata": {},
  "internal_metadata": {},
  "tags": {}
}

Perhaps tmpfs was way to low...but am sure doubling available memory helps.

I seem to be able to get past the gcc4 build and seem to be on to building the rest, as indicated below. Will see how things fair at the end.

[root@devzone ~/smartos-live]# tail -f s1.log 
devzone.local --> Job output
/root/smartos-live/projects/illumos/usr/src/tools/elfsign
devzone.local --> Job output
/root/smartos-live/projects/illumos/usr/src/tools/onbld
/root/smartos-live/projects/illumos/usr/src/tools/onbld/Checks
/root/smartos-live/projects/illumos/usr/src/tools/onbld/hgext
/root/smartos-live/projects/illumos/usr/src/tools/onbld/Scm
/root/smartos-live/projects/illumos/usr/src/tools/onbld/Checks
/root/smartos-live/projects/illumos/usr/src/tools/onbld/hgext
/root/smartos-live/projects/illumos/usr/src/tools/onbld/Scm
^C

[root@04-4b-80-80-80-03 ~]# tail -n -15 /zones/85b828de-e12e-4540-9e69-476901d197ca/root/root/smartos-live/s1.log 
  /root/smartos-live/proto/usr/bin/g++ '-D_LARGEFILE_SOURCE' '-D_FILE_OFFSET_BITS=64' '-DENABLE_DEBUGGER_SUPPORT' '-DV8_TARGET_ARCH_IA32' '-D__C99FEATURES__=1' -I/root/smartos-live/proto/usr/include -I../deps/v8/src  -Wall -m32 -pthreads -fno-strict-aliasing -m32 -O2 -fno-strict-aliasing -ffunction-sections -fdata-sections -fno-tree-vrp -fno-tree-sink -fno-omit-frame-pointer -fno-rtti -fno-exceptions -MMD -MF /root/smartos-live/projects/illumos-extra/node.js/node-v0.8.9-32/out/Release/.deps//root/smartos-live/projects/illumos-extra/node.js/node-v0.8.9-32/out/Release/obj.target/v8_base/deps/v8/src/ia32/macro-assembler-ia32.o.d.raw -isystem /root/smartos-live/proto//usr/include -Wno-unknown-pragmas -c -o /root/smartos-live/projects/illumos-extra/node.js/node-v0.8.9-32/out/Release/obj.target/v8_base/deps/v8/src/ia32/macro-assembler-ia32.o ../deps/v8/src/ia32/macro-assembler-ia32.cc
  /root/smartos-live/proto/usr/bin/g++ '-D_LARGEFILE_SOURCE' '-D_FILE_OFFSET_BITS=64' '-DENABLE_DEBUGGER_SUPPORT' '-DV8_TARGET_ARCH_IA32' '-D__C99FEATURES__=1' -I/root/smartos-live/proto/usr/include -I../deps/v8/src  -Wall -m32 -pthreads -fno-strict-aliasing -m32 -O2 -fno-strict-aliasing -ffunction-sections -fdata-sections -fno-tree-vrp -fno-tree-sink -fno-omit-frame-pointer -fno-rtti -fno-exceptions -MMD -MF /root/smartos-live/projects/illumos-extra/node.js/node-v0.8.9-32/out/Release/.deps//root/smartos-live/projects/illumos-extra/node.js/node-v0.8.9-32/out/Release/obj.target/v8_base/deps/v8/src/ia32/regexp-macro-assembler-ia32.o.d.raw -isystem /root/smartos-live/proto//usr/include -Wno-unknown-pragmas -c -o /root/smartos-live/projects/illumos-extra/node.js/node-v0.8.9-32/out/Release/obj.target/v8_base/deps/v8/src/ia32/regexp-macro-assembler-ia32.o ../deps/v8/src/ia32/regexp-macro-assembler-ia32.cc
virtual memory exhausted: Resource temporarily unavailable
  /root/smartos-live/proto/usr/bin/g++ '-D_LARGEFILE_SOURCE' '-D_FILE_OFFSET_BITS=64' '-DENABLE_DEBUGGER_SUPPORT' '-DV8_TARGET_ARCH_IA32' '-D__C99FEATURES__=1' -I/root/smartos-live/proto/usr/include -I../deps/v8/src  -Wall -m32 -pthreads -fno-strict-aliasing -m32 -O2 -fno-strict-aliasing -ffunction-sections -fdata-sections -fno-tree-vrp -fno-tree-sink -fno-omit-frame-pointer -fno-rtti -fno-exceptions -MMD -MF /root/smartos-live/projects/illumos-extra/node.js/node-v0.8.9-32/out/Release/.deps//root/smartos-live/projects/illumos-extra/node.js/node-v0.8.9-32/out/Release/obj.target/v8_base/deps/v8/src/ia32/stub-cache-ia32.o.d.raw -isystem /root/smartos-live/proto//usr/include -Wno-unknown-pragmas -c -o /root/smartos-live/projects/illumos-extra/node.js/node-v0.8.9-32/out/Release/obj.target/v8_base/deps/v8/src/ia32/stub-cache-ia32.o ../deps/v8/src/ia32/stub-cache-ia32.cc
gmake[1]: *** [/root/smartos-live/projects/illumos-extra/node.js/node-v0.8.9-32/out/Release/obj.target/v8_base/deps/v8/src/compilation-cache.o] Error 1
gmake[1]: *** Waiting for unfinished jobs....
virtual memory exhausted: Resource temporarily unavailable
gmake[1]: *** [/root/smartos-live/projects/illumos-extra/node.js/node-v0.8.9-32/out/Release/obj.target/v8_base/deps/v8/src/handles.o] Error 1
gmake[1]: Leaving directory `/root/smartos-live/projects/illumos-extra/node.js/node-v0.8.9-32/out'
gmake: *** [node] Error 2
gmake[2]: *** [all_autoconf_32] Error 2
gmake[2]: Leaving directory `/root/smartos-live/projects/illumos-extra/node.js'
gmake[1]: *** [node.js] Error 2
gmake[1]: Leaving directory `/root/smartos-live/projects/illumos-extra'
gmake: *** [1-extra-stamp] Error 2

shite. oh well, just noticed that the global zone has no swap configured by default... do I presume correctly that I could configure swap like on OI and that the devzone will automatically use it, or is there something in particular to do for smartos zones differently than on typical non-global ipkg zones ? other than max_swap that is...

[root@devzone ~]# swap -sh
total: 22M allocated + 116M reserved = 138M used, 4.3G available
...
...
[root@04-4b-80-80-80-03 ~]# swap -sh
total: 103M allocated + 33M reserved = 136M used, 4,3G available
[root@04-4b-80-80-80-03 ~]# swap -lh
No swap devices configured
[root@04-4b-80-80-80-03 ~]# dumpadm
      Dump content: kernel pages
       Dump device: /dev/zvol/dsk/zones/dump (dedicated)
Savecore directory: /var/crash/volatile
  Savecore enabled: yes
   Save compressed: on

can I configure swap on the dump device or do separate zfs volumes still need be used for the swap and dump in SmartOS?

http://docs.oracle.com/cd/E19963-01/html/821-1448/ggrln.html#ggvlr

I created an 8G zones/swap volume and did a swap -a to add it to the global zone and devzone saw up to max_swap as hoped. simply continuing the previous build via gmake world seemed to complete ok as well as gmake live.

now I upped max_swap to 8G and am rebuilding after a gmake clean; gmake update to make sure all will build the first time now...

you guys must be getting tired of me but, much to my chagrin, the build didn't work...
so I tried again by a gmake clean and gmake update plus I did another ./configure.
Cool, a couple hours later, it seemed to have worked.

[root@devzone ~/smartos-live]# tail -n -15 doall.log 
lib/libiostream.so.1 installed as /root/smartos-live/proto/usr/lib/libiostream.so.1
/usr/sbin/install -m 0755 -f /root/smartos-live/proto/usr/lib/amd64 \
    lib/amd64/libCrun.so.1
lib/amd64/libCrun.so.1 installed as /root/smartos-live/proto/usr/lib/amd64/libCrun.so.1
/usr/sbin/install -m 0755 -f /root/smartos-live/proto/usr/lib/amd64 \
    lib/amd64/libCstd.so.1
lib/amd64/libCstd.so.1 installed as /root/smartos-live/proto/usr/lib/amd64/libCstd.so.1
/usr/sbin/install -m 0755 -f /root/smartos-live/proto/usr/lib/amd64 \
    lib/amd64/libdemangle.so.1
lib/amd64/libdemangle.so.1 installed as /root/smartos-live/proto/usr/lib/amd64/libdemangle.so.1
/usr/sbin/install -m 0755 -f /root/smartos-live/proto/usr/lib/amd64 \
    lib/amd64/libiostream.so.1
lib/amd64/libiostream.so.1 installed as /root/smartos-live/proto/usr/lib/amd64/libiostream.so.1
gmake[1]: Leaving directory `/root/smartos-live/projects/devpro'
touch 0-devpro-stamp
[root@devzone ~/smartos-live]# gmake world
gmake: Nothing to be done for `world'.

BTW, I still notice things like:

checking for getchar_unlocked... libtool.m4: error: problem compiling FC test program

Build log available here http://dl.free.fr/v3ZGAjXJi

So in summary, apparently gmake clean over does it making ./configure necessary prior to gmake world && gmake live.

I guess I can close now with a comment to emphasize the resources necessary for the build zone.