[Gnash-dev] Porting gnash to Sun Solaris x86, endianness detection issues.

[Criveti Mihai]

I am trying to port gnash to Solaris x86 in order to profile it via DTrace, and had some issues regarding endianness.

cmsol% make
make  all-recursive
make[1]: Entering directory `/export/home/cmihai/Desktop/testing/gnash-
0.7.2'
Making all in libbase
make[2]: Entering directory `/export/home/cmihai/Desktop/testing/gnash-0.7.2/libbase'
source='container.cpp' object='container.lo' libtool=yes \
DEPDIR=.deps depmode=none /bin/bash ../depcomp \
/bin/bash
../libtool --tag=CXX --mode=compile g++ -DHAVE_CONFIG_H -I. -I. -I..
 -I.. -I. -I.. -I../server -D_REENTRANT -pthreads
 -I/usr/include/libxml2      -I/opt/csw/include -DQT_THREAD_SUPPORT
 -D_REENTRANT -D_POSIX_PTHREAD_SEMANTICS -DUSE_SOLARIS -DSVR4  -g -O2
-D_REENTRANT -pthreads -march=pentium4     -W     -Wall
    -Wcast-align     -Wcast-qual     -Wpointer-arith     -Wreturn-type
     -c -o container.lo container.cpp
 g++ -DHAVE_CONFIG_H -I. -I.
-I.. -I.. -I. -I.. -I../server -D_REENTRANT -pthreads
-I/usr/include/libxml2 -I/opt/csw/include -DQT_THREAD_SUPPORT
-D_REENTRANT -D_POSIX_PTHREAD_SEMANTICS -DUSE_SOLARIS -DSVR4 -g -O2
-D_REENTRANT -pthreads -march=pentium4 -W -Wall -Wcast-align
-Wcast-qual -Wpointer-arith -Wreturn-type -c container.cpp  -fPIC -DPIC
-o .libs/container.o
In file included from utility.h:15,
                 from container.h:72,
                 from container.cpp:16:
tu_types.h:70:6: #error BYTE_ORDER not defined by endian.h. :(
tu_types.h:74:68: operator '==' has no right operand
make[2]: *** [container.lo] Error 1
make[2]: Leaving directory `/export/home/cmihai/Desktop/testing/gnash-0.7.2/libbase'/c
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory `/export/home/cmihai/Desktop/testing/gnash-
0.7.2'
make: *** [all] Error 2

The problem was in tu_types.h
My (temporary) solution was to remove detection and enforce LITTLE_ENDIAN (#  define _TU_LITTLE_ENDIAN_ 1)

68a69,71
> #  ifndef BYTE_ORDER
> #    error BYTE_ORDER not defined by endian.h. :(
> #  endif // BYTE_ORDER
70a74
> #if ((BYTE_ORDER == __LITTLE_ENDIAN)||(BYTE_ORDER == _LITTLE_ENDIAN))
71a76,78
> #else
> #     undef _TU_LITTLE_ENDIAN_
> #endif //BYTE_ORDER == SDL_LIL_ENDIAN




After the changes, gnash works on Solaris x86 (SXCE:61).