aster-11.4.0, waf and OS X

podallaire

Hi,

today I spent some time to update my Code_Aster installation on the MacBook with the

latest stable version. Things went "okay" for HDF, Metis, Scotch and others. I re-used

some of the original patches from the Wiki. However, I have some challenges now using

the new compiling engine included, waf. I,m curious to hear if anybody had success ?

I'm using Gcc/gfortran 4.6.3 that I compiled from src. Looks like some of the war settings

will have to be tweaking in the aster-11.4.0-pkg.tar.gz file:

Command line : ./waf configure --use-config=auto_config --install-tests --prefix=/opt/aster-11.4.0/11.4 configure aster installation... Command output : Setting top to : /private/var/folders/8b/hj8b3wl90pq08mr4zqtf0njw0000gn/T/install_aster.28005/aster-11.4.0 Setting out to : /private/var/folders/8b/hj8b3wl90pq08mr4zqtf0njw0000gn/T/install_aster.28005/aster-11.4.0/build Checking for custom configuration : auto_config Getting Code_Aster version : [(11, 4, 0), '75f09ed53e5a', 'v11', '05/06/2013', 'v11', 0] fortran link verbose flag : failure Could not obtain the fortran link verbose flag (see config.log) (complete log in /private/var/folders/8b/hj8b3wl90pq08mr4zqtf0njw0000gn/T/install_aster.28005/aster-11.4.0/build/config.log) EXIT_COMMAND_28005_00000052=1 configure aster installation... [FAILED] Exit code : 1 Setting top to : /private/var/folders/8b/hj8b3wl90pq08mr4zqtf0njw0000gn/T/install_aster.28005/aster-11.4.0 Setting out to : /private/var/folders/8b/hj8b3wl90pq08mr4zqtf0njw0000gn/T/install_aster.28005/aster-11.4.0/build Checking for custom configuration : auto_config Getting Code_Aster version : [(11, 4, 0), '75f09ed53e5a', 'v11', '05/06/2013', 'v11', 0] fortran link verbose flag : failure Could not obtain the fortran link verbose flag (see config.log) (complete log in /private/var/folders/8b/hj8b3wl90pq08mr4zqtf0njw0000gn/T/install_aster.28005/aster-11.4.0/build/config.log)

EXIT_COMMAND_28005_00000052=1

project configured on Sun Sep 22 18 2013 by # waf 1.6.10 (abi 98, python 20702f0 on darwin) # using ./waf configure --use-config=auto_config --install-tests --prefix=/opt/aster-11.4.0/11.4 # ---------------------------------------- Setting top to /private/var/folders/8b/hj8b3wl90pq08mr4zqtf0njw0000gn/T/install_aster.28005/aster-11.4.0 ---------------------------------------- Setting out to /private/var/folders/8b/hj8b3wl90pq08mr4zqtf0njw0000gn/T/install_aster.28005/aster-11.4.0/build ---------------------------------------- Checking for custom configuration auto_config ---------------------------------------- Getting Code_Aster version [(11, 4, 0), '75f09ed53e5a', 'v11', '05/06/2013', 'v11', 0] ---------------------------------------- fortran link verbose flag ==> PROGRAM MAIN END <==[1/2] fc: build/.conf_check_ad76e8609545884f267d581d69469b48/test.f -> build/.conf_check_ad76e8609545884f267d581d69469b48/testbuild/test.f.1.o ['/opt/gcc-4.6.3/bin/gfortran-4.6.3', '/opt/aster-11.4.0/public/hdf5-1.8.8/include', '/opt/aster-11.4.0/public/med-3.0.6/include', '/opt/aster-11.4.0/public /metis-4.0.3/include', '/opt/aster-11.4.0/public/scotch_5.1.11_esmumps/include', 'USE_OPENMP=1', '/private/var/folders/8b/hj8b3wl90pq08mr4zqtf0njw0000gn/T/i nstall_aster.28005/aster-11.4.0/build/.conf_check_ad76e8609545884f267d581d69469b48/testbuild/test.f.1.o', '/private/var/folders/8b/hj8b3wl90pq08mr4zqtf0njw0 000gn/T/install_aster.28005/aster-11.4.0/build/.conf_check_ad76e8609545884f267d581d69469b48/test.f'] err: gfortran-4.6.3: error: USE_OPENMP=1: No such file or directory gfortran-4.6.3: error: /private/var/folders/8b/hj8b3wl90pq08mr4zqtf0njw0000gn/T/install_aster.28005/aster-11.4.0/build/.conf_check_ad76e8609545884f267d581d6 9469b48/testbuild/test.f.1.o: No such file or directory from /private/var/folders/8b/hj8b3wl90pq08mr4zqtf0njw0000gn/T/install_aster.28005/aster-11.4.0: Test does not build: Traceback (most recent call last): File "/private/var/folders/8b/hj8b3wl90pq08mr4zqtf0njw0000gn/T/install_aster.28005/aster-11.4.0/.waf-1.6.10-84fbc87adc22fe809febcc192afd90b1/waflib/Tools/c_config.py", line 445, in run_c_code bld.compile() File "/private/var/folders/8b/hj8b3wl90pq08mr4zqtf0njw0000gn/T/install_aster.28005/aster-11.4.0/.waf-1.6.10-84fbc87adc22fe809febcc192afd90b1/waflib/Build. py", line 190, in compile raise Errors.BuildError(self.producer.error) BuildError: Build failed -> task failed (exit status 1): {task 4545751504: fc test.f -> test.f.1.o}

...

Thanks

mathieu.courtois

Hello,

It fails because there is an argument USE_OPENMP=1 in the command line.

It shoud be: -DUSE_OPENMP=1

I don't know how waf works on OS X.

waf should define these variables:

DEFINES_ST = '-D%s'

FCDEFINES_ST = '-D%s'

I have to investigate in the waf source (Tools/fc.py, Tools/fc_config.py). You can dowload the source of waf 1.6.10 we are based on.

podallaire

courtois wrote:
Hello,

It fails because there is an argument USE_OPENMP=1 in the command line.

It shoud be: -DUSE_OPENMP=1

I don't know how waf works on OS X.

waf should define these variables:

DEFINES_ST = '-D%s'

FCDEFINES_ST = '-D%s'

I have to investigate in the waf source (Tools/fc.py, Tools/fc_config.py). You can dowload the source of waf 1.6.10 we are based on.

MC

Thanks, I'll give it a try and post the solution if I can make it work. Let me know if you find something.

podallaire

Hi,

I have tempted couple things without success. I'm compiling aster on a linux system

to learn a bit more about waf since I never used it before.

bvenkat

Good day,

I too am facing some issues.

For the build to proceed, I had to comment out:

line 26 in aster-11.4.0/bibc/wscript:

self.env.append_unique('LINKFLAGS', ['-Wl,--export-dynamic'])

line 39 in aster-11.4.0/bibfor/wscript:

self.env.prepend_value('FCSHLIB_MARKER', '-Wl,-Bdynamic')

It fails during linking, attached is the log file with details.

Any ideas what is happening?

Regards,

Venkat

Attached file:
setup.log, 1334452kb

podallaire

I've tried different combinations - no success yet. I've been using a modified version

of the waf source code as well.

Guys - any progress on your side ?

Thanks

podallaire

podallaire wrote:
I've tried different combinations - no success yet. I've been using a modified version

of the waf source code as well.

Guys - any progress on your side ?

Thanks

Hey guys, this thread has been quiet for some time. I have not made any progress on this but on the other

hand, I was able to install the previous code aster release on OS X version 10.9.

Regards,

bvenkat

Good day,

Same here - am running 11.2 on Mavericks. I don't understand the build system, need to study it to investigate further.

Have you had any luck with Salome?

Regards,

Venkat

podallaire

Hi,

No luck with Salome, I have been using Gmsh instead. There are couple threads here:

http://www.salome-platform.org/forum/forum_9/thread_1189

http://files.salome-platform.org/edf/SalomeBuildWithFink.html

Regards,

podallaire

Hi,

this thread has been inactive for some time and I was curious to see if somebody has been

able to install the latest version and tweak waf to work with OS X.

Thanks

ThomasDESOZA

podallaire wrote:
Hi,

this thread has been inactive for some time and I was curious to see if somebody has been

able to install the latest version and tweak waf to work with OS X.

Thanks

PO

Still haven't taken the time to update my Aster install on Lion but I'm planning on it so stay tuned !

AsterO'dactyle

Thomas DE SOZA wrote:
Still haven't taken the time to update my Aster install on Lion but I'm planning on it so stay tuned !

Not enough time for you.

A lot of things to do !

ThomasDESOZA

AsterO'dactyle wrote:
[quote=Thomas DE SOZA]Still haven't taken the time to update my Aster install on Lion but I'm planning on it so stay tuned !

Not enough time for you.

A lot of things to do ![/quote]

You're right, master Jedi.

ThomasDESOZA

Hi,

I found some time to attempt Code_Aster installation (unstable) on OS X (Lion). Sadly, a problem at link stage prevents the install from finishing.

Indeed the way the link command is built in Waf triggers the "argument list too long" error (with Aster more than 7000 objects need to be linked). Mac OS X cannot accept more than 262144 bytes on a single command line (getconf ARG_MAX).

On recent Linux distros, this does not happen because the maximum number of bytes allowed has been pushed to a fraction of the stacksize, it is not a hard-coded value anymore.

Note : when building 11.5/12.1 or below, one does not clearly encounter this error (but rather a brutal stop of the waf install as observed by Venkat above), you need a more recent Waf version to catch the error (such a version is provided in the unstable branch of Code_Aster)

I'll try to post an issue in the Waf bug tracker to see if this error can be overcome. I tried a workaround by modifying the link command line to read the arguments from a file but it did not succeed (subsequent call to the linker triggers the error again).

TdS

podallaire

Thanks Thomas

bvenkat

Good day Thomas,

Grateful if you can advise how you are able to build the unstable (from bitbucket) version without already having an existing 11.5/12.1 install. As per the tutorial, $ASTER_ROOT/12.1/share/aster/aster_full_config.py is assumed to be present and without which the compilation cannot proceed.

Regards,

Venkat

ThomasDESOZA

bvenkat wrote:
Grateful if you can advise how you are able to build the unstable (from bitbucket) version without already having an existing 11.5/12.1 install. As per the tutorial, $ASTER_ROOT/12.1/share/aster/aster_full_config.py is assumed to be present and without which the compilation cannot proceed.

The stable or testing install from the aster-full source package is mainly needed to get the prerequisites right and the waf config file, one does need to complete the core aster install to proceed to the unstable installation. I did install all the prerequisites using this procedure, then I directly jumped to cloning the Bitbucket repository, hoping the more recent waf embedded in the Code_Aster source tree might solve the problem. As I said above, it does indeed reveal the source of the error (argument list too long generated at link stage) but we still need to figure out how to overcome it.

TdS

bvenkat

Good day,

I posted this issue on the waf support group and the reply proposed solution can be seen at:

https://groups.google.com/forum/#!topic/waf-users/XTfeSbUuNzQ

Will try and revert with findings.

Regards,

Venkat

ThomasDESOZA

Hi,

Using the hint from Thomas Nagy I was able to workaround the "argument list too long" error at link stage. Additional patches to Code_Aster source files are required then to have a working install.

I've pushed a commit including the required changes (quick and dirty for some) to a Bitbucket repository : https://bitbucket.org/desoza/codeaster-src/commits/b8a6166cd19356fddb390fba6f4501c8a8abe5c3

It is made for the unstable version but it should be applicable to the stable branch or to the testing version.

These include :

- waf config file

- wscript patches to overcome the argument list too long error

- patches to C source files : some fonctions used for memory allocation and error management are not provided in Apple's API and prevent linking

- patch to impmem.F90 : VMPeak measurement not supported in OS X

- patch E_SUPERV.py : consequence of VMPeak deactivation

We'll try to include these patches in the main branch to facilitate future installations.

Enjoy !

TdS

podallaire

Thomas DE SOZA wrote:
Hi,

Using the hint from Thomas Nagy I was able to workaround the "argument list too long" error at link stage. Additional patches to Code_Aster source files are required then to have a working install.

I've pushed a commit including the required changes (quick and dirty for some) to a Bitbucket repository : https://bitbucket.org/desoza/codeaster-src/commits/b8a6166cd19356fddb390fba6f4501c8a8abe5c3

It is made for the unstable version but it should be applicable to the stable branch or to the testing version.

These include :

- waf config file

- wscript patches to overcome the argument list too long error

- patches to C source files : some fonctions used for memory allocation and error management are not provided in Apple's API and prevent linking

- patch to impmem.F90 : VMPeak measurement not supported in OS X

- patch E_SUPERV.py : consequence of VMPeak deactivation

We'll try to include these patches in the main branch to facilitate future installations.

Enjoy !

TdS

Thanks !

Are you using the preinstalled Python or the one from Macport ? I'm getting this error with Waf:

Checking for program python : /usr/bin/python

Checking for python version : (2, 7, 5, 'final', 0)

Checking for library python2.7 in LIBDIR : not found

Checking for library python2.7 in python_LIBPL : not found

Checking for library python2.7 in $prefix/libs : not found

Checking for library python2.7m in LIBDIR : not found

Checking for library python2.7m in python_LIBPL : not found

Checking for library python2.7m in $prefix/libs : not found

Checking for library python27 in LIBDIR : not found

Checking for library python27 in python_LIBPL : not found

Checking for library python27 in $prefix/libs : not found

Checking for program /usr/bin/python-config,python2.7-config,python-config-2.7,python2.7m-config : /usr/bin/python-config

Checking for header Python.h : :-(

Asking python-config for pyembed --cflags flags : yes

Asking python-config for pyembed --libs flags : yes

Asking python-config for pyembed --ldflags flags : yes

Getting pyembed flags from python-config : Could not build a python embedded interpreter

The configuration failed