Local abort before MPI_INIT completed completed successfully

[nico]

Hello, I recently installed CESM model in my personal computer. I have been able to perform case.setup and case.build succesfully. But the following error ocurred during case.submit.

*** The MPI_Info_f2c() function was called before MPI_INIT was invoked.
*** This is disallowed by the MPI standard.
*** Your MPI job will now abort.
*** The MPI_Info_f2c() function was called before MPI_INIT was invoked.
*** This is disallowed by the MPI standard.
*** Your MPI job will now abort.
[DESKTOP-KSVJLVA:21529] Local abort before MPI_INIT completed completed successfully, but am not able to aggregate error messages, and not able to guarantee that all other processes were killed!
[DESKTOP-KSVJLVA:21531] Local abort before MPI_INIT completed completed successfully, but am not able to aggregate error messages, and not able to guarantee that all other processes were killed!

The error is somehow confusing because the CaseStatus file specifies case.submit success.

I am running the program under Windows Subsystem for Linux, using Ubuntu 22.04.2.

I attach the corresponfing config_machines and config_compilers files. Also find attached CaseStatus and output files atm.log, cesm.log and cpl.log.

I have installed the following dependencies:

zlib-1.2.12
hdf5-1_12_2
netcdf-c-4.9.0
netcdf-fortran-4.6.0
pnetcdf-1.12.3
mpich-4.0.2

The name of the machine under config_machines is DESKTOP-KSVJLVA.

I do not have much experience in compiling and debbuging programs so I hope I have given all the information requiered to understand the
origin of the error :)).

 

[dbailey]

Moving this to porting.

 

[nico]

Hello, I could verify that mpich 4.0.2 os compatible with Ubuntu 22.10 but mpich 4.0 is recommended for Ubuntu 22.04. Should I try other mpi versión, could this be the origin of the error?

 

[nico]

Hello, I am trying to resolve the issue. I thinck somehow I must specify during the build MPI libraries location, becuase MPI_Info_f2c is part of mpi.h. May be, CESM is not able to find and execute, mpi.h.

 

[zzheng]

Hello, I am trying to resolve the issue. I thinck somehow I must specify during the build MPI libraries location, becuase MPI_Info_f2c is part of mpi.h. May be, CESM is not able to find and execute, mpi.h.

Hi Nicolás, I wonder how did you resolve this issue? Thanks

 

[zzheng]

I tried different versions of mpich (4.1.2, 4.0.3, 4.0.2, 4.0.1, and 3.4.3). None of them succeeds.
When I installed the new MPI version, I also include it to "LD_LIBRARY_PATH".

Below is the error I got

Finished creating component namelists
-------------------------------------------------------------------------
 - Prestage required restarts into /home/zhonghua/projects/cesm/scratch/testrun/run
 - Case input data directory (DIN_LOC_ROOT) is /home/zhonghua/projects/cesm/inputdata
 - Checking for required input datasets in DIN_LOC_ROOT
-------------------------------------------------------------------------
2023-07-29 14:51:46 MODEL EXECUTION BEGINS HERE
run command is mpiexec -n 36 -prepend-rank /home/zhonghua/projects/cesm/scratch/testrun/bld/cesm.exe  >> cesm.log.$LID 2>&1
ERROR: RUN FAIL: Command 'mpiexec -n 36 -prepend-rank /home/zhonghua/projects/cesm/scratch/testrun/bld/cesm.exe  >> cesm.log.$LID 2>&1 ' failed
See log file for details: /home/zhonghua/projects/cesm/scratch/testrun/run/cesm.log.230729-145146

Attached is the "cesm.log.230729-145146" file.

Thanks!