This site is migrating to a new forum software on Tuesday, September 24th 2019, you may experience a short downtime during this transition

Main menu

Navigation

running cesm1.2.0 on mac using mpich: Fatal error in MPI_Allgatherv

1 post / 0 new
potmomus@...
running cesm1.2.0 on mac using mpich: Fatal error in MPI_Allgatherv

I'm trying to run cesm1.2.0 on Yosemite 10.10.5. I'm running SD-WACCM. Right now I can run the model with mpi-serial. But it is very slow. So I try to use mpi.

I set <entry id="MPILIB"   value="mpich"  />

 

MPI_LIB_NAME:=mpi

 

MPI_PATH:=/opt/local/

I set NTASKS to 4 for all the components(ATM,LND,ICE,OCN,CPL,GLC,ROF and WAV)

and after configure, env_mach_pes.xml file shows:

<entry id="TOTALPES"   value="4"  />

<entry id="PES_LEVEL"   value="1r"  />

<entry id="MAX_TASKS_PER_NODE"   value="1"  />

<entry id="PES_PER_NODE"   value="$MAX_TASKS_PER_NODE"  />

<entry id="COST_PES"   value="0"  />

<entry id="CCSM_PCOST"   value="2"  />

<entry id="CCSM_TCOST"   value="0"  />

 

<entry id="CCSM_ESTCOST"   value="8"  />


I build the model and run the model with:

 

mpirun -np 4 $EXEROOT/cesm.exe >&! cesm.log.$LID

The model crashes and the cesm.log file shows:


Fatal error in MPI_Allgatherv: Invalid buffer pointer, error stack:

MPI_Allgatherv(1122): MPI_Allgatherv(sbuf=0x7fc6b8e27900, scount=24, MPI_DOUBLE_PRECISION, rbuf=0x7fc6b8e27840, rcounts=0x7fc6b8e25920, displs=0x7fc6b8e25810, MPI_DOUBLE_PRECISION, comm=0x84000006) failed

MPI_Allgatherv(1070): Buffers must not be aliased

Fatal error in MPI_Allgatherv: Invalid buffer pointer, error stack:

MPI_Allgatherv(1122): MPI_Allgatherv(sbuf=0x7fa2f1ccb140, scount=24, MPI_DOUBLE_PRECISION, rbuf=0x7fa2f1ccb140, rcounts=0x7fa301d01bb0, displs=0x7fa2f1ccaa30, MPI_DOUBLE_PRECISION, comm=0xc4000002) failed

 

MPI_Allgatherv(1070): Buffers must not be aliased


Could anyone help me with this problem?

Who's new

  • jwolff
  • tinna.gunnarsdo...
  • sarthak2235@...
  • eolivares@...
  • shubham.gandhi@...