taylor_hughlett@gmail_com
New Member
Good afternoon all,
I am attempting to run a ported simulation from yellowstone that immediately terminates with MPT/MPI errors as follows:0:(seq_comm_setcomm) initialize ID ( 1 GLOBAL ) pelist = 0 251 1 ( npes = 252) ( nthreads = 1)0:(seq_comm_setcomm) initialize ID ( 2 CPL ) pelist = 0 44 1 ( npes = 45) ( nthreads = 1)0:(seq_comm_setcomm) initialize ID ( 17 ATM ) pelist = 0 44 1 ( npes = 45) ( nthreads = 1)0:(seq_comm_joincomm) initialize ID ( 18 CPLATM ) join IDs = 2 17 ( npes = 45) ( nthreads = 1)0:(seq_comm_jcommarr) initialize ID ( 3 ALLATMID ) join multiple comp IDs ( npes = 45) ( nthreads = 1)0:(seq_comm_joincomm) initialize ID ( 10 CPLALLATMID ) join IDs = 2 3 ( npes = 45) ( nthreads = 1)64:MPT ERROR: rank:64, function:MPI_GROUP_RANGE_INCL, Invalid argument72:MPT ERROR: rank:72, function:MPI_GROUP_RANGE_INCL, Invalid argument112:MPT ERROR: rank:112, function:MPI_GROUP_RANGE_INCL, Invalid argument0:(seq_comm_setcomm) initialize ID ( 19 LND ) pelist = 0 44 1 ( npes = 45) ( nthreads = 1)0:(seq_comm_joincomm) initialize ID ( 20 CPLLND ) join IDs = 2 19 ( npes = 45) ( nthreads = 1)65:MPT ERROR: rank:65, function:MPI_GROUP_RANGE_INCL, Invalid argument74:MPT ERROR: rank:74, function:MPI_GROUP_RANGE_INCL, Invalid argument113:MPT ERROR: rank:113, function:MPI_GROUP_RANGE_INCL, Invalid argument0:(seq_comm_jcommarr) initialize ID ( 4 ALLLNDID ) join multiple comp IDs ( npes = 45) ( nthreads = 1)0:(seq_comm_joincomm) initialize ID ( 11 CPLALLLNDID ) join IDs = 2 4 ( npes = 45) ( nthreads = 1)66:MPT ERROR: rank:66, function:MPI_GROUP_RANGE_INCL, Invalid argument80:MPT ERROR: rank:80, function:MPI_GROUP_RANGE_INCL, Invalid argument114:MPT ERROR: rank:114, function:MPI_GROUP_RANGE_INCL, Invalid argument0:MPT ERROR: rank:0, function:MPI_GROUP_RANGE_INCL, Invalid argument67:MPT ERROR: rank:67, function:MPI_GROUP_RANGE_INCL, Invalid argument81:MPT ERROR: rank:81, function:MPI_GROUP_RANGE_INCL, Invalid argument115:MPT ERROR: rank:115, function:MPI_GROUP_RANGE_INCL, Invalid argument1:MPT ERROR: rank:1, function:MPI_GROUP_RANGE_INCL, Invalid argument68:MPT ERROR: rank:68, function:MPI_GROUP_RANGE_INCL, Invalid argument84:MPT ERROR: rank:84, function:MPI_GROUP_RANGE_INCL, Invalid argument116:MPT ERROR: rank:116, function:MPI_GROUP_RANGE_INCL, Invalid argument4:MPT ERROR: rank:4, function:MPI_GROUP_RANGE_INCL, Invalid argument69:MPT ERROR: rank:69, function:MPI_GROUP_RANGE_INCL, Invalid argument85:MPT ERROR: rank:85, function:MPI_GROUP_RANGE_INCL, Invalid argument118:MPT ERROR: rank:118, function:MPI_GROUP_RANGE_INCL, Invalid argument5:MPT ERROR: rank:5, function:MPI_GROUP_RANGE_INCL, Invalid argument70:MPT ERROR: rank:70, function:MPI_GROUP_RANGE_INCL, Invalid argument86:MPT ERROR: rank:86, function:MPI_GROUP_RANGE_INCL, Invalid argument120:MPT ERROR: rank:120, function:MPI_GROUP_RANGE_INCL, Invalid argument0:MPT ERROR: Rank 0(g:0) is aborting with error code 0.0: Process ID: 14672, Host: r1i5n23, Program: /glade2/scratch2/hughlett/b.e12.IRF.B1850BDRD.f09_g16/bld/cesm.exe0: MPT Version: SGI MPT 2.15 09/03/16 04:15:540:0:MPT: --------stack traceback-------I have never run into this before, so I am at a loss. Any suggestion would be great, and I can provide whatever info you need as well.
Thanks,
Taylor
I am attempting to run a ported simulation from yellowstone that immediately terminates with MPT/MPI errors as follows:0:(seq_comm_setcomm) initialize ID ( 1 GLOBAL ) pelist = 0 251 1 ( npes = 252) ( nthreads = 1)0:(seq_comm_setcomm) initialize ID ( 2 CPL ) pelist = 0 44 1 ( npes = 45) ( nthreads = 1)0:(seq_comm_setcomm) initialize ID ( 17 ATM ) pelist = 0 44 1 ( npes = 45) ( nthreads = 1)0:(seq_comm_joincomm) initialize ID ( 18 CPLATM ) join IDs = 2 17 ( npes = 45) ( nthreads = 1)0:(seq_comm_jcommarr) initialize ID ( 3 ALLATMID ) join multiple comp IDs ( npes = 45) ( nthreads = 1)0:(seq_comm_joincomm) initialize ID ( 10 CPLALLATMID ) join IDs = 2 3 ( npes = 45) ( nthreads = 1)64:MPT ERROR: rank:64, function:MPI_GROUP_RANGE_INCL, Invalid argument72:MPT ERROR: rank:72, function:MPI_GROUP_RANGE_INCL, Invalid argument112:MPT ERROR: rank:112, function:MPI_GROUP_RANGE_INCL, Invalid argument0:(seq_comm_setcomm) initialize ID ( 19 LND ) pelist = 0 44 1 ( npes = 45) ( nthreads = 1)0:(seq_comm_joincomm) initialize ID ( 20 CPLLND ) join IDs = 2 19 ( npes = 45) ( nthreads = 1)65:MPT ERROR: rank:65, function:MPI_GROUP_RANGE_INCL, Invalid argument74:MPT ERROR: rank:74, function:MPI_GROUP_RANGE_INCL, Invalid argument113:MPT ERROR: rank:113, function:MPI_GROUP_RANGE_INCL, Invalid argument0:(seq_comm_jcommarr) initialize ID ( 4 ALLLNDID ) join multiple comp IDs ( npes = 45) ( nthreads = 1)0:(seq_comm_joincomm) initialize ID ( 11 CPLALLLNDID ) join IDs = 2 4 ( npes = 45) ( nthreads = 1)66:MPT ERROR: rank:66, function:MPI_GROUP_RANGE_INCL, Invalid argument80:MPT ERROR: rank:80, function:MPI_GROUP_RANGE_INCL, Invalid argument114:MPT ERROR: rank:114, function:MPI_GROUP_RANGE_INCL, Invalid argument0:MPT ERROR: rank:0, function:MPI_GROUP_RANGE_INCL, Invalid argument67:MPT ERROR: rank:67, function:MPI_GROUP_RANGE_INCL, Invalid argument81:MPT ERROR: rank:81, function:MPI_GROUP_RANGE_INCL, Invalid argument115:MPT ERROR: rank:115, function:MPI_GROUP_RANGE_INCL, Invalid argument1:MPT ERROR: rank:1, function:MPI_GROUP_RANGE_INCL, Invalid argument68:MPT ERROR: rank:68, function:MPI_GROUP_RANGE_INCL, Invalid argument84:MPT ERROR: rank:84, function:MPI_GROUP_RANGE_INCL, Invalid argument116:MPT ERROR: rank:116, function:MPI_GROUP_RANGE_INCL, Invalid argument4:MPT ERROR: rank:4, function:MPI_GROUP_RANGE_INCL, Invalid argument69:MPT ERROR: rank:69, function:MPI_GROUP_RANGE_INCL, Invalid argument85:MPT ERROR: rank:85, function:MPI_GROUP_RANGE_INCL, Invalid argument118:MPT ERROR: rank:118, function:MPI_GROUP_RANGE_INCL, Invalid argument5:MPT ERROR: rank:5, function:MPI_GROUP_RANGE_INCL, Invalid argument70:MPT ERROR: rank:70, function:MPI_GROUP_RANGE_INCL, Invalid argument86:MPT ERROR: rank:86, function:MPI_GROUP_RANGE_INCL, Invalid argument120:MPT ERROR: rank:120, function:MPI_GROUP_RANGE_INCL, Invalid argument0:MPT ERROR: Rank 0(g:0) is aborting with error code 0.0: Process ID: 14672, Host: r1i5n23, Program: /glade2/scratch2/hughlett/b.e12.IRF.B1850BDRD.f09_g16/bld/cesm.exe0: MPT Version: SGI MPT 2.15 09/03/16 04:15:540:0:MPT: --------stack traceback-------I have never run into this before, so I am at a loss. Any suggestion would be great, and I can provide whatever info you need as well.
Thanks,
Taylor