cesm2.1 submit error

Ting · Jan 5, 2021

I have successfully built CESM 2.1 on my university's HPC, but when I submit sample case of guide book, I met an error. This error is shown in $RUNROOT (cesm.log.210106-123255).

Can anyone help me figure out this problem?

Ting · Jan 5, 2021

Invalid PIO rearranger comm max pend req (comp2io), 0
Resetting PIO rearranger comm max pend req (comp2io) to 64
PIO rearranger options:
comm type =
p2p

comm fcd =
2denable

max pend req (comp2io) = 0
enable_hs (comp2io) = T
enable_isend (comp2io) = F
max pend req (io2comp) = 64
enable_hs (io2comp) = F
enable_isend (io2comp) = T
(seq_comm_setcomm) init ID ( 1 GLOBAL ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_setcomm) init ID ( 2 CPL ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_setcomm) init ID ( 5 ATM ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 6 CPLATM ) join IDs = 2 5 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 3 ALLATMID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 4 CPLALLATMID ) join IDs = 2 3 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 9 LND ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 10 CPLLND ) join IDs = 2 9 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 7 ALLLNDID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 8 CPLALLLNDID ) join IDs = 2 7 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 13 ICE ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 14 CPLICE ) join IDs = 2 13 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 11 ALLICEID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 12 CPLALLICEID ) join IDs = 2 11 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 17 OCN ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 18 CPLOCN ) join IDs = 2 17 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 15 ALLOCNID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 16 CPLALLOCNID ) join IDs = 2 15 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 21 ROF ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 22 CPLROF ) join IDs = 2 21 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 19 ALLROFID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 20 CPLALLROFID ) join IDs = 2 19 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 25 GLC ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 26 CPLGLC ) join IDs = 2 25 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 23 ALLGLCID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 24 CPLALLGLCID ) join IDs = 2 23 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 29 WAV ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 30 CPLWAV ) join IDs = 2 29 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 27 ALLWAVID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 28 CPLALLWAVID ) join IDs = 2 27 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 33 ESP ) pelist = 0 0 1 ( npes = 1) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 34 CPLESP ) join IDs = 2 33 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 31 ALLESPID ) join multiple comp IDs ( npes = 1) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 32 CPLALLESPID ) join IDs = 2 31 ( npes = 80) ( nthreads = 1)
(seq_comm_printcomms) 1 0 80 1 GLOBAL:
(seq_comm_printcomms) 2 0 80 1 CPL:
(seq_comm_printcomms) 3 0 80 1 ALLATMID:
(seq_comm_printcomms) 4 0 80 1 CPLALLATMID:
(seq_comm_printcomms) 5 0 80 1 ATM:
(seq_comm_printcomms) 6 0 80 1 CPLATM:
(seq_comm_printcomms) 7 0 80 1 ALLLNDID:
(seq_comm_printcomms) 8 0 80 1 CPLALLLNDID:
(seq_comm_printcomms) 9 0 80 1 LND:
(seq_comm_printcomms) 10 0 80 1 CPLLND:
(seq_comm_printcomms) 11 0 80 1 ALLICEID:
(seq_comm_printcomms) 12 0 80 1 CPLALLICEID:
(seq_comm_printcomms) 13 0 80 1 ICE:
(seq_comm_printcomms) 14 0 80 1 CPLICE:
(seq_comm_printcomms) 15 0 80 1 ALLOCNID:
(seq_comm_printcomms) 16 0 80 1 CPLALLOCNID:
(seq_comm_printcomms) 17 0 80 1 OCN:
(seq_comm_printcomms) 18 0 80 1 CPLOCN:
(seq_comm_printcomms) 19 0 80 1 ALLROFID:
(seq_comm_printcomms) 20 0 80 1 CPLALLROFID:
(seq_comm_printcomms) 21 0 80 1 ROF:
(seq_comm_printcomms) 22 0 80 1 CPLROF:
(seq_comm_printcomms) 23 0 80 1 ALLGLCID:
(seq_comm_printcomms) 24 0 80 1 CPLALLGLCID:
(seq_comm_printcomms) 25 0 80 1 GLC:
(seq_comm_printcomms) 26 0 80 1 CPLGLC:
(seq_comm_printcomms) 27 0 80 1 ALLWAVID:
(seq_comm_printcomms) 28 0 80 1 CPLALLWAVID:
(seq_comm_printcomms) 29 0 80 1 WAV:
(seq_comm_printcomms) 30 0 80 1 CPLWAV:
(seq_comm_printcomms) 31 0 1 1 ALLESPID:
(seq_comm_printcomms) 32 0 80 1 CPLALLESPID:
(seq_comm_printcomms) 33 0 1 1 ESP:
(seq_comm_printcomms) 34 0 80 1 CPLESP:
(t_initf) Read in prof_inparm namelist from: drv_in
(t_initf) Using profile_disable= F
(t_initf) profile_timer= 4
(t_initf) profile_depth_limit= 4

Stack trace terminated abnormally.

Ting · Jan 5, 2021

These are detailed error and my configuration.

altuntas · Jan 6, 2021

Hi Ting,

Which guide are you following? Can you give more information on the case and the compset you are trying to run. See: Information to include in help requests

Ting · Jan 6, 2021

altuntas said:
Hi Ting,

Which guide are you following? Can you give more information on the case and the compset you are trying to run. See: Information to include in help requests

Thanks for your reply! I have solved the previous question that I posted on the another poster. Now, I am testing atmosphere component (CAM) of CESM 2.1.3. I have successfully build the example case (./create_newcase --case aqua_case --compset QSC6 --res f09_f09_mg17) in my machine, but when I try to submit this case, I met this problem. The guide book I followed is CAM 6.3 User's Guide.
I am using a new machine and I am a new modeler as well, so I am not sure which step is wrong when I port CESM. Thus I posted all my files below. Thanks!!!

zongy17 · Jul 17, 2021

Ting said:
Invalid PIO rearranger comm max pend req (comp2io), 0
Resetting PIO rearranger comm max pend req (comp2io) to 64
PIO rearranger options:
comm type =
p2p

comm fcd =
2denable

max pend req (comp2io) = 0
enable_hs (comp2io) = T
enable_isend (comp2io) = F
max pend req (io2comp) = 64
enable_hs (io2comp) = F
enable_isend (io2comp) = T
(seq_comm_setcomm) init ID ( 1 GLOBAL ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_setcomm) init ID ( 2 CPL ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_setcomm) init ID ( 5 ATM ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 6 CPLATM ) join IDs = 2 5 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 3 ALLATMID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 4 CPLALLATMID ) join IDs = 2 3 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 9 LND ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 10 CPLLND ) join IDs = 2 9 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 7 ALLLNDID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 8 CPLALLLNDID ) join IDs = 2 7 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 13 ICE ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 14 CPLICE ) join IDs = 2 13 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 11 ALLICEID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 12 CPLALLICEID ) join IDs = 2 11 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 17 OCN ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 18 CPLOCN ) join IDs = 2 17 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 15 ALLOCNID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 16 CPLALLOCNID ) join IDs = 2 15 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 21 ROF ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 22 CPLROF ) join IDs = 2 21 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 19 ALLROFID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 20 CPLALLROFID ) join IDs = 2 19 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 25 GLC ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 26 CPLGLC ) join IDs = 2 25 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 23 ALLGLCID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 24 CPLALLGLCID ) join IDs = 2 23 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 29 WAV ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 30 CPLWAV ) join IDs = 2 29 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 27 ALLWAVID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 28 CPLALLWAVID ) join IDs = 2 27 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 33 ESP ) pelist = 0 0 1 ( npes = 1) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 34 CPLESP ) join IDs = 2 33 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 31 ALLESPID ) join multiple comp IDs ( npes = 1) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 32 CPLALLESPID ) join IDs = 2 31 ( npes = 80) ( nthreads = 1)
(seq_comm_printcomms) 1 0 80 1 GLOBAL:
(seq_comm_printcomms) 2 0 80 1 CPL:
(seq_comm_printcomms) 3 0 80 1 ALLATMID:
(seq_comm_printcomms) 4 0 80 1 CPLALLATMID:
(seq_comm_printcomms) 5 0 80 1 ATM:
(seq_comm_printcomms) 6 0 80 1 CPLATM:
(seq_comm_printcomms) 7 0 80 1 ALLLNDID:
(seq_comm_printcomms) 8 0 80 1 CPLALLLNDID:
(seq_comm_printcomms) 9 0 80 1 LND:
(seq_comm_printcomms) 10 0 80 1 CPLLND:
(seq_comm_printcomms) 11 0 80 1 ALLICEID:
(seq_comm_printcomms) 12 0 80 1 CPLALLICEID:
(seq_comm_printcomms) 13 0 80 1 ICE:
(seq_comm_printcomms) 14 0 80 1 CPLICE:
(seq_comm_printcomms) 15 0 80 1 ALLOCNID:
(seq_comm_printcomms) 16 0 80 1 CPLALLOCNID:
(seq_comm_printcomms) 17 0 80 1 OCN:
(seq_comm_printcomms) 18 0 80 1 CPLOCN:
(seq_comm_printcomms) 19 0 80 1 ALLROFID:
(seq_comm_printcomms) 20 0 80 1 CPLALLROFID:
(seq_comm_printcomms) 21 0 80 1 ROF:
(seq_comm_printcomms) 22 0 80 1 CPLROF:
(seq_comm_printcomms) 23 0 80 1 ALLGLCID:
(seq_comm_printcomms) 24 0 80 1 CPLALLGLCID:
(seq_comm_printcomms) 25 0 80 1 GLC:
(seq_comm_printcomms) 26 0 80 1 CPLGLC:
(seq_comm_printcomms) 27 0 80 1 ALLWAVID:
(seq_comm_printcomms) 28 0 80 1 CPLALLWAVID:
(seq_comm_printcomms) 29 0 80 1 WAV:
(seq_comm_printcomms) 30 0 80 1 CPLWAV:
(seq_comm_printcomms) 31 0 1 1 ALLESPID:
(seq_comm_printcomms) 32 0 80 1 CPLALLESPID:
(seq_comm_printcomms) 33 0 1 1 ESP:
(seq_comm_printcomms) 34 0 80 1 CPLESP:
(t_initf) Read in prof_inparm namelist from: drv_in
(t_initf) Using profile_disable= F
(t_initf) profile_timer= 4
(t_initf) profile_depth_limit= 4

Stack trace terminated abnormally.

hi Ting,
could you share how you solved this problem?
I met the same as you and didn't know what to do.

cesm2.1 submit error

Ting

Ting Lin

New Member

Ting

Ting Lin

New Member

Ting

Ting Lin

New Member

Attachments

altuntas

Alper Altuntas

Moderator

Ting

Ting Lin

New Member

Attachments

zongy17

zongy17

New Member