Scheduled Downtime
On Tuesday 24 October 2023 @ 5pm MT the forums will be in read only mode in preparation for the downtime. On Wednesday 25 October 2023 @ 5am MT, this website will be down for maintenance and expected to return online later in the morning.
Normal Operations
The forums are back online with normal operations. If you notice any issues or errors related to the forums, please reach out to help@ucar.edu

cesm2.1 submit error

Ting

Ting Lin
New Member
I have successfully built CESM 2.1 on my university's HPC, but when I submit sample case of guide book, I met an error. This error is shown in $RUNROOT (cesm.log.210106-123255).

Can anyone help me figure out this problem?
 

Ting

Ting Lin
New Member
Invalid PIO rearranger comm max pend req (comp2io), 0
Resetting PIO rearranger comm max pend req (comp2io) to 64
PIO rearranger options:
comm type =
p2p

comm fcd =
2denable

max pend req (comp2io) = 0
enable_hs (comp2io) = T
enable_isend (comp2io) = F
max pend req (io2comp) = 64
enable_hs (io2comp) = F
enable_isend (io2comp) = T
(seq_comm_setcomm) init ID ( 1 GLOBAL ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_setcomm) init ID ( 2 CPL ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_setcomm) init ID ( 5 ATM ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 6 CPLATM ) join IDs = 2 5 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 3 ALLATMID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 4 CPLALLATMID ) join IDs = 2 3 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 9 LND ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 10 CPLLND ) join IDs = 2 9 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 7 ALLLNDID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 8 CPLALLLNDID ) join IDs = 2 7 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 13 ICE ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 14 CPLICE ) join IDs = 2 13 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 11 ALLICEID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 12 CPLALLICEID ) join IDs = 2 11 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 17 OCN ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 18 CPLOCN ) join IDs = 2 17 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 15 ALLOCNID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 16 CPLALLOCNID ) join IDs = 2 15 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 21 ROF ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 22 CPLROF ) join IDs = 2 21 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 19 ALLROFID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 20 CPLALLROFID ) join IDs = 2 19 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 25 GLC ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 26 CPLGLC ) join IDs = 2 25 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 23 ALLGLCID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 24 CPLALLGLCID ) join IDs = 2 23 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 29 WAV ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 30 CPLWAV ) join IDs = 2 29 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 27 ALLWAVID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 28 CPLALLWAVID ) join IDs = 2 27 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 33 ESP ) pelist = 0 0 1 ( npes = 1) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 34 CPLESP ) join IDs = 2 33 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 31 ALLESPID ) join multiple comp IDs ( npes = 1) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 32 CPLALLESPID ) join IDs = 2 31 ( npes = 80) ( nthreads = 1)
(seq_comm_printcomms) 1 0 80 1 GLOBAL:
(seq_comm_printcomms) 2 0 80 1 CPL:
(seq_comm_printcomms) 3 0 80 1 ALLATMID:
(seq_comm_printcomms) 4 0 80 1 CPLALLATMID:
(seq_comm_printcomms) 5 0 80 1 ATM:
(seq_comm_printcomms) 6 0 80 1 CPLATM:
(seq_comm_printcomms) 7 0 80 1 ALLLNDID:
(seq_comm_printcomms) 8 0 80 1 CPLALLLNDID:
(seq_comm_printcomms) 9 0 80 1 LND:
(seq_comm_printcomms) 10 0 80 1 CPLLND:
(seq_comm_printcomms) 11 0 80 1 ALLICEID:
(seq_comm_printcomms) 12 0 80 1 CPLALLICEID:
(seq_comm_printcomms) 13 0 80 1 ICE:
(seq_comm_printcomms) 14 0 80 1 CPLICE:
(seq_comm_printcomms) 15 0 80 1 ALLOCNID:
(seq_comm_printcomms) 16 0 80 1 CPLALLOCNID:
(seq_comm_printcomms) 17 0 80 1 OCN:
(seq_comm_printcomms) 18 0 80 1 CPLOCN:
(seq_comm_printcomms) 19 0 80 1 ALLROFID:
(seq_comm_printcomms) 20 0 80 1 CPLALLROFID:
(seq_comm_printcomms) 21 0 80 1 ROF:
(seq_comm_printcomms) 22 0 80 1 CPLROF:
(seq_comm_printcomms) 23 0 80 1 ALLGLCID:
(seq_comm_printcomms) 24 0 80 1 CPLALLGLCID:
(seq_comm_printcomms) 25 0 80 1 GLC:
(seq_comm_printcomms) 26 0 80 1 CPLGLC:
(seq_comm_printcomms) 27 0 80 1 ALLWAVID:
(seq_comm_printcomms) 28 0 80 1 CPLALLWAVID:
(seq_comm_printcomms) 29 0 80 1 WAV:
(seq_comm_printcomms) 30 0 80 1 CPLWAV:
(seq_comm_printcomms) 31 0 1 1 ALLESPID:
(seq_comm_printcomms) 32 0 80 1 CPLALLESPID:
(seq_comm_printcomms) 33 0 1 1 ESP:
(seq_comm_printcomms) 34 0 80 1 CPLESP:
(t_initf) Read in prof_inparm namelist from: drv_in
(t_initf) Using profile_disable= F
(t_initf) profile_timer= 4
(t_initf) profile_depth_limit= 4


Stack trace terminated abnormally.
 

Ting

Ting Lin
New Member
These are detailed error and my configuration.
 

Attachments

  • cesm.log.210106-123255.txt
    26.7 KB · Views: 4
  • config_compilers.txt
    3 KB · Views: 3
  • config_machines.txt
    2.1 KB · Views: 4

Ting

Ting Lin
New Member
Hi Ting,

Which guide are you following? Can you give more information on the case and the compset you are trying to run. See: Information to include in help requests
Thanks for your reply! I have solved the previous question that I posted on the another poster. Now, I am testing atmosphere component (CAM) of CESM 2.1.3. I have successfully build the example case (./create_newcase --case aqua_case --compset QSC6 --res f09_f09_mg17) in my machine, but when I try to submit this case, I met this problem. The guide book I followed is CAM 6.3 User's Guide.
I am using a new machine and I am a new modeler as well, so I am not sure which step is wrong when I port CESM. Thus I posted all my files below. Thanks!!!
 

Attachments

  • atm.log.210106-123255.txt
    74.7 KB · Views: 1
  • cesm.log.210106-123255.txt
    26.7 KB · Views: 3
  • cpl.log.210106-123255.txt
    42.1 KB · Views: 1
  • config_compilers.txt
    3 KB · Views: 3
  • config_machines.txt
    2.1 KB · Views: 4
  • version_info.txt
    5.3 KB · Views: 1

zongy17

zongy17
New Member
Invalid PIO rearranger comm max pend req (comp2io), 0
Resetting PIO rearranger comm max pend req (comp2io) to 64
PIO rearranger options:
comm type =
p2p

comm fcd =
2denable

max pend req (comp2io) = 0
enable_hs (comp2io) = T
enable_isend (comp2io) = F
max pend req (io2comp) = 64
enable_hs (io2comp) = F
enable_isend (io2comp) = T
(seq_comm_setcomm) init ID ( 1 GLOBAL ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_setcomm) init ID ( 2 CPL ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_setcomm) init ID ( 5 ATM ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 6 CPLATM ) join IDs = 2 5 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 3 ALLATMID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 4 CPLALLATMID ) join IDs = 2 3 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 9 LND ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 10 CPLLND ) join IDs = 2 9 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 7 ALLLNDID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 8 CPLALLLNDID ) join IDs = 2 7 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 13 ICE ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 14 CPLICE ) join IDs = 2 13 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 11 ALLICEID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 12 CPLALLICEID ) join IDs = 2 11 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 17 OCN ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 18 CPLOCN ) join IDs = 2 17 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 15 ALLOCNID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 16 CPLALLOCNID ) join IDs = 2 15 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 21 ROF ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 22 CPLROF ) join IDs = 2 21 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 19 ALLROFID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 20 CPLALLROFID ) join IDs = 2 19 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 25 GLC ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 26 CPLGLC ) join IDs = 2 25 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 23 ALLGLCID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 24 CPLALLGLCID ) join IDs = 2 23 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 29 WAV ) pelist = 0 79 1 ( npes = 80) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 30 CPLWAV ) join IDs = 2 29 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 27 ALLWAVID ) join multiple comp IDs ( npes = 80) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 28 CPLALLWAVID ) join IDs = 2 27 ( npes = 80) ( nthreads = 1)
(seq_comm_setcomm) init ID ( 33 ESP ) pelist = 0 0 1 ( npes = 1) ( nthreads = 1)( suffix =)
(seq_comm_joincomm) init ID ( 34 CPLESP ) join IDs = 2 33 ( npes = 80) ( nthreads = 1)
(seq_comm_jcommarr) init ID ( 31 ALLESPID ) join multiple comp IDs ( npes = 1) ( nthreads = 1)
(seq_comm_joincomm) init ID ( 32 CPLALLESPID ) join IDs = 2 31 ( npes = 80) ( nthreads = 1)
(seq_comm_printcomms) 1 0 80 1 GLOBAL:
(seq_comm_printcomms) 2 0 80 1 CPL:
(seq_comm_printcomms) 3 0 80 1 ALLATMID:
(seq_comm_printcomms) 4 0 80 1 CPLALLATMID:
(seq_comm_printcomms) 5 0 80 1 ATM:
(seq_comm_printcomms) 6 0 80 1 CPLATM:
(seq_comm_printcomms) 7 0 80 1 ALLLNDID:
(seq_comm_printcomms) 8 0 80 1 CPLALLLNDID:
(seq_comm_printcomms) 9 0 80 1 LND:
(seq_comm_printcomms) 10 0 80 1 CPLLND:
(seq_comm_printcomms) 11 0 80 1 ALLICEID:
(seq_comm_printcomms) 12 0 80 1 CPLALLICEID:
(seq_comm_printcomms) 13 0 80 1 ICE:
(seq_comm_printcomms) 14 0 80 1 CPLICE:
(seq_comm_printcomms) 15 0 80 1 ALLOCNID:
(seq_comm_printcomms) 16 0 80 1 CPLALLOCNID:
(seq_comm_printcomms) 17 0 80 1 OCN:
(seq_comm_printcomms) 18 0 80 1 CPLOCN:
(seq_comm_printcomms) 19 0 80 1 ALLROFID:
(seq_comm_printcomms) 20 0 80 1 CPLALLROFID:
(seq_comm_printcomms) 21 0 80 1 ROF:
(seq_comm_printcomms) 22 0 80 1 CPLROF:
(seq_comm_printcomms) 23 0 80 1 ALLGLCID:
(seq_comm_printcomms) 24 0 80 1 CPLALLGLCID:
(seq_comm_printcomms) 25 0 80 1 GLC:
(seq_comm_printcomms) 26 0 80 1 CPLGLC:
(seq_comm_printcomms) 27 0 80 1 ALLWAVID:
(seq_comm_printcomms) 28 0 80 1 CPLALLWAVID:
(seq_comm_printcomms) 29 0 80 1 WAV:
(seq_comm_printcomms) 30 0 80 1 CPLWAV:
(seq_comm_printcomms) 31 0 1 1 ALLESPID:
(seq_comm_printcomms) 32 0 80 1 CPLALLESPID:
(seq_comm_printcomms) 33 0 1 1 ESP:
(seq_comm_printcomms) 34 0 80 1 CPLESP:
(t_initf) Read in prof_inparm namelist from: drv_in
(t_initf) Using profile_disable= F
(t_initf) profile_timer= 4
(t_initf) profile_depth_limit= 4


Stack trace terminated abnormally.
hi Ting,
could you share how you solved this problem?
I met the same as you and didn't know what to do.
 
Top