Scheduled Downtime
On Tuesday 24 October 2023 @ 5pm MT the forums will be in read only mode in preparation for the downtime. On Wednesday 25 October 2023 @ 5am MT, this website will be down for maintenance and expected to return online later in the morning.
Normal Operations
The forums are back online with normal operations. If you notice any issues or errors related to the forums, please reach out to help@ucar.edu

CESM2.0/CAM6 crashing unexpectedly (shr_reprosum_calc error)

H

hmhorow@uw_edu

New Member
Hello,I am trying to run CESM2.0 with some modifications of my own. It has been running successfully. Recently I slightly changed the code in chemistry/aerosol/sslt_sections.F90 and chemistry/modal_aero/seasalt_model.F90 (made one parameter have 2 values depending on latitude). Now the model crashes after VOLC_RAD_GEOM3 / VOLC_SAD (see atm.log and cesm.log files attached) with a SHR_REPROSUM_CALC error. the atm.log file error starts here:  VOLC_RAD_GEOM3                  VOLC_SAD SHR_REPROSUM_CALC: Input contains  0.25600E+03 NaNs and  0.00000E+00 INFs on process       0  ERROR: shr_reprosum_calc ERROR: NaNs or INFs in inputand the cesm.log error starts here:0:calcsize j,iq,jac, lsfrm,lstoo  2  6  2  21  271:SHR_REPROSUM_CALC: Input contains  0.25600E+03 NaNs and  0.00000E+00 INFs on process       11: ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input2:SHR_REPROSUM_CALC: Input contains  0.25600E+03 NaNs and  0.00000E+00 INFs on process       22: ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input69:SHR_REPROSUM_CALC: Input contains  0.25600E+03 NaNs and  0.00000E+00 INFs on process      6969: ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input70:SHR_REPROSUM_CALC: Input contains  0.25600E+03 NaNs and  0.00000E+00 INFs on process      7070: ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input71:SHR_REPROSUM_CALC: Input contains  0.25600E+03 NaNs and  0.00000E+00 INFs on process      7171: ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input 0: ERROR: shr_reprosum_calc ERROR: NaNs or INFs in inputThis also happened yesterday and I was able to get it to run again by using a slightly different compset, but then I changed the code slightly again (made another parameter have 2 values depending on latitude) and now that compset (F2000_CAM60_CLM50%SP_CICE%PRES_DOCN%DOM_RTM_SGLC_SWAV) crashes, too. I am planning to move to CESM2.1 and use different compsets but wanted to test these very minor changes before I did that. Thank you for your help!Best,Hannah
 
I

inos@bas_ac_uk

Member
Hello Hannah,Did you ever find out what was causing this problem? I am running into the same shr_reprosum_calc error. I am running the CESM2.0.1 FXHIST compset. Three ensemble members all crash on 1957-12-22 after running successfully from 1950-01-01 onward. I made no modifications to the code. Any hints would be appreciated!Thanks,Ingrid From cesm.log file:SHR_REPROSUM_CALC: Input contains  0.10811E+06 NaNs and  0.00000E+00 INFs on process       1
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
SHR_REPROSUM_CALC: Input contains  0.10811E+06 NaNs and  0.00000E+00 INFs on process     260
SHR_REPROSUM_CALC: Input contains  0.10811E+06 NaNs and  0.00000E+00 INFs on process     259
SHR_REPROSUM_CALC: Input contains  0.10811E+06 NaNs and  0.00000E+00 INFs on process     262
SHR_REPROSUM_CALC: Input contains  0.10811E+06 NaNs and  0.00000E+00 INFs on process     263
SHR_REPROSUM_CALC: Input contains  0.10811E+06 NaNs and  0.00000E+00 INFs on process     261
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
SHR_REPROSUM_CALC: Input contains  0.10811E+06 NaNs and  0.00000E+00 INFs on process       6
SHR_REPROSUM_CALC: Input contains  0.10811E+06 NaNs and  0.00000E+00 INFs on process       2
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
SHR_REPROSUM_CALC: Input contains  0.10811E+06 NaNs and  0.00000E+00 INFs on process       4
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
SHR_REPROSUM_CALC: Input contains  0.10811E+06 NaNs and  0.00000E+00 INFs on process       3
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
SHR_REPROSUM_CALC: Input contains  0.11642E+06 NaNs and  0.00000E+00 INFs on process       5
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
SHR_REPROSUM_CALC: Input contains  0.10811E+06 NaNs and  0.00000E+00 INFs on process       7
SHR_REPROSUM_CALC: Input contains  0.10811E+06 NaNs and  0.00000E+00 INFs on process      10
SHR_REPROSUM_CALC: Input contains  0.10811E+06 NaNs and  0.00000E+00 INFs on process       8
SHR_REPROSUM_CALC: Input contains  0.10811E+06 NaNs and  0.00000E+00 INFs on process       9
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
SHR_REPROSUM_CALC: Input contains  0.11642E+06 NaNs and  0.00000E+00 INFs on process     258
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
SHR_REPROSUM_CALC: Input contains  0.10811E+06 NaNs and  0.00000E+00 INFs on process     253
SHR_REPROSUM_CALC: Input contains  0.10811E+06 NaNs and  0.00000E+00 INFs on process     256
SHR_REPROSUM_CALC: Input contains  0.10811E+06 NaNs and  0.00000E+00 INFs on process     257
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
SHR_REPROSUM_CALC: Input contains  0.10811E+06 NaNs and  0.00000E+00 INFs on process     255
SHR_REPROSUM_CALC: Input contains  0.10811E+06 NaNs and  0.00000E+00 INFs on process     254
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input
 ERROR: shr_reprosum_calc ERROR: NaNs or INFs in input

 
 
D

dsh224@cornell_edu

New Member
Hi, any updates on this by any chance? I have the same error for CESM2.1. where the model crashes in September of 1995 when running with the FHIST compset on Cheyenne.

The suggested fix for WACCM was to increase the variable "ionos_xport_nsplit" from 5 to 10. But that is not a variable in non-WACCM CESM2.1-CAM6.

If anyone can advise how to diagnose what is causing the problem and/or fixes that would be great.

Thanks, Douglas
 
Z

ZYue

ZYue
New Member
dsh224@cornell_edu said:
Hi, any updates on this by any chance? I have the same error for CESM2.1. where the model crashes in September of 1995 when running with the FHIST compset on Cheyenne.

The suggested fix for WACCM was to increase the variable "ionos_xport_nsplit" from 5 to 10. But that is not a variable in non-WACCM CESM2.1-CAM6.

If anyone can advise how to diagnose what is causing the problem and/or fixes that would be great.

Thanks, Douglas
Click to expand...
Hi Douglas, did you figure out this problem? I met the same question. Can you give me some suggestions?
Thanks, ZYue
 
You must log in or register to reply here.
Top