Problem running CESM: segmentation fault

[sakata.y]

Hi everyone,

I was trying to run a PETM simulation using the dt2.0_cesm1_2_2_1 following the paleoToolkit documentation. I have completed steps 1 to 31 outlined in the Setup Recipe. However, when I attempt to run a fully coupled simulation with compset BPETMC5CN and resolution f19_g16, I encounter a segmentation fault. The error appears to be related to the CAM component.

Here’s the relevant part of the atm.log file：
FV subcycling - nv, n2, nsplit, dt = 3 2 2 50.0000000000000
Divergence damping: use 4th order damping.

The cesm.log file says:
CalcWorkPerBlock: Total blocks: 1536 Ice blocks: 468 IceFree blocks: 743 Land blocks: 325
MCT::m_Router::initp_: GSMap indices not increasing...Will correct
MCT::m_Router::initp_: RGSMap indices not increasing...Will correct
MCT::m_Router::initp_: RGSMap indices not increasing...Will correct
MCT::m_Router::initp_: GSMap indices not increasing...Will correct
MCT::m_Router::initp_: GSMap indices not increasing...Will correct
MCT::m_Router::initp_: RGSMap indices not increasing...Will correct
MCT::m_Router::initp_: RGSMap indices not increasing...Will correct
MCT::m_Router::initp_: GSMap indices not increasing...Will correct
forrtl: severe (174): SIGSEGV, segmentation fault occurred
Image PC Routine Line Source
cesm.exe 0000000002190A04 Unknown Unknown Unknown
libpthread-2.17.s 00002B9408E50630 Unknown Unknown Unknown
cesm.exe 00000000013AE381 tp_core_mp_tp2c_ 119 tp_core.F90
cesm.exe 000000000139D271 sw_core_mp_d_sw_ 893 sw_core.F90
cesm.exe 00000000012E26B7 cd_core_ 1110 cd_core.F90
cesm.exe 00000000010E21C7 dyn_comp_mp_dyn_r 1822 dyn_comp.F90
cesm.exe 0000000000F081C8 stepon_mp_stepon_ 422 stepon.F90
cesm.exe 00000000004A4704 cam_comp_mp_cam_r 250 cam_comp.F90
cesm.exe 000000000049F6D4 atm_comp_mct_mp_a 364 atm_comp_mct.F90
cesm.exe 0000000000430607 ccsm_comp_mod_mp_ 2525 ccsm_comp_mod.F90
cesm.exe 0000000000437075 MAIN__ 90 ccsm_driver.F90
cesm.exe 000000000041491E Unknown Unknown Unknown
libc-2.17.so 00002B9409381555 __libc_start_main Unknown Unknown
cesm.exe 0000000000414829 Unknown Unknown Unknown

I have reviewed several threads related to this issue and made the following changes based on suggestions:

1. Added ulimit -s unlimited in my script.
2. Modified the user_nl_cam file by setting the following parameters:
   
   • nsplit = 12
   • nspltrac = 6
   • nspltvrm = 3
3. Tried changing ATM_NCPL = 72 and 144.

Unfortunately, none of these changes resolved the issue. I have attached the relevant namelist files and log files below for reference.
Additionally, does anyone have information on the positions of the North and South poles defined in the gx1PETM grid? The grid files can be found at the following link: - Revision 69156: /trunk/inputdata/ocn/pop/gx1PETM/grid

Please let me know what changes are required.
Any suggestions or advice would be greatly appreciated!

Best,
yang

 

[sakata.y]

Sorry, these are the correct log files