WRF-CTSM running got stuck at a certain time

[Xiao.zh]

Hi all, I met a problem with WRF-CTSM simulation.
I have set a simulation of 112 days. The wrf.exe was running fine until 22:56:06 of the first day. Then there was no more output and the wrf.exe was still running.
I used grep cfl rsl* to check errors and found nothing. I have tried to use small time steps and have got the same condition.
Does anyone have met similar problem or have any ideas on how to fix this?
I attached my namelist.input and files for CTSM.
Thanks for your attention.

Xiao

 

[Xiao.zh]

I tried to reduce the frequency of file output in CTSM and worked.

 

[Xiao.zh]

the simulation got stucked again while writing restarting files. There are no more message after this in rsl.out file:
writing restart file ./ctsm_lilac.clm2.r.1998-06-02-00000.nc for model date =
1998-06-02-00000

restFile_open: writing restart dataset ./ctsm_lilac.clm2.r.1998-06-02-00000.nc at nstep = 3200

htape_create : Opening netcdf rhtape ./ctsm_lilac.clm2.rh0.1998-06-02-00000.nc
htape_create : Successfully defined netcdf restart history file 1
htape_create : Opening netcdf rhtape ./ctsm_lilac.clm2.rh1.1998-06-02-00000.nc
htape_create : Successfully defined netcdf restart history file 2

 

[slevis]

The fact that the model gets stuck when you increase output frequency and/or when writing restart files suggests that you have an i/o (input/output) problem, and you should probably ask the administrators of the machine that you're running on for help.