wrf ctsm: bottom layer-specific humidity

[dquaker]

I was able to run wrf-ctsm for 1 day successfully, but on the second day of my chosen date, I had this error and the model stopped.
(cpl:utils:check_for_errors) ERROR: Bottom layer specific humidity sent from the atmosphere model is less than zero.

In the past, I did encounter this error when running ctsm using wrf outputs and overcame the error by following the advice on this thread "Bottom layer specific humidty sent from the atmosphere model is less than zero"

However, since this is wrf coupling with ctsm in lilac, what would be the best way to overcome this error?
@slevis, I was thinking if turning off the bottom layer-specific humidity sent from the atmosphere model is a possibility to consider, but I do not know how to implement the idea

Excerpt from rsl.out.0000 as I cannot upload due to file size of 9mb

taskid: 0 hostname: i23r01c01s12.cos.lrz.de
Quilting with 1 groups of 0 I/O tasks.
Ntasks in X 1 , ntasks in Y 1
*************************************
Configuring physics suite 'tropical'

mp_physics: 6*
cu_physics: 0*
ra_lw_physics: 1*
ra_sw_physics: 1*
bl_pbl_physics: 7*
sf_sfclay_physics: 1*
sf_surface_physics: 6*

(* = option overrides suite setting)
*************************************
Domain # 1: dx = 3000.000 m
WRF V4.4.1 MODEL
git commit 087df5e81a46138d6bb1ad0337363f2ce582fd43
*************************************
Parent domain
ids,ide,jds,jde 1 305 1 550
ims,ime,jms,jme -4 310 -4 555
ips,ipe,jps,jpe 1 305 1 550
*************************************
DYNAMICS OPTION: Eulerian Mass Coordinate
alloc_space_field: domain 1 , 3451110536 bytes allocated
RESTART run: opening wrfrst_d01_2016-01-02_00:00:00 for reading
Input data is acceptable to use: wrfrst_d01_2016-01-02_00:00:00
Timing for processing restart file for domain 1: 3.71103 elapsed seconds
Max map factor in domain 1 = 1.04. Scale the dt in the model accordingly.
Max map factor in domain 1 = 1.04. Scale the dt in the model accordingly.
D01: Time step = 18.00000 (s)
D01: Grid Distance = 3.000000 (km)
D01: Grid Distance Ratio dt/dx = 6.000000 (s/km)
D01: Ratio Including Maximum Map Factor = 6.214227 (s/km)
D01: NML defined reasonable_time_step_ratio = 6.000000
Climate GHG input from file from year 1765 to 2499
CO2 range = 277.913000000000 579.264000000000 ppm
N2O range = 274.372000000000 359.798000000000 ppb
CH4 range = 738.986000000000 997.311000000000 ppb
CFC11 range = 0.000000000000000E+000 1.400000000000000E-002 ppt
CFC12 range = 0.000000000000000E+000 2.88100000000000 ppt
Normal ending of CAMtr_volume_mixing_ratio file
GHG annual values from CAM trace gas file
Year = 2016 , Julian day = 1
CO2 = 4.016888022676173E-004 volume mixing ratio
N2O = 3.286720562791652E-007 volume mixing ratio
CH4 = 1.847243087110089E-006 volume mixing ratio
CFC11 = 2.304310728479182E-010 volume mixing ratio
CFC12 = 5.161331126883768E-010 volume mixing ratio
CTSM start time: 2016 1 2 0
User-specified PIO rearranger comm max pend req (comp2io), 0
(value will be reset as requested)
Resetting PIO rearranger comm max pend req (comp2io) to 64
User-specified PIO rearranger comm max pend req (io2comp), 0
(value will be reset as requested)
Resetting PIO rearranger comm max pend req (io2comp) to 64
PIO rearranger options:
....................................


stop alarm is F
lilac ymd= 20160102 lilac tod= 84258
Running coupler component..... cpl_lnd2atm_comp , rc = 0
Running cpl_lnd2atm_run
time is icremented now... (ClockAdvance) , rc = 0
Timing for main: time 2016-01-02_23:24:36 on domain 1: 17.94787 elapsed seconds
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Lilac Run
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Running atmos_cap gridded component , rc = 0
DEBUG: stream_varname = Faxa_bcphiwet
DEBUG: stream_varname = Faxa_bcphodry
DEBUG: stream_varname = Faxa_bcphidry
DEBUG: stream_varname = Faxa_ocphiwet
DEBUG: stream_varname = Faxa_ocphidry
DEBUG: stream_varname = Faxa_ocphodry
DEBUG: stream_varname = Faxa_dstwet1
DEBUG: stream_varname = Faxa_dstdry1
DEBUG: stream_varname = Faxa_dstwet2
DEBUG: stream_varname = Faxa_dstdry2
DEBUG: stream_varname = Faxa_dstwet3
DEBUG: stream_varname = Faxa_dstdry3
DEBUG: stream_varname = Faxa_dstwet4
DEBUG: stream_varname = Faxa_dstdry4
Running coupler component..... cpl_atm2lnd_comp
Running cpl_atm2lnd_run
Running ctsm
ERROR:
(cpl:utils:check_for_errors) ERROR: Bottom layer specific humidty sent from the
atmosphere model is less than zero

 

[slevis]

@dquaker it has been several years since I helped Negin Sobhani and @sacks get wrf-clm simulations to work in the lilac context, so...
1) I do not have much insight about this to offer a good suggestion without spending much time on it, and
2) We do not consider wrf-clm a supported model configuration to justify spending such time.

I pinged @sacks to this post and you may email Negin (negins@ucar.edu) in case one of them has insight into this issue beyond what you found in the post that you shared.

 

[slevis]

When you do resolve the error, it will be great for the community if you post about it in this thread. Thank you in advance!

 

[sacks]

I don't have many more thoughts on this except to say that another user ran into this in the past: see WRF-CTSM: Bottom layer specific humidty sent from the atmosphere model is less than zero · Issue #1725 · ESCOMP/CTSM. There are some suggestions in that issue that you could try (making sure you are using certain compatible options): it sounds like they didn't explain the issue for the other user, but it's possible that they would help you.

 

[sacks]

Iris posted to the above issue; I'll repost here: "The solution we applied is available under Bottom layer specific humidty sent from the atmosphere model is less than zero."