Hello!
I am running CESM2.2 WACCM6 using the FWSD compset with nudged wind and temperature, starting from 1989-01-01.
I turned on the COSP simulator, the namelist looks like this:
&cospsimulator_nl
cosp_active = .true.
cosp_ncolumns = 10
cosp_nradsteps = 3
cosp_lite = .true.
cosp_isccp = .true.
cosp_lradar_sim = .false.
cosp_llidar_sim = .false.
cosp_lisccp_sim = .true.
cosp_lmisr_sim = .false.
cosp_lmodis_sim = .false.
/
I would like ISCCP simulator to run, and do not care about the other satellites (can be on/off, aka cosp_lradar_sim = .false. or .true. etc.). To be honest, I do not have a specific preference on how to run or customize the COSP simulator. I was just requested to output some variables that are associated with COSP.
Then the error messages in both atm.log and cesm.log look like
cosp_simulator: ERROR: ERROR: COSP input variable: cospIN%g_vol_cloudsat contai
ns values out of range
ERROR: cospsimulator_intr_run: error return from cosp_simulator
I briefly looked into the code, any values of cospIN%g_vol_cloudsat < 0 can invoke this error. I don't know why and how this happened. But I cannot understand why this error occurred because I've turned off the CloudSat simulator. Even though the CloudSat simulator was not turned on, the error appeared to be associated with CloudSat. Perhaps some experts should inspect the code and understand why there was negative value in the variable and why this error was hit even when CloudSat simulator was not wanted.
After a couple trial and error, I found that in the cospsimulator_nl, I only set .true. to cosp_lite (see below), the model can run to 1488 time steps.
My second question is what is the appropriate combination of settings for cospsimulator_nl? Any other settings other than just cosp_lite=.true. will invoke the
cospIN%g_vol_cloudsat contains values out of range error.
&cospsimulator_nl
cosp_lite = .true.
/
The model crashed after 1488 time steps, with the error message in the cesm.log file shown below:
1: Opened file cesm220.WACCM6.nudged.1991Pinatubo_v5.cam.h0.1989-01.nc to write
1: 2
0: WARNING: Rearr optional argument is a pio2 feature, ignored in pio1
0: WARNING: Rearr optional argument is a pio2 feature, ignored in pio1
0: WARNING: Rearr optional argument is a pio2 feature, ignored in pio1
0: WARNING: Rearr optional argument is a pio2 feature, ignored in pio1
0: WARNING: Rearr optional argument is a pio2 feature, ignored in pio1
0: WARNING: Rearr optional argument is a pio2 feature, ignored in pio1
0: WARNING: Rearr optional argument is a pio2 feature, ignored in pio1
181: pionfwrite_mod::write_nfdarray_double 107 IAM: 5 start:
181: 1 1 11
181: 1 count: 288 192
181: 2 1 size : 1
181: error: -60 21225 0
181: pio_support::pio_die:: myrank= -1 : ERROR:
181: pionfwrite_mod::write_nfdarray_double: 250 :
181: NetCDF: Numeric conversion not representable
217: pionfwrite_mod::write_nfdarray_double 107 IAM: 6 start:
217: 1 1 13
217: 1 count: 288 192
217: 2 1 size : 1
217: error: -60 20711 0
217: pio_support::pio_die:: myrank= -1 : ERROR:
217: pionfwrite_mod::write_nfdarray_double: 250 :
217: NetCDF: Numeric conversion not representable
217:Image PC Routine Line Source
217:cesm.exe 0000000003235A8A Unknown Unknown Unknown
217:cesm.exe 0000000002AD9C21 pio_support_mp_pi 118 pio_support.F90
217:cesm.exe 0000000002AD7B91 pio_utils_mp_chec 59 pio_utils.F90
217:cesm.exe 0000000002BE5228 pionfwrite_mod_mp 250 pionfwrite_mod.F90.in
217:cesm.exe 0000000002BAD7E2 piodarray_mp_writ 650 piodarray.F90.in
217:cesm.exe 0000000002BAB13C piodarray_mp_writ 223 piodarray.F90.in
217:cesm.exe 0000000002BB0934 piodarray_mp_writ 293 piodarray.F90.in
217:cesm.exe 00000000011158DF cam_grid_support_ 3311 cam_grid_support.F90
217:cesm.exe 000000000052A039 cam_history_mp_du 4766 cam_history.F90
217:cesm.exe 000000000050A29E cam_history_mp_ws 5090 cam_history.F90
217:cesm.exe 00000000004F6C05 cam_comp_mp_cam_r 389 cam_comp.F90
217:cesm.exe 00000000004E610B atm_comp_mct_mp_a 508 atm_comp_mct.F90
217:cesm.exe 0000000000428C54 component_mod_mp_ 737 component_mod.F90
217:cesm.exe 000000000040AAE4 cime_comp_mod_mp_ 2823 cime_comp_mod.F90
217:cesm.exe 000000000042888C MAIN__ 133 cime_driver.F90
217:cesm.exe 00000000004084E2 Unknown Unknown Unknown
217:libc-2.22.so 00002B7A9A4ACA35 __libc_start_main Unknown Unknown
217:cesm.exe 00000000004083E9 Unknown Unknown Unknown
217:MPT ERROR: Rank 217(g:217) is aborting with error code 1.
I did find something similar in the past posts, but no solid explanation on why we have this kind of error.
I further turned on the debug mode by setting ./xmlchange DEBUG=TRUE.
The model crashed at 5 time step with error message in the cesm.log like this:
104:forrtl: severe (408): fort: (8): Attempt to fetch from allocatable variable SD_CS when it is not allocated
104:
104:Image PC Routine Line Source
104:cesm.exe 000000000AF09886 Unknown Unknown Unknown
104:cesm.exe 0000000002BB1E58 cospsimulator_int 2099 cospsimulator_intr.F90
104:cesm.exe 00000000012DCBB8 radiation_mp_radi 1315 radiation.F90
104:cesm.exe 00000000011D27A2 physpkg_mp_tphysb 2614 physpkg.F90
104:cesm.exe 00000000011A275B physpkg_mp_phys_r 1078 physpkg.F90
104:cesm.exe 0000000000867D3C cam_comp_mp_cam_r 259 cam_comp.F90
104:cesm.exe 000000000082AD76 atm_comp_mct_mp_a 521 atm_comp_mct.F90
104:cesm.exe 0000000000468615 component_mod_mp_ 737 component_mod.F90
104:cesm.exe 0000000000431570 cime_comp_mod_mp_ 2823 cime_comp_mod.F90
104:cesm.exe 000000000045015C MAIN__ 133 cime_driver.F90
104:cesm.exe 00000000004085A2 Unknown Unknown Unknown
104:libc-2.22.so 00002AFBB3B7AA35 __libc_start_main Unknown Unknown
104:cesm.exe 00000000004084A9 Unknown Unknown Unknown
107:forrtl: severe (408): fort: (8): Attempt to fetch from allocatable variable SD_CS when it is not allocated
107:
107:Image PC Routine Line Source
107:cesm.exe 000000000AF09886 Unknown Unknown Unknown
107:cesm.exe 0000000002BB1E58 cospsimulator_int 2099 cospsimulator_intr.F90
107:cesm.exe 00000000012DCBB8 radiation_mp_radi 1315 radiation.F90
107:cesm.exe 00000000011D27A2 physpkg_mp_tphysb 2614 physpkg.F90
107:cesm.exe 00000000011A275B physpkg_mp_phys_r 1078 physpkg.F90
107:cesm.exe 0000000000867D3C cam_comp_mp_cam_r 259 cam_comp.F90
107:cesm.exe 000000000082AD76 atm_comp_mct_mp_a 521 atm_comp_mct.F90
107:cesm.exe 0000000000468615 component_mod_mp_ 737 component_mod.F90
107:cesm.exe 0000000000431570 cime_comp_mod_mp_ 2823 cime_comp_mod.F90
107:cesm.exe 000000000045015C MAIN__ 133 cime_driver.F90
107:cesm.exe 00000000004085A2 Unknown Unknown Unknown
107:libc-2.22.so 00002AFBB3B7AA35 __libc_start_main Unknown Unknown
107:cesm.exe 00000000004084A9 Unknown Unknown Unknown
-1:MPT ERROR: MPI_COMM_WORLD rank 184 has terminated without calling MPI_Finalize()
-1: aborting job
Can some experts look into Line 2099 in cospsimulator_intro.F90?
One more note. If I only set ./xmlchange --id CAM_CONFIG_OPTS --append --val='-cosp' and didn't set anything in the cospsimulator_nl, I still get the cospIN%g_vol_cloudsat contains values out of range error.
Just post my trial and error today and share with someone who might be interested in this or might encounter this kind of error in the future.
Thanks,
Lin
I am running CESM2.2 WACCM6 using the FWSD compset with nudged wind and temperature, starting from 1989-01-01.
I turned on the COSP simulator, the namelist looks like this:
&cospsimulator_nl
cosp_active = .true.
cosp_ncolumns = 10
cosp_nradsteps = 3
cosp_lite = .true.
cosp_isccp = .true.
cosp_lradar_sim = .false.
cosp_llidar_sim = .false.
cosp_lisccp_sim = .true.
cosp_lmisr_sim = .false.
cosp_lmodis_sim = .false.
/
I would like ISCCP simulator to run, and do not care about the other satellites (can be on/off, aka cosp_lradar_sim = .false. or .true. etc.). To be honest, I do not have a specific preference on how to run or customize the COSP simulator. I was just requested to output some variables that are associated with COSP.
Then the error messages in both atm.log and cesm.log look like
cosp_simulator: ERROR: ERROR: COSP input variable: cospIN%g_vol_cloudsat contai
ns values out of range
ERROR: cospsimulator_intr_run: error return from cosp_simulator
I briefly looked into the code, any values of cospIN%g_vol_cloudsat < 0 can invoke this error. I don't know why and how this happened. But I cannot understand why this error occurred because I've turned off the CloudSat simulator. Even though the CloudSat simulator was not turned on, the error appeared to be associated with CloudSat. Perhaps some experts should inspect the code and understand why there was negative value in the variable and why this error was hit even when CloudSat simulator was not wanted.
After a couple trial and error, I found that in the cospsimulator_nl, I only set .true. to cosp_lite (see below), the model can run to 1488 time steps.
My second question is what is the appropriate combination of settings for cospsimulator_nl? Any other settings other than just cosp_lite=.true. will invoke the
cospIN%g_vol_cloudsat contains values out of range error.
&cospsimulator_nl
cosp_lite = .true.
/
The model crashed after 1488 time steps, with the error message in the cesm.log file shown below:
1: Opened file cesm220.WACCM6.nudged.1991Pinatubo_v5.cam.h0.1989-01.nc to write
1: 2
0: WARNING: Rearr optional argument is a pio2 feature, ignored in pio1
0: WARNING: Rearr optional argument is a pio2 feature, ignored in pio1
0: WARNING: Rearr optional argument is a pio2 feature, ignored in pio1
0: WARNING: Rearr optional argument is a pio2 feature, ignored in pio1
0: WARNING: Rearr optional argument is a pio2 feature, ignored in pio1
0: WARNING: Rearr optional argument is a pio2 feature, ignored in pio1
0: WARNING: Rearr optional argument is a pio2 feature, ignored in pio1
181: pionfwrite_mod::write_nfdarray_double 107 IAM: 5 start:
181: 1 1 11
181: 1 count: 288 192
181: 2 1 size : 1
181: error: -60 21225 0
181: pio_support::pio_die:: myrank= -1 : ERROR:
181: pionfwrite_mod::write_nfdarray_double: 250 :
181: NetCDF: Numeric conversion not representable
217: pionfwrite_mod::write_nfdarray_double 107 IAM: 6 start:
217: 1 1 13
217: 1 count: 288 192
217: 2 1 size : 1
217: error: -60 20711 0
217: pio_support::pio_die:: myrank= -1 : ERROR:
217: pionfwrite_mod::write_nfdarray_double: 250 :
217: NetCDF: Numeric conversion not representable
217:Image PC Routine Line Source
217:cesm.exe 0000000003235A8A Unknown Unknown Unknown
217:cesm.exe 0000000002AD9C21 pio_support_mp_pi 118 pio_support.F90
217:cesm.exe 0000000002AD7B91 pio_utils_mp_chec 59 pio_utils.F90
217:cesm.exe 0000000002BE5228 pionfwrite_mod_mp 250 pionfwrite_mod.F90.in
217:cesm.exe 0000000002BAD7E2 piodarray_mp_writ 650 piodarray.F90.in
217:cesm.exe 0000000002BAB13C piodarray_mp_writ 223 piodarray.F90.in
217:cesm.exe 0000000002BB0934 piodarray_mp_writ 293 piodarray.F90.in
217:cesm.exe 00000000011158DF cam_grid_support_ 3311 cam_grid_support.F90
217:cesm.exe 000000000052A039 cam_history_mp_du 4766 cam_history.F90
217:cesm.exe 000000000050A29E cam_history_mp_ws 5090 cam_history.F90
217:cesm.exe 00000000004F6C05 cam_comp_mp_cam_r 389 cam_comp.F90
217:cesm.exe 00000000004E610B atm_comp_mct_mp_a 508 atm_comp_mct.F90
217:cesm.exe 0000000000428C54 component_mod_mp_ 737 component_mod.F90
217:cesm.exe 000000000040AAE4 cime_comp_mod_mp_ 2823 cime_comp_mod.F90
217:cesm.exe 000000000042888C MAIN__ 133 cime_driver.F90
217:cesm.exe 00000000004084E2 Unknown Unknown Unknown
217:libc-2.22.so 00002B7A9A4ACA35 __libc_start_main Unknown Unknown
217:cesm.exe 00000000004083E9 Unknown Unknown Unknown
217:MPT ERROR: Rank 217(g:217) is aborting with error code 1.
I did find something similar in the past posts, but no solid explanation on why we have this kind of error.
I further turned on the debug mode by setting ./xmlchange DEBUG=TRUE.
The model crashed at 5 time step with error message in the cesm.log like this:
104:forrtl: severe (408): fort: (8): Attempt to fetch from allocatable variable SD_CS when it is not allocated
104:
104:Image PC Routine Line Source
104:cesm.exe 000000000AF09886 Unknown Unknown Unknown
104:cesm.exe 0000000002BB1E58 cospsimulator_int 2099 cospsimulator_intr.F90
104:cesm.exe 00000000012DCBB8 radiation_mp_radi 1315 radiation.F90
104:cesm.exe 00000000011D27A2 physpkg_mp_tphysb 2614 physpkg.F90
104:cesm.exe 00000000011A275B physpkg_mp_phys_r 1078 physpkg.F90
104:cesm.exe 0000000000867D3C cam_comp_mp_cam_r 259 cam_comp.F90
104:cesm.exe 000000000082AD76 atm_comp_mct_mp_a 521 atm_comp_mct.F90
104:cesm.exe 0000000000468615 component_mod_mp_ 737 component_mod.F90
104:cesm.exe 0000000000431570 cime_comp_mod_mp_ 2823 cime_comp_mod.F90
104:cesm.exe 000000000045015C MAIN__ 133 cime_driver.F90
104:cesm.exe 00000000004085A2 Unknown Unknown Unknown
104:libc-2.22.so 00002AFBB3B7AA35 __libc_start_main Unknown Unknown
104:cesm.exe 00000000004084A9 Unknown Unknown Unknown
107:forrtl: severe (408): fort: (8): Attempt to fetch from allocatable variable SD_CS when it is not allocated
107:
107:Image PC Routine Line Source
107:cesm.exe 000000000AF09886 Unknown Unknown Unknown
107:cesm.exe 0000000002BB1E58 cospsimulator_int 2099 cospsimulator_intr.F90
107:cesm.exe 00000000012DCBB8 radiation_mp_radi 1315 radiation.F90
107:cesm.exe 00000000011D27A2 physpkg_mp_tphysb 2614 physpkg.F90
107:cesm.exe 00000000011A275B physpkg_mp_phys_r 1078 physpkg.F90
107:cesm.exe 0000000000867D3C cam_comp_mp_cam_r 259 cam_comp.F90
107:cesm.exe 000000000082AD76 atm_comp_mct_mp_a 521 atm_comp_mct.F90
107:cesm.exe 0000000000468615 component_mod_mp_ 737 component_mod.F90
107:cesm.exe 0000000000431570 cime_comp_mod_mp_ 2823 cime_comp_mod.F90
107:cesm.exe 000000000045015C MAIN__ 133 cime_driver.F90
107:cesm.exe 00000000004085A2 Unknown Unknown Unknown
107:libc-2.22.so 00002AFBB3B7AA35 __libc_start_main Unknown Unknown
107:cesm.exe 00000000004084A9 Unknown Unknown Unknown
-1:MPT ERROR: MPI_COMM_WORLD rank 184 has terminated without calling MPI_Finalize()
-1: aborting job
Can some experts look into Line 2099 in cospsimulator_intro.F90?
One more note. If I only set ./xmlchange --id CAM_CONFIG_OPTS --append --val='-cosp' and didn't set anything in the cospsimulator_nl, I still get the cospIN%g_vol_cloudsat contains values out of range error.
Just post my trial and error today and share with someone who might be interested in this or might encounter this kind of error in the future.
Thanks,
Lin