Hi @slevis and @oleson,
According to the guidebook (Setting up (high-res sparse) regional-grid CTSM simulations · ESCOMP/CTSM · Discussion #1919), I am able to run the CLM5-BGC-crop at regular 1-degree resolution in the mid-west US. However, I want to run a high-resolution (0.125 degree) case in the mid-west US. I got stuck here for several days. Could you please give me some input here? Thanks!
I used the following command:
1. Subset the surface data
~/CTSM/tools/site_and_regional> qcmd -- ./subset_data region --lat1 37.00 --lat2 49.00 --lon1 -105.00 --lon2 -80.00 --reg CO_region --create-surface --create-user-mods --datm-syr 2000 --datm-eyr 2005 --crop --outdir /glade/scratch/mengqij/my_subset_data_Bo1_region_1
Note: This is surface datafor mid-west US.
2. Create a new case
./create_newcase --case ~/A_corn_simulation_region/I2000_CTSM_singlept_region_test_a --res ne240_ne240_mg17 --compset I2000Clm51BgcCrop --project UIUC0025 --run-unsupported
Note: I changed the --res from "CLM_USRDAT" to "ne240_ne240_mg17". ne240_ne240_mg17 is one of the supported resolutions.
3. Generate mesh files (note the Scrip2Unstruct command has been updated in Discussion 1919)
In ctsm/tools/site_and_regional/
module load nco
ncks --rgr infer --rgr scrip=scrip.nc ~/surface_dataset_corn/surfdata_CO_region_hist_78pfts_CMIP6_simyr2000_c230828.nc foo.nc
/glade/u/apps/ch/opt/esmf-netcdf/8.0.0/intel/19.0.5/bin/bing/Linux.intel.64.mpiuni.default/ESMF_Scrip2Unstruct scrip.nc lnd_mesh.nc 0
ncap2 -s 'elementMask(:)=0' lnd_mesh.nc mask_mesh.nc
Note: I did not change these commands. Right?
4. Set up a case and build the executable
./case.setup
qcmd -- ./case.build
5. Submit the run
./xmlchange STOP_OPTION=nyears.
./xmlchange STOP_N=1
./xmlchange DATM_YR_ALIGN=2000./xmlchange DATM_YR_START=2000
./xmlchange DATM_YR_END=2001
./xmlchange LND_DOMAIN_MESH= "$DIN_LOC_ROOT/share/meshes/ne240np4_ESMFmesh_cdf5_c20211018.nc"
./xmlchange ATM_DOMAIN_MESH= "$DIN_LOC_ROOT/share/meshes/ne240np4_ESMFmesh_cdf5_c20211018.nc"
./xmlchange MASK_MESH= "$DIN_LOC_ROOT/share/meshes/gx1v7_151008_ESMFmesh.nc"
Note: For LND_DOMAIN_MESH, ATM_DOMAIN_MESH, and MASK_MESH, I noticed that these variables were automatically set.
However, in the guidebook, they seem to be:
./xmlchange LND_DOMAIN_MESH='/path/to/your/lnd_mesh.nc'
./xmlchange ATM_DOMAIN_MESH='/path/to/your/lnd_mesh.nc'
./xmlchange MASK_MESH='/path/to/your/mask_mesh.nc'
Thus, I am not sure if I should revise the default values.
6. Submit the case
./case.submit
The run does not work. I attached a log file for your reference. In brief, it said:
Input land mesh file /glade/p/cesmdata/cseg/inputdata/share/meshes/ne240np4_ESMFmesh_cdf5_c20211018.nc
Input mask mesh file /glade/p/cesmdata/cseg/inputdata/share/meshes/gx1v7_151008_ESMFmesh.nc
Obtaining land mask and fraction from mask file /glade/p/cesmdata/cseg/inputdata/share/meshes/gx1v7_151008_ESMFmesh.nc
Attempting to read global dimensions from surface dataset
(GETFIL): attempting to find local file
surfdata_CO_region_hist_78pfts_CMIP6_simyr2000_c230828.nc
(GETFIL): using /glade/u/home/mengqij/surface_dataset_corn/surfdata_CO_region_hist_78pfts_CMIP6_simyr2000_c230828.nc
global ni,nj = 20 13
model grid is 2-dimensional
Computing land fraction and land mask by mapping mask from mesh_mask file
decompInit_lnd(): Number of processes exceeds number of land grid cells
1152 0
ENDRUN:
ERROR: ERROR in decompInitMod.F90 at line 170
According to the guidebook (Setting up (high-res sparse) regional-grid CTSM simulations · ESCOMP/CTSM · Discussion #1919), I am able to run the CLM5-BGC-crop at regular 1-degree resolution in the mid-west US. However, I want to run a high-resolution (0.125 degree) case in the mid-west US. I got stuck here for several days. Could you please give me some input here? Thanks!
I used the following command:
1. Subset the surface data
~/CTSM/tools/site_and_regional> qcmd -- ./subset_data region --lat1 37.00 --lat2 49.00 --lon1 -105.00 --lon2 -80.00 --reg CO_region --create-surface --create-user-mods --datm-syr 2000 --datm-eyr 2005 --crop --outdir /glade/scratch/mengqij/my_subset_data_Bo1_region_1
Note: This is surface datafor mid-west US.
2. Create a new case
./create_newcase --case ~/A_corn_simulation_region/I2000_CTSM_singlept_region_test_a --res ne240_ne240_mg17 --compset I2000Clm51BgcCrop --project UIUC0025 --run-unsupported
Note: I changed the --res from "CLM_USRDAT" to "ne240_ne240_mg17". ne240_ne240_mg17 is one of the supported resolutions.
3. Generate mesh files (note the Scrip2Unstruct command has been updated in Discussion 1919)
In ctsm/tools/site_and_regional/
module load nco
ncks --rgr infer --rgr scrip=scrip.nc ~/surface_dataset_corn/surfdata_CO_region_hist_78pfts_CMIP6_simyr2000_c230828.nc foo.nc
/glade/u/apps/ch/opt/esmf-netcdf/8.0.0/intel/19.0.5/bin/bing/Linux.intel.64.mpiuni.default/ESMF_Scrip2Unstruct scrip.nc lnd_mesh.nc 0
ncap2 -s 'elementMask(:)=0' lnd_mesh.nc mask_mesh.nc
Note: I did not change these commands. Right?
4. Set up a case and build the executable
./case.setup
qcmd -- ./case.build
5. Submit the run
./xmlchange STOP_OPTION=nyears.
./xmlchange STOP_N=1
./xmlchange DATM_YR_ALIGN=2000./xmlchange DATM_YR_START=2000
./xmlchange DATM_YR_END=2001
./xmlchange LND_DOMAIN_MESH= "$DIN_LOC_ROOT/share/meshes/ne240np4_ESMFmesh_cdf5_c20211018.nc"
./xmlchange ATM_DOMAIN_MESH= "$DIN_LOC_ROOT/share/meshes/ne240np4_ESMFmesh_cdf5_c20211018.nc"
./xmlchange MASK_MESH= "$DIN_LOC_ROOT/share/meshes/gx1v7_151008_ESMFmesh.nc"
Note: For LND_DOMAIN_MESH, ATM_DOMAIN_MESH, and MASK_MESH, I noticed that these variables were automatically set.
However, in the guidebook, they seem to be:
./xmlchange LND_DOMAIN_MESH='/path/to/your/lnd_mesh.nc'
./xmlchange ATM_DOMAIN_MESH='/path/to/your/lnd_mesh.nc'
./xmlchange MASK_MESH='/path/to/your/mask_mesh.nc'
Thus, I am not sure if I should revise the default values.
6. Submit the case
./case.submit
The run does not work. I attached a log file for your reference. In brief, it said:
Input land mesh file /glade/p/cesmdata/cseg/inputdata/share/meshes/ne240np4_ESMFmesh_cdf5_c20211018.nc
Input mask mesh file /glade/p/cesmdata/cseg/inputdata/share/meshes/gx1v7_151008_ESMFmesh.nc
Obtaining land mask and fraction from mask file /glade/p/cesmdata/cseg/inputdata/share/meshes/gx1v7_151008_ESMFmesh.nc
Attempting to read global dimensions from surface dataset
(GETFIL): attempting to find local file
surfdata_CO_region_hist_78pfts_CMIP6_simyr2000_c230828.nc
(GETFIL): using /glade/u/home/mengqij/surface_dataset_corn/surfdata_CO_region_hist_78pfts_CMIP6_simyr2000_c230828.nc
global ni,nj = 20 13
model grid is 2-dimensional
Computing land fraction and land mask by mapping mask from mesh_mask file
decompInit_lnd(): Number of processes exceeds number of land grid cells
1152 0
ENDRUN:
ERROR: ERROR in decompInitMod.F90 at line 170
Attachments
Last edited by a moderator: