How to make the landuse_timeseries data?

Li Ming · Mar 28, 2023

Hi,
The version I am using is clm5.0.35 and I want to make a domain and surface file with resolution of 0.1°. I successfully made the domain file using the gen_domain tool, then I made the surface file using the mksurfdata.pl tool:

./mksurfdata.pl -r usrspec -usr_gname $GRIDNAME -usr_gdate $CDATE

Now I want to make the landuse_timeseries file and I tried the following command:

./mksurfdata.pl -r usrspec -usr_gname $GRIDNAME -usr_gdate $CDATE -no_surfdata

As a result, only landuse_timeseries_hist_78pfts_simyr1850-2015.txt appears, how do I use the txt file to make landuse_timeseries?

And I have another question, after creating the case the CaseDocs folder will generate the control file for atmosphere forcing data such as datm.streams.txt.CLMGSWP3v1.Precip, is there any difference between the atmosphere forcing domain file and the ATM_DOMAIN_FILE in env_run? Do I need to replace it with a 0.1° domain file that I made myself?

Thank you very much for your help!

oleson · Mar 28, 2023

I think you need to add "-years 1850-2000" to your mksurfdata.pl command.

Yes, there is a difference. The domain file in datm.streams.txt.CLMGSWP3v1.Precip is for the 0.5deg GSWP3v1 forcing grid (domain.lnd.360x720_gswp3.0v1.c170606.nc). ATM_DOMAIN_FILE (and LND_DOMAIN_FILE) should point to your 0.1deg domain file.

Li Ming · Mar 30, 2023

Thanks for your reply, I am using this command and the model works fine. If I want to create future scenario surface files and landuse_timeseries files, what command should I use?

oleson · Mar 30, 2023

If you run ./mksurfdata.pl --help you'll see the options available.
One of those is:

-ssp_rcp "scenario-name" Shared Socioeconomic Pathway and Representative Concentration Pathway Scenario name(s).
"hist" for historical, otherwise in form of SSPn-m.m where n is the SSP number
and m.m is the radiative forcing in W/m^2 at the peak or 2100.

So, for example:

./mksurfdata.pl -ssp_rcp SSP5-8.5 -res 0.9x1.25 -years 1850-2100

Li Ming · Apr 2, 2023

Thankyou Oleson, I will try again

jinping F · May 13, 2024

oleson said:
If you run ./mksurfdata.pl --help you'll see the options available.
One of those is:

-ssp_rcp "scenario-name" Shared Socioeconomic Pathway and Representative Concentration Pathway Scenario name(s).
"hist" for historical, otherwise in form of SSPn-m.m where n is the SSP number
and m.m is the radiative forcing in W/m^2 at the peak or 2100.

So, for example:

./mksurfdata.pl -ssp_rcp SSP5-8.5 -res 0.9x1.25 -years 1850-2100

Hi
"What is the command for '-res 0.125×0.125°'? How is it generated?"

oleson · May 14, 2024

See this post here:

landuse.timeseries historical (1850-2015) data file at 0.125x0.125 resolution

Hi everyone, Is there a landuse.timeseries (1850-2015 or for recent decades) data file at 0.125x0.125 resolution available? It would be helpful if anyone share the file. I find the surfdata file at this resolution here...

bb.cgd.ucar.edu

jinping F · Jun 2, 2024

oleson said:
If you run ./mksurfdata.pl --help you'll see the options available.
One of those is:

-ssp_rcp "scenario-name" Shared Socioeconomic Pathway and Representative Concentration Pathway Scenario name(s).
"hist" for historical, otherwise in form of SSPn-m.m where n is the SSP number
and m.m is the radiative forcing in W/m^2 at the peak or 2100.

So, for example:

./mksurfdata.pl -ssp_rcp SSP5-8.5 -res 0.9x1.25 -years 1850-2100

Hello, scientist.
I am working on a landuse_timeseries at 0.1x0.1 degree resolution and encountering the following error!

[fengjinping@swarm01 mksurfdata_map]$ ./mksurfdata.pl -res 0.1x0.1 -years 1850-2000
ERROR: mapping file for this resolution does NOT exist (/home/fengjinping/project/cesm/inputdata/lnd/clm2/mappingdata/maps/0.1x0.1/map_3x3min_MODIS-wCsp_to_0.1x0.1_nomask_aave_da_c160425.nc).

The URL (https://svn-ccsm-inputdata.cgd.ucar.edu/trunk/inputdata/lnd/clm2/mappingdata/maps/0.1x0.1/) does not have the file 'map_3x3min_MODIS-wCsp_to_0.1x0.1_nomask_aave_da_c160425.nc'. Please upload it. Also, there is another small issue. Which other .nc files does this command require? Can you upload them together? Thank you!

slevis · Jun 3, 2024

I copied the file to our anonymous ftp site:
ftp ftp.cgd.ucar.edu
login: anonymous
passwd: your email address
cd /pub/slevis/for_jinpingF
I'm afraid I don't know which other .nc files this requires. The list may appear in a namelist in your working directory. Either way, you will have to tell me...

jinping F · Jun 4, 2024

slevis said:
I copied the file to our anonymous ftp site:
ftp ftp.cgd.ucar.edu
login: anonymous
passwd: your email address
cd /pub/slevis/for_jinpingF
I'm afraid I don't know which other .nc files this requires. The list may appear in a namelist in your working directory. Either way, you will have to tell me...

No namelist was generated, so we can only go one by one. I am missing the file map_0.25x0.25_MODIS_to_0.1x0.1_nomask_aave_da_c170321.nc.

[fengjinping@swarm01 mksurfdata_map]$ ./mksurfdata.pl -res 0.1x0.1 -years 1850-2000
ERROR: mapping file for this resolution does NOT exist (/home/fengjinping/project/cesm/inputdata/lnd/clm2/mappingdata/maps/0.1x0.1/map_0.25x0.25_MODIS_to_0.1x0.1_nomask_aave_da_c170321.nc).

oleson · Jun 4, 2024

If you add -debug to your command a namelist file will be generated and then you can determine which files you are missing.

jinping F · Jun 5, 2024

oleson said:
If you add -debug to your command a namelist file will be generated and then you can determine which files you are missing.

I have attempted the command "./mksurfdata.pl -res 0.1x0.1 -years 1850-2000 -debug".
Shown as follows :
[fengjinping@swarm01 mksurfdata_map]$ ./mksurfdata.pl -res 0.1x0.1 -years 1850-2000 -debug
ERROR: mapping file for this resolution does NOT exist (/home/fengjinping/project/cesm/inputdata/lnd/clm2/mappingdata/maps/0.1x0.1/map_0.25x0.25_MODIS_to_0.1x0.1_nomask_aave_da_c170321.nc).

However, I still encountered an error, and it didn't show which files the script would read, the commands it would execute, or the data it would generate during runtime. Could you please run this command on your server and share the generated namelist file with me? This would allow me to identify which files are missing and proceed accordingly. Thank you!

oleson · Jun 5, 2024

Sorry, I thought it would generate a namelist file regardless. We don't have a way to do that ourselves because those tools don't work on our new machine. We have transitioned to a new tool, mksurfdata_esmf. However, another way of determining the files that you need is to look at this file (the file name may differ depending on the version of the model you are using:

bld/namelist_files/namelist_defaults_clm4_5.xml

In the version I'm looking at I see:



<map frm_hgrid="0.1x0.1" frm_lmask="nomask" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_0.1x0.1_nomask_to_0.1x0.1_nomask_aave_da_c120406.nc</map>
<map frm_hgrid="0.5x0.5" frm_lmask="AVHRR" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_0.5x0.5_AVHRR_to_0.1x0.1_nomask_aave_da_c120406.nc</map>
<map frm_hgrid="0.5x0.5" frm_lmask="MODIS" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_0.5x0.5_MODIS_to_0.1x0.1_nomask_aave_da_c120406.nc</map>
<map frm_hgrid="0.25x0.25" frm_lmask="MODIS" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_0.25x0.25_MODIS_to_0.1x0.1_nomask_aave_da_c170321.nc</map>
<map frm_hgrid="0.5x0.5" frm_lmask="nomask" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_0.5x0.5_nomask_to_0.1x0.1_nomask_aave_da_c120406.nc</map>
<map frm_hgrid="10x10min" frm_lmask="nomask" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_10x10min_nomask_to_0.1x0.1_nomask_aave_da_c120406.nc</map>
<map frm_hgrid="3x3min" frm_lmask="MODIS" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_3x3min_MODIS_to_0.1x0.1_nomask_aave_da_c120406.nc</map>
<map frm_hgrid="3x3min" frm_lmask="MODIS-wCsp" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_3x3min_MODIS-wCsp_to_0.1x0.1_nomask_aave_da_c160425.nc</map>
<map frm_hgrid="5x5min" frm_lmask="IGBP-GSDP" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_5x5min_IGBP-GSDP_to_0.1x0.1_nomask_aave_da_c120406.nc</map>
<map frm_hgrid="5x5min" frm_lmask="ISRIC-WISE" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_5x5min_ISRIC-WISE_to_0.1x0.1_nomask_aave_da_c120406.nc</map>
<map frm_hgrid="5x5min" frm_lmask="ORNL-Soil" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_5x5min_ORNL-Soil_to_0.1x0.1_nomask_aave_da_c170706.nc</map>
<map frm_hgrid="5x5min" frm_lmask="nomask" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_5x5min_nomask_to_0.1x0.1_nomask_aave_da_c120406.nc</map>
<map frm_hgrid="ne120np4" frm_lmask="nomask" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_ne120np4_nomask_to_0.1x0.1_nomask_aave_da_c120711.nc</map>
<map frm_hgrid="4x5" frm_lmask="nomask" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_4x5_nomask_to_0.1x0.1_nomask_aave_da_c120706.nc</map>
<map frm_hgrid="1.9x2.5" frm_lmask="nomask" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_1.9x2.5_nomask_to_0.1x0.1_nomask_aave_da_c120709.nc</map>
<map frm_hgrid="ne240np4" frm_lmask="nomask" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_ne240np4_nomask_to_0.1x0.1_nomask_aave_da_c120711.nc</map>
<map frm_hgrid="0.9x1.25" frm_lmask="GRDC" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_0.9x1.25_GRDC_to_0.1x0.1_nomask_aave_da_c130308.nc</map>
<map frm_hgrid="360x720cru" frm_lmask="cruncep" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_360x720_cruncep_to_0.1x0.1_nomask_aave_da_c130326.nc</map>
<map frm_hgrid="1km-merge-10min" frm_lmask="HYDRO1K-merge-nomask" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_1km-merge-10min_HYDRO1K-merge-nomask_to_0.1x0.1_nomask_aave_da_c130405.nc</map>

jinping F · Jun 6, 2024

oleson said:
Sorry, I thought it would generate a namelist file regardless. We don't have a way to do that ourselves because those tools don't work on our new machine. We have transitioned to a new tool, mksurfdata_esmf. However, another way of determining the files that you need is to look at this file (the file name may differ depending on the version of the model you are using:

bld/namelist_files/namelist_defaults_clm4_5.xml

In the version I'm looking at I see:



<map frm_hgrid="0.1x0.1" frm_lmask="nomask" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_0.1x0.1_nomask_to_0.1x0.1_nomask_aave_da_c120406.nc</map>
<map frm_hgrid="0.5x0.5" frm_lmask="AVHRR" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_0.5x0.5_AVHRR_to_0.1x0.1_nomask_aave_da_c120406.nc</map>
<map frm_hgrid="0.5x0.5" frm_lmask="MODIS" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_0.5x0.5_MODIS_to_0.1x0.1_nomask_aave_da_c120406.nc</map>
<map frm_hgrid="0.25x0.25" frm_lmask="MODIS" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_0.25x0.25_MODIS_to_0.1x0.1_nomask_aave_da_c170321.nc</map>
<map frm_hgrid="0.5x0.5" frm_lmask="nomask" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_0.5x0.5_nomask_to_0.1x0.1_nomask_aave_da_c120406.nc</map>
<map frm_hgrid="10x10min" frm_lmask="nomask" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_10x10min_nomask_to_0.1x0.1_nomask_aave_da_c120406.nc</map>
<map frm_hgrid="3x3min" frm_lmask="MODIS" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_3x3min_MODIS_to_0.1x0.1_nomask_aave_da_c120406.nc</map>
<map frm_hgrid="3x3min" frm_lmask="MODIS-wCsp" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_3x3min_MODIS-wCsp_to_0.1x0.1_nomask_aave_da_c160425.nc</map>
<map frm_hgrid="5x5min" frm_lmask="IGBP-GSDP" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_5x5min_IGBP-GSDP_to_0.1x0.1_nomask_aave_da_c120406.nc</map>
<map frm_hgrid="5x5min" frm_lmask="ISRIC-WISE" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_5x5min_ISRIC-WISE_to_0.1x0.1_nomask_aave_da_c120406.nc</map>
<map frm_hgrid="5x5min" frm_lmask="ORNL-Soil" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_5x5min_ORNL-Soil_to_0.1x0.1_nomask_aave_da_c170706.nc</map>
<map frm_hgrid="5x5min" frm_lmask="nomask" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_5x5min_nomask_to_0.1x0.1_nomask_aave_da_c120406.nc</map>
<map frm_hgrid="ne120np4" frm_lmask="nomask" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_ne120np4_nomask_to_0.1x0.1_nomask_aave_da_c120711.nc</map>
<map frm_hgrid="4x5" frm_lmask="nomask" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_4x5_nomask_to_0.1x0.1_nomask_aave_da_c120706.nc</map>
<map frm_hgrid="1.9x2.5" frm_lmask="nomask" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_1.9x2.5_nomask_to_0.1x0.1_nomask_aave_da_c120709.nc</map>
<map frm_hgrid="ne240np4" frm_lmask="nomask" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_ne240np4_nomask_to_0.1x0.1_nomask_aave_da_c120711.nc</map>
<map frm_hgrid="0.9x1.25" frm_lmask="GRDC" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_0.9x1.25_GRDC_to_0.1x0.1_nomask_aave_da_c130308.nc</map>
<map frm_hgrid="360x720cru" frm_lmask="cruncep" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_360x720_cruncep_to_0.1x0.1_nomask_aave_da_c130326.nc</map>
<map frm_hgrid="1km-merge-10min" frm_lmask="HYDRO1K-merge-nomask" to_hgrid="0.1x0.1" to_lmask="nomask"
>lnd/clm2/mappingdata/maps/0.1x0.1/map_1km-merge-10min_HYDRO1K-merge-nomask_to_0.1x0.1_nomask_aave_da_c130405.nc</map>

Thank you for your response!
After checking and downloading, I am missing the following nc files.
>lnd/clm2/mappingdata/maps/0.1x0.1/map_0.25x0.25_MODIS_to_0.1x0.1_nomask_aave_da_c170321.nc
>lnd/clm2/mappingdata/maps/0.1x0.1/map_3x3min_MODIS_to_0.1x0.1_nomask_aave_da_c120406.nc
>lnd/clm2/mappingdata/maps/0.1x0.1/map_5x5min_ORNL-Soil_to_0.1x0.1_nomask_aave_da_c170706.nc
Could you please upload them for me?

oleson · Jun 7, 2024

You can find them at: /ftp/pub/oleson/mapping_files/

jinping F · Jun 8, 2024

oleson said:
You can find them at: /ftp/pub/oleson/mapping_files/

I have found and downloaded the file, but when I run './mksurfdata.pl -res 0.1x0.1 -years 1850-2000', it still gives me an error. Can you please help me figure out the reason? I haven't found a good solution so far. Thank you for your assistance.

[fengjinping@swarm02 mksurfdata_map]$ ./mksurfdata.pl -res 0.1x0.1 -years 1850-2000
ERROR: could NOT find a mapping file for this resolution: 0.1x0.1 and type: fmx at 3x3min and USGS.

slevis · Jun 11, 2024

My first thought is that I think that there is a namelist that you may need to update to point to the new file(s).

oleson · Jun 11, 2024

That may work for you but if you still have trouble an alternative is to use mapping files I created some time ago for another user. I've put them here:

/ftp/pub/oleson/mapping_files_c231018

I've also included a year 2005 dataset I created using those mapping file and release-cesm2.2.0.
The surface dataset was created with these commands:

setenv CDATE 231018

setenv GRIDNAME 0.1x0.1

./mksurfdata.pl -r usrspec -usr_gname $GRIDNAME -usr_gdate $CDATE -hirespft -years 2005

How to make the landuse_timeseries data?

Li Ming

Member

Keith Oleson

CSEG and Liaisons

Li Ming

Member

Keith Oleson

CSEG and Liaisons

Li Ming

Member

冯进平

New Member

Keith Oleson

CSEG and Liaisons

冯进平

New Member

Moderator

冯进平

New Member

Keith Oleson

CSEG and Liaisons

冯进平

New Member

Keith Oleson

CSEG and Liaisons

冯进平

New Member

Keith Oleson

CSEG and Liaisons

冯进平

New Member

Moderator

Keith Oleson

CSEG and Liaisons