subset_data can not find inputdata

[taoliu_tech]

I am following tutorial Welcome to the 2022 CTSM mini-tutorial — CTSM Mini-tutorial 2022 to simulate single point, but I received the error below. I am using a container escomp/cesm-lab-neon.

[user@cesm site_and_regional]$ ./subset_data point --lat 42.53562 --lon 287.82438 --site my_point --create-surface --create-datm --datm-syr 2001 --datm-eyr 2002 --create-user-mods --outdir ~/my_subset_data --inputdata-dir ~/inputdata
WARNING: No dominant pft type is chosen. If you want to choose a dominant pft type, please use --dompft flag.
ERROR: File not found : /home/user/inputdata/lnd/clm2/surfdata_map/release-clm5.0.18/surfdata_0.9x1.25_hist_16pfts_Irrig_CMIP6_simyr2000_c190214.nc

 

[afoster]

Hi,

Unfortunately it looks like that file is not available on your container. For the tutorial we downloaded the file from Cheyenne and placed in in that folder location. I'm not sure if that file exists on the container escomp/cesm-lab-neon. If it does you will need to find it and modify the file default_data.cfg in ctsm/tools/site_and_regional so that the directory (and filename) are correct.

 

[taoliu_tech]

I manually downloaded the missing data from website https://svn-ccsm-inputdata.cgd.ucar.edu/trunk/inputdata/.
That tutorial asked to change xml

./xmlchange MPILIB=impi

I was not able to do this, because I received error message "ERROR: Could not find a matching MPI for attributes: {'compiler': 'gnu', 'mpilib': 'impi', 'threaded': False}". If I did not change XML, now, I encountered the error below after case.submit.

*** The MPI_Query_thread() function was called before MPI_INIT was invoked.
*** This is disallowed by the MPI standard.
*** Your MPI job will now abort.
[cc1348ebea6c:34309] Local abort before MPI_INIT completed completed successfully, but am not able to aggregate error messages, and not able to guarantee that all other processes were killed!

 

[oleson]

I've been told that the CTSM mini-tutorial was not designed to work in the cesm-lab NEON container. Please see this discussion regarding current and future tutorial opportunities:

Tutorial opportunities for CTSM · ESCOMP CTSM · Discussion #1855

We've received a number of requests to launch the cloud environment from the CTSM mini-tutorial. This cloud environment has been taken down, but there are still ways to learn about CTSM. Here are s...

github.com

 

[taoliu_tech]

Thanks, Keith. Is there any tutorial for running single point simulations in general?

 

[oleson]

The following may be helpful:

CTSM-Tutorial-2022/Day2a_GenericSinglePoint.ipynb at main · NCAR/CTSM-Tutorial-2022

Materials for CTSM Mini Tutorial 2022. Contribute to NCAR/CTSM-Tutorial-2022 development by creating an account on GitHub.

github.com

Also:

How do I create a single-point run with the NUOPC (default) coupler? · ESCOMP CTSM · Discussion #1833

We get this question a lot: I am trying to set up a case for a specific latitude and longitude. I want to use GSWP3 climate data, how do I set this up?

github.com

You'll likely have to make modifications for your own machine, these instructions are based on our machine, cheyenne.

 

[taoliu_tech]

Thank you, Keith. Those links point to the same content as the mini tutorial. I have tried myself three months to install CESM on my own computer and I have never had success. I do not plan to invest more time installing the CESM on my computer. I'm now using escomp/cesm-lab-neon, escomp/ctsm-neon and escomp/cesm-lab-2.2 containers to run and learn CESM. I can run global simulation examples using those containers, but single-point simulation never succeeded. I can use run_neon command in escomp/ctsm-neon container to successfully get the simulation results for NEON sites, but as I mentioned above, the general point simulation failed following the instruction links above. I think NEON simulation is just a special case of general point simulation, and I should be able to run a general point simulation in a container if NEON simulation is successful in that container. Do you know any container that works for general point simulation? Can CESM users like me apply for an account to use the Cheyenne machine?

 

[oleson]

In that link I provided above, there is mention of obtaining allocations on cheyenne through CISL:

Documentation | ARC NCAR

arc.ucar.edu

 

[taoliu_tech]

Excellent! Thanks for informing me of this opportunity, Keith. I will submit my application soon.