Scheduled Downtime
On Tuesday 24 October 2023 @ 5pm MT the forums will be in read only mode in preparation for the downtime. On Wednesday 25 October 2023 @ 5am MT, this website will be down for maintenance and expected to return online later in the morning.
Normal Operations
The forums are back online with normal operations. If you notice any issues or errors related to the forums, please reach out to help@ucar.edu

Error when use ./check_input_data --download

hyf412694462

HE Yanfeng
New Member
My machine is a centos7 supercomputer at NIES (Japan) with PBS batch sytem.

I executed the following commands with all commands executed successfully without errors.
./create_newcase --case I1850CLM50_001 --res f19_g17 --compset I1850Clm50Sp --mach sx-aurora
./case.setup
./case.build

After that, I found my inputdata directory don't has any input data (input data have not downloaded automatically).
So I use ./check_input_data --download to download missing input data.
Part of the missing input data are downloaded successfully, but some missing input data cannot be downloaded with the following error message. How can I solve this problem?

Client protocol gftp not enabled
Could not automatically download file /home/reg/freg0043/data/clm5/output/I1850CLM50_001/I1850CLM50_001/run/inputdata_checksum.dat Restoring existing version.
Client protocol None not enabled
Client protocol gftp not enabled

Model datm missing file file240 = '/home/reg/freg0043/data/clm5/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/TPHWL/clmforc.GSWP3.c2011.0.5x0.5.TPQWL.1920-12.nc'
Trying to download file: 'lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/TPHWL/clmforc.GSWP3.c2011.0.5x0.5.TPQWL.1920-12.nc' to path '/home/reg/freg0043/data/clm5/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/TPHWL/clmforc.GSWP3.c2011.0.5x0.5.TPQWL.1920-12.nc' using WGET protocol.
wget failed with output: b'' and errput b"--2023-10-04 13:56:45-- ftp://ftp.cgd.ucar.edu/cesm/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/TPHWL/clmforc.GSWP3.c2011.0.5x0.5.TPQWL.1920-12.nc\n => '/home/reg/freg0043/data/clm5/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/TPHWL/clmforc.GSWP3.c2011.0.5x0.5.TPQWL.1920-12.nc'\nResolving ftp.cgd.ucar.edu (ftp.cgd.ucar.edu)... 128.117.13.41\nConnecting to ftp.cgd.ucar.edu (ftp.cgd.ucar.edu)|128.117.13.41|:21... connected.\nLogging in as anonymous ... Logged in!\n==> SYST ... done. ==> PWD ... done.\n==> TYPE I ... done. ==> CWD (1) /cesm/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/TPHWL ... \nNo such directory 'cesm/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/TPHWL'."

Loading input file list: 'Buildconf/cism.input_data_list'
Loading input file list: 'Buildconf/mosart.input_data_list'
Checking server ftp.cgd.ucar.edu/cesm/inputdata with protocol ftp
Setting resource.RLIMIT_STACK to -1 from (-1, -1)
Using protocol ftp with user anonymous and passwd user@example.edu
server address ftp.cgd.ucar.edu root path cesm/inputdata
Loading input file list: 'Buildconf/clm.input_data_list'
Loading input file list: 'Buildconf/cpl.input_data_list'
Loading input file list: 'Buildconf/datm.input_data_list'
Model datm missing file domain1 = '/home/reg/freg0043/data/clm5/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/domain.lnd.360x720_gswp3.0v1.c170606.nc'
Trying to download file: 'lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/domain.lnd.360x720_gswp3.0v1.c170606.nc' to path '/home/reg/freg0043/data/clm5/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/domain.lnd.360x720_gswp3.0v1.c170606.nc' using FTP protocol.
ERROR from ftp server, trying next server
Model datm missing file file1 = '/home/reg/freg0043/data/clm5/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/Solar/clmforc.GSWP3.c2011.0.5x0.5.Solr.1901-01.nc'
Trying to download file: 'lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/Solar/clmforc.GSWP3.c2011.0.5x0.5.Solr.1901-01.nc' to path '/home/reg/freg0043/data/clm5/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/Solar/clmforc.GSWP3.c2011.0.5x0.5.Solr.1901-01.nc' using FTP protocol.
ERROR from ftp server, trying next server
 

dbailey

CSEG and Liaisons
Staff member
I'm going to move this to the CLM forum. Although are these your own custom files?
 

jedwards

CSEG and Liaisons
Staff member
Our input data server was down this morning for maintenance but it's back now - can you try again?
 

dbailey

CSEG and Liaisons
Staff member
That is what I was referring to. If you have created your own files then you need to copy these to the run directory.
 

hyf412694462

HE Yanfeng
New Member
Hi,

I have solved this problem by changing the following item in config_machines.xml.

Changed from:
<DIN_LOC_ROOT_CLMFORC>$DIN_LOC_ROOT/lmwg</DIN_LOC_ROOT_CLMFORC>
to:
<DIN_LOC_ROOT_CLMFORC>$DIN_LOC_ROOT/atm/datm7</DIN_LOC_ROOT_CLMFORC>

If you set the above directory to lmwg, check_input_data will try to download data from ftp://ftp.cgd.ucar.edu/cesm/inputdata/lmwg, which is a wrong path.
 
Top