Error when use ./check_input_data --download

Status
Not open for further replies.

hyf412694462

HE Yanfeng
New Member
My machine is a centos7 supercomputer at NIES (Japan) with PBS batch sytem.

I executed the following commands with all commands executed successfully without errors.
./create_newcase --case I1850CLM50_001 --res f19_g17 --compset I1850Clm50Sp --mach sx-aurora
./case.setup
./case.build

After that, I found my inputdata directory don't has any input data (input data have not downloaded automatically).
So I use ./check_input_data --download to download missing input data.
Part of the missing input data are downloaded successfully, but some missing input data cannot be downloaded with the following error message. How can I solve this problem?

Client protocol gftp not enabled
Could not automatically download file /home/reg/freg0043/data/clm5/output/I1850CLM50_001/I1850CLM50_001/run/inputdata_checksum.dat Restoring existing version.
Client protocol None not enabled
Client protocol gftp not enabled

Model datm missing file file240 = '/home/reg/freg0043/data/clm5/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/TPHWL/clmforc.GSWP3.c2011.0.5x0.5.TPQWL.1920-12.nc'
Trying to download file: 'lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/TPHWL/clmforc.GSWP3.c2011.0.5x0.5.TPQWL.1920-12.nc' to path '/home/reg/freg0043/data/clm5/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/TPHWL/clmforc.GSWP3.c2011.0.5x0.5.TPQWL.1920-12.nc' using WGET protocol.
wget failed with output: b'' and errput b"--2023-10-04 13:56:45-- ftp://ftp.cgd.ucar.edu/cesm/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/TPHWL/clmforc.GSWP3.c2011.0.5x0.5.TPQWL.1920-12.nc\n => '/home/reg/freg0043/data/clm5/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/TPHWL/clmforc.GSWP3.c2011.0.5x0.5.TPQWL.1920-12.nc'\nResolving ftp.cgd.ucar.edu (ftp.cgd.ucar.edu)... 128.117.13.41\nConnecting to ftp.cgd.ucar.edu (ftp.cgd.ucar.edu)|128.117.13.41|:21... connected.\nLogging in as anonymous ... Logged in!\n==> SYST ... done. ==> PWD ... done.\n==> TYPE I ... done. ==> CWD (1) /cesm/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/TPHWL ... \nNo such directory 'cesm/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/TPHWL'."

Loading input file list: 'Buildconf/cism.input_data_list'
Loading input file list: 'Buildconf/mosart.input_data_list'
Checking server ftp.cgd.ucar.edu/cesm/inputdata with protocol ftp
Setting resource.RLIMIT_STACK to -1 from (-1, -1)
Using protocol ftp with user anonymous and passwd user@example.edu
server address ftp.cgd.ucar.edu root path cesm/inputdata
Loading input file list: 'Buildconf/clm.input_data_list'
Loading input file list: 'Buildconf/cpl.input_data_list'
Loading input file list: 'Buildconf/datm.input_data_list'
Model datm missing file domain1 = '/home/reg/freg0043/data/clm5/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/domain.lnd.360x720_gswp3.0v1.c170606.nc'
Trying to download file: 'lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/domain.lnd.360x720_gswp3.0v1.c170606.nc' to path '/home/reg/freg0043/data/clm5/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/domain.lnd.360x720_gswp3.0v1.c170606.nc' using FTP protocol.
ERROR from ftp server, trying next server
Model datm missing file file1 = '/home/reg/freg0043/data/clm5/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/Solar/clmforc.GSWP3.c2011.0.5x0.5.Solr.1901-01.nc'
Trying to download file: 'lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/Solar/clmforc.GSWP3.c2011.0.5x0.5.Solr.1901-01.nc' to path '/home/reg/freg0043/data/clm5/inputdata/lmwg/atm_forcing.datm7.GSWP3.0.5d.v1.c170516/Solar/clmforc.GSWP3.c2011.0.5x0.5.Solr.1901-01.nc' using FTP protocol.
ERROR from ftp server, trying next server
 

jedwards

CSEG and Liaisons
Staff member
Our input data server was down this morning for maintenance but it's back now - can you try again?
 

dbailey

CSEG and Liaisons
Staff member
That is what I was referring to. If you have created your own files then you need to copy these to the run directory.
 

hyf412694462

HE Yanfeng
New Member
Hi,

I have solved this problem by changing the following item in config_machines.xml.

Changed from:
<DIN_LOC_ROOT_CLMFORC>$DIN_LOC_ROOT/lmwg</DIN_LOC_ROOT_CLMFORC>
to:
<DIN_LOC_ROOT_CLMFORC>$DIN_LOC_ROOT/atm/datm7</DIN_LOC_ROOT_CLMFORC>

If you set the above directory to lmwg, check_input_data will try to download data from ftp://ftp.cgd.ucar.edu/cesm/inputdata/lmwg, which is a wrong path.
 
Status
Not open for further replies.
Back
Top