Input data download

yhdchoi

YONGHAN CHOI
New Member
Describe your problem or question:
Hello,
I executed "check_input_data --download" to download required data for my CESM2 run.
However, I got errors.

Resolving ftp.cgd.ucar.edu (ftp.cgd.ucar.edu)... 128.117.13.41
Connecting to ftp.cgd.ucar.edu (ftp.cgd.ucar.edu)|128.117.13.41|:21... failed: Connection refused.

Could you let me know how I can resolve the above problem?
Thank you.
 

nusbaume

Jesse Nusbaumer
CSEG and Liaisons
Staff member
Hi Yonghan Choi,

I believe our inputdata servers no longer support ftp as a connection option. Does your system allow for alternative protocols like svn or wget? If so then you can try one of those using the --protocol flag? For example:

Code:
./check_input_data --download --protocol svn

Of course if that still doesn't work for your system then please let us know.

Thanks, and have a great day!

Jesse
 
Vote Upvote 0 Downvote

yhdchoi

YONGHAN CHOI
New Member
Hello Jesse,

Thank you for your kind suggestion!
Unfortunately, adding "--protocol" flag did not work, it resulted in the same error.

Have a good day!

Yonghan
 
Vote Upvote 0 Downvote

jedwards

CSEG and Liaisons
Staff member
Try this version of the config_inputdata.xml file.

Code:
<?xml version="1.0"?>

<inputdata>
  <!-- server precidence is order in this file.  Highest preference at top -->
  <!-- If the client doesn't have the protocol it will be skipped -->
  <!-- chksum verification of inputfiles is possible.  If a file with name -->
  <!-- inputdata_chksum.dat is found on the server in the directory above inputdata -->
  <!-- it will be searched for filename and chksum of each downloaded file.  -->
  <!-- see the file ftp://ftp.cgd.ucar.edu/cesm/inputdata_chksum.dat for proper format. -->
  <server>
    <protocol>wget</protocol>
    <address>https://ftp.cgd.ucar.edu/cesm/inputdata/</address>
    <checksum>../inputdata_checksum.dat</checksum>
  </server>

  <server>
    <comment> wget access to subversion </comment>
    <protocol>wget</protocol>
    <address>https://svn-ccsm-inputdata.cgd.ucar.edu/trunk/inputdata/</address>
  </server>

  <server>
    <protocol>svn</protocol>
    <address>https://svn-ccsm-inputdata.cgd.ucar.edu/trunk/inputdata</address>
  </server>

  <server>
    <protocol>wget</protocol>
    <address>https://redoak.cs.toronto.edu/twitcher/ows/proxy/thredds/fileServer/datasets/CESM/inputdata/</address>
  </server>
 
  <server CLM_USRDAT_NAME="NEON">
    <comment> NEON Tower data for datm </comment>
    <protocol>wget</protocol>
    <address>https://storage.neonscience.org/neon-ncar/NEON/</address>
    <!-- inventory is a CSV list of available data files and the valid date for each -->
    <!-- expected format is pathtofile,YYYY-MM-DD HH:MM:SS -->
    <!-- one per line where the date stamp indicates the last modification time of the file -->
    <inventory>../listing.csv</inventory>

  </server>
  <server CLM_USRDAT_NAME="NEON.PRISM">
    <comment> NEON Tower data for datm </comment>
    <protocol>wget</protocol>
    <address>https://storage.neonscience.org/neon-ncar/NEON/</address>
    <!-- inventory is a CSV list of available data files and the valid date for each -->
    <!-- expected format is pathtofile,YYYY-MM-DD HH:MM:SS -->
    <!-- one per line where the date stamp indicates the last modification time of the file -->
    <inventory>../listing.csv</inventory>
  </server>

</inputdata>
 
Vote Upvote 0 Downvote

Andy_Wai

New Member
Try this version of the config_inputdata.xml file.

Code:
<?xml version="1.0"?>

<inputdata>
  <!-- server precidence is order in this file.  Highest preference at top -->
  <!-- If the client doesn't have the protocol it will be skipped -->
  <!-- chksum verification of inputfiles is possible.  If a file with name -->
  <!-- inputdata_chksum.dat is found on the server in the directory above inputdata -->
  <!-- it will be searched for filename and chksum of each downloaded file.  -->
  <!-- see the file ftp://ftp.cgd.ucar.edu/cesm/inputdata_chksum.dat for proper format. -->
  <server>
    <protocol>wget</protocol>
    <address>https://ftp.cgd.ucar.edu/cesm/inputdata/</address>
    <checksum>../inputdata_checksum.dat</checksum>
  </server>

  <server>
    <comment> wget access to subversion </comment>
    <protocol>wget</protocol>
    <address>https://svn-ccsm-inputdata.cgd.ucar.edu/trunk/inputdata/</address>
  </server>

  <server>
    <protocol>svn</protocol>
    <address>https://svn-ccsm-inputdata.cgd.ucar.edu/trunk/inputdata</address>
  </server>

  <server>
    <protocol>wget</protocol>
    <address>https://redoak.cs.toronto.edu/twitcher/ows/proxy/thredds/fileServer/datasets/CESM/inputdata/</address>
  </server>
 
  <server CLM_USRDAT_NAME="NEON">
    <comment> NEON Tower data for datm </comment>
    <protocol>wget</protocol>
    <address>https://storage.neonscience.org/neon-ncar/NEON/</address>
    <!-- inventory is a CSV list of available data files and the valid date for each -->
    <!-- expected format is pathtofile,YYYY-MM-DD HH:MM:SS -->
    <!-- one per line where the date stamp indicates the last modification time of the file -->
    <inventory>../listing.csv</inventory>

  </server>
  <server CLM_USRDAT_NAME="NEON.PRISM">
    <comment> NEON Tower data for datm </comment>
    <protocol>wget</protocol>
    <address>https://storage.neonscience.org/neon-ncar/NEON/</address>
    <!-- inventory is a CSV list of available data files and the valid date for each -->
    <!-- expected format is pathtofile,YYYY-MM-DD HH:MM:SS -->
    <!-- one per line where the date stamp indicates the last modification time of the file -->
    <inventory>../listing.csv</inventory>
  </server>

</inputdata>
I try it , but it does not work. the following links do not work:





PS: I am using CESM 2.1.5

Could you help? Thanks
 
Vote Upvote 0 Downvote
Back
Top