Problem with downloading input data

[johanna_teresa]

Hi all,

I am trying to download required input data for an FWHIST compset run but when trying to download input data I keep getting error messages. I have tried moving the svn protocol to before the wget protocol in case there was an issue with wget, but it says 'Client protocol svn not enabled' and directly attempts to download via the wget protocol. It then successfully downloads the 'inputdata_checksum.dat' file but fails directly after.

Trying to download file: '../inputdata_checksum.dat' to path '/capstor/scratch/cscs/jmalle/waccm_test_1/waccm_test_1/run/inputdata_checksum.dat.raw' using WGET protocol.
SUCCESS

It fails with the following message when running ./check_input_data --download --debug:

Using protocol wget with user  and passwd
RUN: wget --no-check-certificate  --spider https://svn-ccsm-inputdata.cgd.ucar.edu/trunk/inputdata/
  errput: Spider mode enabled. Check if remote file exists.
--2025-04-10 16:14:38--  https://svn-ccsm-inputdata.cgd.ucar.edu/trunk/inputdata/
Resolving svn-ccsm-inputdata.cgd.ucar.edu (svn-ccsm-inputdata.cgd.ucar.edu)... 128.117.13.55
Connecting to svn-ccsm-inputdata.cgd.ucar.edu (svn-ccsm-inputdata.cgd.ucar.edu)|128.117.13.55|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Remote file exists and could contain further links,
but recursion is disabled -- not retrieving.

I have copied my entries to config_input_data.xml below.

When I completely delete the e.g.

.../inputdata/cesm2_init/f.e21.FWHIST.f09_f09_mg17.cesm2.1-exp011.001_v2/1979-01-01/

folder, it is attempting to download things already during the ./preview_namelist call, but somehow it adds many more files than what I see on - Revision 70327: /trunk/inputdata/cesm2_init/f.e21.FWHIST.f09_f09_mg17.cesm2.1-exp011.001_v2/1979-01-01


Any hints would be greatly appreciated.

Thanks a lot,
Johanna

What version of the code are you using? CESM 2.1.3

Have you made any changes to files in the source tree? I have played around with my config_inputdata.xml script. Currently it looks like this:

<inputdata>
  <!-- server precidence is order in this file.  Highest preference at top -->
  <!-- If the client doesn't have the protocol it will be skipped -->
  <!-- chksum verification of inputfiles is possible.  If a file with name -->
  <!-- inputdata_chksum.dat is found on the server in the directory above inputdata -->
  <!-- it will be searched for filename and chksum of each downloaded file.  -->
  <!-- see the file ftp://ftp.cgd.ucar.edu/cesm/inputdata_chksum.dat for proper format. -->

  <server>
    <protocol>svn</protocol>
    <address>https://svn-ccsm-inputdata.cgd.ucar.edu/trunk/inputdata</address>
  </server>

 <server>
    <protocol>wget</protocol>
    <address>https://ftp.cgd.ucar.edu/cesm/inputdata/</address>
    <checksum>../inputdata_checksum.dat</checksum>
  </server>

  <server>
    <comment> wget access to subversion </comment>
    <protocol>wget</protocol>
    <address>https://svn-ccsm-inputdata.cgd.ucar.edu/trunk/inputdata/</address>
  </server>

  <server>
    <protocol>svn</protocol>
    <address>https://svn-ccsm-inputdata.cgd.ucar.edu/trunk/inputdata</address>
  </server>

  <server>
    <protocol>wget</protocol>
    <address>https://redoak.cs.toronto.edu/twitcher/ows/proxy/thredds/fileServer/datasets/CESM/inputdata/</address>
  </server>

</inputdata>

 

[jedwards]

I think that the problem may be that you are using an old version of the code. Please update to the latest cesm2.1.x (at this time 2.1.5) and
try again.