Scheduled Downtime
On Tuesday 24 October 2023 @ 5pm MT the forums will be in read only mode in preparation for the downtime. On Wednesday 25 October 2023 @ 5am MT, this website will be down for maintenance and expected to return online later in the morning.
Normal Operations
The forums are back online with normal operations. If you notice any issues or errors related to the forums, please reach out to help@ucar.edu

downloading entire cesm input repository

R

rauscher

New Member
I am trying to download the cesm input data via svn, i.e.
svn checkout https://svn-ccsm-inputdata.cgd.ucar.edu/trunk/inputdata/

I realize one is not supposed to download the entire data directory, but
we have a
growing community of cesm users here at lanl and we want to establish a
common input data directory for everyone to use. However, I have been
getting repeated errors during svn, e.g.
svn: REPORT request failed on '/!svn/vcc/default'
svn: REPORT of '/!svn/vcc/default': Could not read response body: Secure
connection truncated (https://svn-ccsm-inputdata.cgd.ucar.edu)

Is it possible for me to get the data via scp from bluefire (or another
machine) - I have an account on bluefire, but I wanted to check first
before doing such a large file transfer that could inconvenience other
users. Or if you could recommend another way for me to get the data,
that would be great.
 
D

dbailey

CSEG and Liaisons
Staff member
What version of the subversion client are you using on your end? I'm guessing that these don't match up. Also, when did you last try? We definitely do not recommend scp'ing the data from bluefire. I can check with our systems guys to see if they can find the problem in the subversion logs.
 
M

mvr

Member
Hi...
We strongly discourage users to download the entire inputdata repository. The repository
contains many experimental datasets (some of which are vary large) that your user base
will never put to use. The same is true for the inputdata directory of bluefire.

It is far more efficient to set up a common inputdata directory for your users and have
them use the script 'check_input_data' to identify and download the files there. This
script is located in the Tools directory of any CESM tag, and (even better!) supplied
whenever a build fails due to a file not existing in the local inputdata directory.

'check_input_data' will still need svn to download the files, but the error you were
experiencing was due to a server problem that we took measures to correct. If
any further problems occur, let us know.

Mathew
 
R

rauscher

New Member
I understand that it is discouraged, hence my questions. We were using the common input data directory model with everyone writing to it but we had some permissions issues that caused jobs to fail. I was just trying to find some other solution to get things working for everyone. I started from scratch and set the group ownership and permissions more carefully so I am hopeful everything will work now.
thanks
 
S

snandini@marum_de

New Member
We are are facing issues with importing data through svn to supercomputer platform, hlrn
svn --username ***** --password ******  list https://svn-ccsm-inputdata.cgd.ucar.edu/trunk/inputdata/

The username and password to be used are correct we checked it from our machine.
We received an error message.
svn: OPTIONS of 'https://svn-ccsm-inputdata.cgd.ucar.edu/trunk/inputdata': could not connect to server (https://svn-ccsm-inputdata.cgd.ucar.edu)

As this works from our local machine we guess that an outgoing svn is not allowed at hlogin at the supercomputer platform, however the support group is able to connect with the server.
Please suggest an alternative solution for this?
Deeply appreciated.

Sri Nandini
Uni Bremen
 
You must log in or register to reply here.
Top