It would be nice if the INPUT files or the examples were easier to access for external users

[cspencerjones]

I'm struggling with downloading the input data for the examples. It's difficult to figure out which ones you need to download in order to run a particular test case (I want to run SIS2_icebergs) and the total size is 18.6GB. I get an error saying `some data in “CORE.tgz” can’t be read or written` when I try to download some files from the ftp site as a guest, so I think there must be something wrong here.

I also might be missing something, but it'd be lovely to be able to `sftp` to the ftp site from the command line on my local cluster, but there isn't a dummy username for this and my understanding is that you can't `sftp` with a guest account.

Am I missing something here? Is there a way to make this easier? Do I need an account to access some of these files?

 

[adcroft]

Concerning part A: a mapping between data files and examples would be useful. The tar file approach is obfuscating.

On sftp: I hear you! Something a little more modern would be better.

Keeping this data available has been a long standing pain and our ftp server has been losing capability drip by drip. I can't reach the files myself. I'll see what I can do.

 

[adcroft]

The files are there but the server is slow. For the CORE.tgz file in particular, you can find the individual files at Corrected Normal Year Forcing (CNYF) Version 2.0. I just checked they are identical, albeit with different names:

$ tar zxf CORE.tgz 
$ md5sum CORE/NYF_v2.0/*
71235d8dac21cc62836c35c0c068923c  CORE/NYF_v2.0/ncar_precip.clim.nc
0964b91c2b9f19295a23c2e00ab6ef0c  CORE/NYF_v2.0/ncar_rad.clim.nc
09b6de3fd2555aa212fdbe1f2059c138  CORE/NYF_v2.0/q_10_mod.clim.nc
95232a02719417ca08c808eba1de26c2  CORE/NYF_v2.0/slp.clim.nc
7e6fef9eb022b5f51e6e85cc78848db2  CORE/NYF_v2.0/t_10_mod.clim.nc
8b5b0c55c0a9e455be6fb8ee8d11c78a  CORE/NYF_v2.0/u_10_mod.clim.nc
6f4c414b7d7259bfe599b25b3b8089c0  CORE/NYF_v2.0/v_10_mod.clim.nc
$ wget https://data1.gfdl.noaa.gov/~nnz/mom4/COREv2/data_1948_2006/NormalYearForcing/CORRECTED/ncar_precip.15JUNE2009.nc
$ wget https://data1.gfdl.noaa.gov/~nnz/mom4/COREv2/data_1948_2006/NormalYearForcing/CORRECTED/ncar_rad.15JUNE2009.nc
$ wget https://data1.gfdl.noaa.gov/~nnz/mom4/COREv2/data_1948_2006/NormalYearForcing/CORRECTED/q_10.15JUNE2009.nc
$ wget https://data1.gfdl.noaa.gov/~nnz/mom4/COREv2/data_1948_2006/NormalYearForcing/CORRECTED/t_10.15JUNE2009.nc
$ wget https://data1.gfdl.noaa.gov/~nnz/mom4/COREv2/data_1948_2006/NormalYearForcing/CORRECTED/u_10.15JUNE2009.nc
$ wget https://data1.gfdl.noaa.gov/~nnz/mom4/COREv2/data_1948_2006/NormalYearForcing/CORRECTED/v_10.15JUNE2009.nc
$ wget https://data1.gfdl.noaa.gov/~nnz/mom4/COREv2/data_1948_2006/NormalYearForcing/CORRECTED/slp.15JUNE2009.nc
$ md5sum *.nc
71235d8dac21cc62836c35c0c068923c  ncar_precip.15JUNE2009.nc
0964b91c2b9f19295a23c2e00ab6ef0c  ncar_rad.15JUNE2009.nc
09b6de3fd2555aa212fdbe1f2059c138  q_10.15JUNE2009.nc
95232a02719417ca08c808eba1de26c2  slp.15JUNE2009.nc
7e6fef9eb022b5f51e6e85cc78848db2  t_10.15JUNE2009.nc
8b5b0c55c0a9e455be6fb8ee8d11c78a  u_10.15JUNE2009.nc
6f4c414b7d7259bfe599b25b3b8089c0  v_10.15JUNE2009.nc

 

[cspencerjones]

Thanks for looking into this and I hope that migrating to a more modern option is possible in the near future! I'll persist and let you know if I have problems.

 

[cspencerjones]

I just wanted to flag that this is still an issue for me. Today I have tried to download "reanalysis.tgz" about 7 times and I always get the error "
The Finder can’t complete the operation because some data in “reanalysis.tgz” can’t be read or written.
(Error code -36)"
before it completes (though at different points in the download).
I know no-one really has time to fix this but it seemed worth mentioning.