Issue downloading input data on ported CESM2

[James King]

Hi all,

I'm trying to run CESM2.1.3 on the shiny new UK HPC ARCHER2. I am running into what seems to be a common problem with downloading input data from remote UCAR/NCAR servers. Running ./case.submit results in the following:

Could not connect to repo 'ftp://ftp.cgd.ucar.edu/cesm/inputdata'
This is most likely either a proxy, or network issue .
Trying to download file: '../inputdata_checksum.dat' to path '/work/n02/n02/jking/cesm/CESM2.1.3/runs/F2000_test/run/inputdata_checksum.dat.raw' using NoneType protocol.
Traceback (most recent call last):
File "./case.submit", line 107, in <module>
_main_func(__doc__)
File "./case.submit", line 104, in _main_func
mail_user=mail_user, mail_type=mail_type, batch_args=batch_args)
File "/mnt/lustre/a2fs-work2/work/n02/n02/jking/cesm/CESM2.1.3/cesm_for_archer2/cime/scripts/Tools/../../scripts/lib/CIME/case/case_submit.py", line 157, in submit
custom_success_msg_functor=verbatim_success_msg)
File "/mnt/lustre/a2fs-work2/work/n02/n02/jking/cesm/CESM2.1.3/cesm_for_archer2/cime/scripts/Tools/../../scripts/lib/CIME/utils.py", line 1683, in run_and_log_case_status
rv = func()
File "/mnt/lustre/a2fs-work2/work/n02/n02/jking/cesm/CESM2.1.3/cesm_for_archer2/cime/scripts/Tools/../../scripts/lib/CIME/case/case_submit.py", line 155, in <lambda>
batch_args=batch_args)
File "/mnt/lustre/a2fs-work2/work/n02/n02/jking/cesm/CESM2.1.3/cesm_for_archer2/cime/scripts/Tools/../../scripts/lib/CIME/case/case_submit.py", line 85, in _submit
case.check_case()
File "/mnt/lustre/a2fs-work2/work/n02/n02/jking/cesm/CESM2.1.3/cesm_for_archer2/cime/scripts/Tools/../../scripts/lib/CIME/case/case_submit.py", line 171, in check_case
self.check_all_input_data()
File "/mnt/lustre/a2fs-work2/work/n02/n02/jking/cesm/CESM2.1.3/cesm_for_archer2/cime/scripts/Tools/../../scripts/lib/CIME/case/check_input_data.py", line 163, in check_all_input_data
_download_checksum_file(self.get_value("RUNDIR"))
File "/mnt/lustre/a2fs-work2/work/n02/n02/jking/cesm/CESM2.1.3/cesm_for_archer2/cime/scripts/Tools/../../scripts/lib/CIME/case/check_input_data.py", line 54, in _download_checksum_file
success = server.getfile(rel_path, new_file)
AttributeError: 'NoneType' object has no attribute 'getfile'

I have tried the various fixes suggested by other users on the forum, including fixing the ftp address and changing the order of preference of file transfer protocols in config_inputdata.xml, to no avail. It seems that, regardless of the transfer protocol, my system doesn't want to connect to the NCAR/UCAR system. Is there something I can do to fix this, or is it either a problem at the NCAR/UCAR end or at my (HPC) end?

Thanks,

James

 

[joneill]

We are seeing a recent address associated with the archer HPC being caught by our blocking service (2/24 at ~10:45am MT). I've removed the ip address from our block list, so if you wouldn't mind trying to access the data again, I can troubleshoot further if they continue to have issues.

It does look like the user in question wasn't using the proper login credentials (trying to log into the server as 'root'?), so try using the following to log in to the server:

Server: ftp.cgd.ucar.edu
Username: anonymous
Password: {my_email_address@my_institution}

Let me know if that does the trick!

Joseph O'Neill

 

[James King]

We are seeing a recent address associated with the archer HPC being caught by our blocking service (2/24 at ~10:45am MT). I've removed the ip address from our block list, so if you wouldn't mind trying to access the data again, I can troubleshoot further if they continue to have issues.

It does look like the user in question wasn't using the proper login credentials (trying to log into the server as 'root'?), so try using the following to log in to the server:

Server: ftp.cgd.ucar.edu
Username: anonymous
Password: {my_email_address@my_institution}

Let me know if that does the trick!

Joseph O'Neill

Hi Joseph,

Thanks, that seems to be working for both myself and ARCHER2 system admins.

Cheers,

James

 

[joneill]

Great! If you expect this to be a relatively common occurrence, we'd be happy to add your IP range to our allow list as well. I'd just need to know Archer's IP range and we can prevent similar issues from occurring in the future.

Joseph O'Neill

 

[James King]

Hi Joseph,

Thanks, that's great! I can send you these via email, let me know your address.

Best,

James