Error gathering provenance information from manage_externals

[johanna_teresa]

Hi,

I have recently ported CESM2.2 to a new machine, and am having problems with the last step of ./case.build - see below for the error. If I rebuild with the --skip-provenance-check option it works, but as I want to run the ensemble consistency tests this doesn't seem to be a long-term option plus I am worried it's covering up a bigger problem.

When I ran ./manage_externals initially it didn't give me an error. I have tried removing a component (e.g. cam) and running ./manage_externals/checkout_externals cam. It then works, but once I repeat ./manage_externals/checkout_externals cam I get the same error as below. The HPC I am using only has subversion version 1.7.14 installed, do you think this is the main reason for my problems? I have previously ported CESM2.1 on another HPC which also only has subversion 1.7.14 and had no issues.

Any help with this would be appreciated!
Thanks,
Johanna


ERROR: Error gathering provenance information from manage_externals.

manage_externals error message:
ERROR:root:'ascii' codec can't decode byte 0xc3 in position 27: ordinal not in range(128)
ERROR:root:In directory
/home/malle/CESM2/my_cesm_sandbox/components/clm
DEV_ERROR: Invalid arguments trying to run subprocess:
git status

manage_externals output:
Processing externals description file : Externals.cfg
Processing externals description file : Externals_CLM.cfg
Processing externals description file : ../Externals_cime.cfg
Processing externals description file : Externals_POP.cfg
Processing externals description file : Externals_CISM.cfg
Processing externals description file : .gitmodules
Processing submodules description file : .gitmodules
Processing externals description file : Externals_CAM.cfg
Checking status of externals: clm,
ERROR: In directory
/home/malle/CESM2/my_cesm_sandbox/components/clm
DEV_ERROR: Invalid arguments trying to run subprocess:
git status

To solve this, either:

(1) Find and fix the problem: From /home/malle/CESM2/my_cesm_sandbox, try to get this command to work:
manage_externals/checkout_externals --status --verbose --no-logging

(2) If you don't need provenance information, rebuild with --skip-provenance-check

Error building..

 

[jedwards]

This seems to be a problem with git and clm not svn and cam.
Try
git clone https://github.com/ESCOMP/CTSM -b release-cesm2.2.01 components/clm

 

[johanna_teresa]

Thanks a lot for your reply! When I try:
git clone ESCOMP/CTSM -b release-cesm2.2.01 components/clm
I get an earlier error during the building phase related to FatesInterfaceMod.F90, maybe because the FATES sub-component wasn't checked out when directly cloning it from CTSM? I performed a CESM rather than a CTSM checkout. If I delete components/clm again and run
./manage_externals/checkout_externals clm
again I get the same initial error (DEV_ERROR: Invalid arguments trying to run subprocess: git status). The same error message also occurs when I just try to run ./describe_version. While it outputs git describe:cesm2.2.0-0-g332937b, same DEV_ERROR appears as well:

ERROR:root:'ascii' codec can't decode byte 0xc3 in position 27: ordinal not in range(128)
ERROR:root:In directory
/home/malle/CESM2/my_cesm_sandbox/components/clm
DEV_ERROR: Invalid arguments trying to run subprocess:
git status

Traceback (most recent call last):
File "./describe_version", line 71, in <module>
main()
File "./describe_version", line 67, in main
universal_newlines=True)
File "/usr/lib64/python2.7/subprocess.py", line 575, in check_output
raise CalledProcessError(retcode, cmd, output=output)
subprocess.CalledProcessError: Command '['manage_externals/checkout_externals', '--status', '--verbose', '--verbose']' returned non-zero exit status 1

Have you seen a similar problem before? I am running git version 1.8.3.1.

 

[jedwards]

I haven't seen this error before but I suspect that your git version is too old.
I think you need version 2.20 or newer.

 

[johanna_teresa]

I got it to work by using a newer git version and using python 3.7.6 instead of python 2.7.5. Thanks for your help!

 

[kaeritai]

This seems to be a problem with git and clm not svn and cam.
Try
git clone https://github.com/ESCOMP/CTSM -b release-cesm2.2.01 components/clm

Hi，does it matter if I just neglect this and build with ./case.build --skip-provenance-check ?

I mean if I build this way, will this have any influence on my simulating? Thanks!