test_bless_test_results error at running scripts_regression_test.py

[huazhen]

I am trying to run CESM2 on super computer. I use intel/2017.u2 compiler. I get an error when I run scripts_regression_tests.py Q_TestBlessTestResults. The output document guided me the following errors: Testing commit 3861ef9f890b0d169982014c0204faab091845c3Using cime_model = cesmTesting machine = spartanTest root: /data/cephfs/punim0769/scripts_regression_test.20190614_155051 test_bless_test_results (__main__.Q_TestBlessTestResults) ... FAILtest_rebless_namelist (__main__.Q_TestBlessTestResults) ... ok ======================================================================FAIL: test_bless_test_results (__main__.Q_TestBlessTestResults)----------------------------------------------------------------------Traceback (most recent call last):  File "scripts_regression_tests.py", line 1358, in test_bless_test_results    self._create_test(compargs)  File "scripts_regression_tests.py", line 954, in _create_test    self._wait_for_tests(test_id, expect_works=(not pre_run_errors and not run_errors))  File "scripts_regression_tests.py", line 963, in _wait_for_tests    from_dir=self._testroot, expected_stat=expected_stat)  File "scripts_regression_tests.py", line 67, in run_cmd_assert_result    test_obj.assertEqual(stat, expected_stat, msg=msg)AssertionError: 100 != 0 :COMMAND: /home/huazhenl/my_cesm_sandbox/cime/scripts/Tools/wait_for_tests  *20190614_161354/TestStatusFROM_DIR: /data/cephfs/punim0769/scripts_regression_test.20190614_155051SHOULD HAVE WORKED, INSTEAD GOT STAT 100OUTPUT: Test 'TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel' finished with status 'DIFF'    Path: TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel.C.20190614_161354/TestStatusERRPUT:  ----------------------------------------------------------------------Ran 2 tests in 3129.342s FAILED (failures=1)Detected failures, leaving directory: /data/cephfs/punim0769/scripts_regression_test.20190614_155051  The contents in path /data/cephfs/punim0769/scripts_regression_test.20190614_155051/TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel.C.20190614_161354/TestStatus is: PASS TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel CREATE_NEWCASEPASS TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel XMLPASS TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel SETUPPASS TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel SHAREDLIB_BUILD time=0PASS TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel NLCOMPPASS TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel MODEL_BUILD time=20PASS TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel SUBMITPASS TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel RUN time=17FAIL TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel BASELINE fake_testing_only_20190614_155156PASS TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel MEMLEAK insuffiencient data for memleak testPASS TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel SHORT_TERM_ARCHIVER I guess the problem maybe caused by the baseline setting in $HOME/.cime/config_machines.xml? I have no idea how to solve this problem.  I will attach my $HOME/.cime/config_compiler.xml , config_machines.xml and config_batch.xml. Any help is much appreciated. Thanks a lot.

 

[jedwards]

I can't tell here what the problem is.  One guess - does directory /home/huazhenl/my_cesm_sandbox/cesm_baselines exist? You can get more details on the failure in the TestStatus.log file

 

[huazhen]

Thanks for your reply. I found directory /home/huazhenl/my_cesm_sandbox/cesm_baselines not exist. So I make a directory manually. But it still can't run successfully and give me the same error messages. I also checked the contents in the TestStatus.log file, but I still have no idea how to solve the problem. Do I need to change the path of " /home/huazhenl/my_cesm_sandbox/cesm_baselines" in $HOME/.cime/config_machines.xml? I will attach TestStatus.log below.Do you have any suggestions. Thanks a lot.

 

[jedwards]

Did you build and install cprnc?  Check the contents of file /data/cephfs/punim0769/scripts_regression_test.20190614_155051/TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel.C.20190614_161354/run/TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel.C.20190614_161354.cpl.hi.0.nc.cprnc.out

 

[huazhen]

The contents of file /data/cephfs/punim0769/scripts_regression_test.20190614_155051/TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel.C.20190614_161354/run/TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel.C.20190614_161354.cpl.hi.0.nc.cprnc.out is: /bin/sh: /home/huazhenl/my_cesm_sandbox/cime/tools/cprnc/cprnc.F90: Permission denied So I changed the permission of cprnc.F90 using (chmod 755 cprnc.F90) manually. I got the following contents (/data/cephfs/punim0769/scripts_regression_test.20190619_104206/TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel.C.20190619_104512/run/TESTRUNDIFF_P1.f19_g16_rx1.A.spartan_intel.C.20190619_104512.cpl.hi.0.nc.cprnc.out): /home/huazhenl/my_cesm_sandbox/cime/tools/cprnc/cprnc.F90: line 1: program: command not found/home/huazhenl/my_cesm_sandbox/cime/tools/cprnc/cprnc.F90: line 2: use: command not found/home/huazhenl/my_cesm_sandbox/cime/tools/cprnc/cprnc.F90: line 3: use: command not found/home/huazhenl/my_cesm_sandbox/cime/tools/cprnc/cprnc.F90: line 4: use: command not found/home/huazhenl/my_cesm_sandbox/cime/tools/cprnc/cprnc.F90: line 6: use: command not found/home/huazhenl/my_cesm_sandbox/cime/tools/cprnc/cprnc.F90: line 8: implicit: command not found/home/huazhenl/my_cesm_sandbox/cime/tools/cprnc/cprnc.F90: line 10: integer: command not found/home/huazhenl/my_cesm_sandbox/cime/tools/cprnc/cprnc.F90: line 11: syntax error near unexpected token `len=1024'/home/huazhenl/my_cesm_sandbox/cime/tools/cprnc/cprnc.F90: line 11: `  character(len=1024) :: arg = ''                     ! cmd-line argument' Do I need to change the contents of /home/huazhenl/my_cesm_sandbox/cime/tools/cprnc/cprnc.F90 ? Thanks a lot for your help so far.

 

[jedwards]

cprnc.F90 is the source of a program you need to compile and install on your system.   See the README file in that directory for instructions on building it.

 

[huazhen]

Thanks a lot for your help. I will try to build cprnc later.