How do I run my case in the economy queue on Derecho?
- Thread starter KeerZ
- Start date
I have the same problem!
Here is the response from the NCAR officer, but I am still not clear to solve this problem.
this tag of CESM does not seem to have logic in the CIME scripts to handle how priority is done on Derecho. Folks in the CESM User Forum can probably give more advice (including which tag to switch to for Derecho support), but for this particular problem you could edit your env_batch.xml to be something like this:
<submit_args>
<arg flag="-q" name="main"/>
<arg flag="-l job_priority=" name="$JOB_QUEUE"/>
<arg flag="-l walltime=" name="$JOB_WALLCLOCK_TIME"/>
<arg flag="-A" name="$PROJECT"/>
</submit_args>
Here is the response from the NCAR officer, but I am still not clear to solve this problem.
this tag of CESM does not seem to have logic in the CIME scripts to handle how priority is done on Derecho. Folks in the CESM User Forum can probably give more advice (including which tag to switch to for Derecho support), but for this particular problem you could edit your env_batch.xml to be something like this:
<submit_args>
<arg flag="-q" name="main"/>
<arg flag="-l job_priority=" name="$JOB_QUEUE"/>
<arg flag="-l walltime=" name="$JOB_WALLCLOCK_TIME"/>
<arg flag="-A" name="$PROJECT"/>
</submit_args>
I'm not expert on derecho ...yet :-) but there is no economy queue on derecho. From my notes (when I attended the intro to derecho talk) there are three routing queues:
- main (default)
- preempt (preemption queues use cycles at lower costs but jobs stop unexpectedly)
- develop
I recommend watching the intro to derecho talk on the NCAR CISL website.
- main (default)
- preempt (preemption queues use cycles at lower costs but jobs stop unexpectedly)
- develop
I recommend watching the intro to derecho talk on the NCAR CISL website.
Unfortunately documentation on the queues for Derecho aren't available yet from CISL. But, here is where it will appear as well as documentation that is currently available...
arc.ucar.edu
The little amount that I know is that you don't use queues to change the priority. But, there is way to change the priority of a job when
it's submitted (the -p option to qsub).
For CESM this is set by the JOB_PRIORITY XML variable which has the familiar: economy, regular, and premium settings.
This does need you to have one of the very latest versions of CESM.
Documentation | ARC NCAR
arc.ucar.edu
The little amount that I know is that you don't use queues to change the priority. But, there is way to change the priority of a job when
it's submitted (the -p option to qsub).
For CESM this is set by the JOB_PRIORITY XML variable which has the familiar: economy, regular, and premium settings.
This does need you to have one of the very latest versions of CESM.
for CESM 2.1.4 (this is the version for 2023 CESM tutorial), I tried to use ./xmlchange JOB_PRIORITY=economy, it does not work. So how can we change the priority to economy for this version?
I have added this line in cime/config/cesm/machines/config_batch.xml (see following), but it does not work.
<machine MACH="derecho">
<DESC>NCAR AMD EPYC </DESC>
<NODENAME_REGEX>de.*.hpc.ucar.edu</NODENAME_REGEX>
<OS>CNL</OS>
<COMPILERS>intel</COMPILERS>
<arg flag="-l job_priority=" name="economy"/>
<!-- <COMPILERS>intel,gnu,cray,nvhpc,intel-oneapi,intel-classic</COMPILERS> -->
<MPILIBS>mpich</MPILIBS>
<CIME_OUTPUT_ROOT>$ENV{SCRATCH}</CIME_OUTPUT_ROOT>
………………………………………………………
Hi Dr. Edwards,
I see in my timing files almost identical costs between the same job I submitted in the regular and economy queues. Am I not to expect a reduction in cost from using the economy queue?
Thanks.
I see the adjustment now on SAM. Thank you