Scheduled Downtime
On Tuesday 24 October 2023 @ 5pm MT the forums will be in read only mode in preparation for the downtime. On Wednesday 25 October 2023 @ 5am MT, this website will be down for maintenance and expected to return online later in the morning.
Normal Operations
The forums are back online with normal operations. If you notice any issues or errors related to the forums, please reach out to help@ucar.edu

Cloud sedimentation blowing up with first sea ice

mhuber

New Member
Howdy, I figure this forum is hopefully a reasonable place to ask for advice on a the following problem.

I'm doing an idealized fully coupled CCSM3 run that begins without sea ice and runs for about 30 years before sea ice develops. My configuration is T31_gx3v5, and my namelist parameters are pretty standard altough my cam/clm time step is turned down to 1200, and the ocean dt is 24...The simulation progresses very nicely for ~30 years until the first day when sea ice appears, then blamo!

It is dieing in pkg_cld_sediment (stderr file quoted below). Now I imagine this has something to do adding snow to ice for the first time and i probably just need to get through the first couple of days, but I'm beginning to run out of knobs to turn (that I know of) to help me through this.

Any comments are appreciated.

stderr quote

Code:
D3<L4>: Message type 21 from source 16
  16:    Offset 0x00000190 in procedure __abortutils_MOD_endrun
  16:  Traceback:
  16:    Offset 0x00000190 in procedure __abortutils_MOD_endrun
  16:  Traceback:
D3<L4>: Message type 21 from source 16
  16:    Offset 0x00000190 in procedure __abortutils_MOD_endrun, near line 38 in file , near line 38 in file /ptmp/mhuber/b.ww.02/atm/obj/abortutils.f90/ptmp/mhuber/b.ww.0
2/atm/obj/abortutils.f90
D3<L4>: Message type 21 from source 16
  16:
  16:, near line 38 in file , near line 38 in file /ptmp/mhuber/b.ww.02/atm/obj/abortutils.f90
  16:    Offset 0x000044d4 in procedure cfint2    Offset 0x000044d4 in procedure cfint2    Offset 0x000044d4 in procedure cfint2/ptmp/mhuber/b.ww.02/atm/obj/abortutils.f90
D3<L4>: Message type 21 from source 16
  16:    Offset 0x000044d4 in procedure cfint2, near line 497 in file /ptmp/mhuber/b.ww.02/atm/obj/pkg_cld_sediment.f90
D3<L4>: Message type 21 from source 16
  16:, near line 497 in file     Offset 0x000024e8 in procedure getflx/ptmp/mhuber/b.ww.02/atm/obj/pkg_cld_sediment.f90
  16:, near line 497 in file     Offset 0x000024e8 in procedure getflx/ptmp/mhuber/b.ww.02/atm/obj/pkg_cld_sediment.f90
  16:, near line 497 in file /ptmp/mhuber/b.ww.02/atm/obj/pkg_cld_sediment.f90
D3<L4>: Message type 21 from source 16
  16:    Offset 0x000024e8 in procedure getflx    Offset 0x000024e8 in procedure getflx, near line 420 in file /ptmp/mhuber/b.ww.02/atm/obj/pkg_cld_sediment.f90
D3<L4>: Message type 21 from source 16
  16:, near line 420 in file /ptmp/mhuber/b.ww.02/atm/obj/pkg_cld_sediment.f90
  16:, near line 420 in file /ptmp/mhuber/b.ww.02/atm/obj/pkg_cld_sediment.f90    Offset 0x00002c84 in procedure __pkg_cld_sediment_MOD_cld_sediment_tend    Offset 0x00002
c84 in procedure __pkg_cld_sediment_MOD_cld_sediment_tend
D3<L4>: Message type 21 from source 16
  16:, near line 420 in file /ptmp/mhuber/b.ww.02/atm/obj/pkg_cld_sediment.f90
D3<L4>: Message type 21 from source 16
  16:    Offset 0x00002c84 in procedure __pkg_cld_sediment_MOD_cld_sediment_tend    Offset 0x00002c84 in procedure __pkg_cld_sediment_MOD_cld_sediment_tend, near line 297 
in file /ptmp/mhuber/b.ww.02/atm/obj/pkg_cld_sediment.f90
D3<L4>: Message type 21 from source 16
  16:    Offset 0x000009d0 in procedure __cldcond_MOD_cldcond_sediment, near line 297 in file /ptmp/mhuber/b.ww.02/atm/obj/pkg_cld_sediment.f90
  16:, near line 297 in file /ptmp/mhuber/b.ww.02/atm/obj/pkg_cld_sediment.f90, near line 297 in file /ptmp/mhuber/b.ww.02/atm/obj/pkg_cld_sediment.f90
D3<L4>: Message type 21 from source 16
  16:    Offset 0x000009d0 in procedure __cldcond_MOD_cldcond_sediment    Offset 0x000009d0 in procedure __cldcond_MOD_cldcond_sediment
D3<L4>: Message type 21 from source 16
  16:    Offset 0x000009d0 in procedure __cldcond_MOD_cldcond_sediment, near line 95 in file /ptmp/mhuber/b.ww.02/atm/obj/cldcond.f90
D3<L4>: Message type 21 from source 16
  16:, near line 95 in file , near line 95 in file /ptmp/mhuber/b.ww.02/atm/obj/cldcond.f90, near line 95 in file /ptmp/mhuber/b.ww.02/atm/obj/cldcond.f90/ptmp/mhuber/b.ww
.02/atm/obj/cldcond.f90
  16:
  16:
D3<L4>: Message type 21 from source 16
  16:    Offset 0x00003fb4 in procedure tphysbc    Offset 0x00003fb4 in procedure tphysbc    Offset 0x00003fb4 in procedure tphysbc    Offset 0x00003fb4 in procedure tphys
bc, near line 506 in file , near line 506 in file /ptmp/mhuber/b.ww.02/atm/obj/tphysbc.f90
D3<L4>: Message type 21 from source 16
  16:, near line 506 in file     Offset 0x00000724 in procedure [email]physpkg@OL@2/ptmp/mhuber/b.ww[/email].02/atm/obj/tphysbc.f90
  16:, near line 506 in file /ptmp/mhuber/b.ww.02/atm/obj/tphysbc.f90    Offset 0x00000724 in procedure physpkg@OL@2
  16:    Offset 0x00000724 in procedure [email]physpkg@OL@2/ptmp/mhuber/b.ww[/email].02/atm/obj/tphysbc.f90
D3<L4>: Message type 21 from source 16
  16:    Offset 0x00000724 in procedure physpkg@OL@2
  16:


and here's some output from the ocn.log file

arwt rain h2o kg in dt = 0.00000000000000000E+00 0.00000000000000000E+00
arwt snow h2o kg in dt = 0.00000000000000000E+00 0.00000000000000000E+00
arwt evap h2o kg in dt = 0.00000000000000000E+00 0.00000000000000000E+00
arwt frzl h2o kg in dt = 0.00000000000000000E+00 0.00000000000000000E+00
arwt frsh h2o kg in dt = 0.00000000000000000E+00 0.00000000000000000E+00
arwt ice mass (kg) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt snw mass (kg) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt tot mass (kg) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt tot mass chng(kg) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt water flux = 0.00000000000000000E+00 0.00000000000000000E+00
(=rain+snow+evap+frzl-fresh)
water flux error = 0.00000000000000000E+00 0.00000000000000000E+00
----------------------------
arwt atm heat flux (W) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt ocn heat flux (W) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt frzl heat flux(W) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt tot energy (J) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt net heat (J) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt tot energy chng(J)= 0.00000000000000000E+00 0.00000000000000000E+00
arwt heat error = 0.00000000000000000E+00 0.00000000000000000E+00
----------------------------
arwt salt mass (kg) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt salt mass chng(kg)= 0.00000000000000000E+00 0.00000000000000000E+00
arwt salt flx in dt(kg)= 0.00000000000000000E+00 0.00000000000000000E+00
arwt salt flx error = 0.00000000000000000E+00 0.00000000000000000E+00
----------------------------

istep1: 205488 idate: 240617 sec: 0
Arctic Antarctic
max cH (m) = 0.00000000000000000 0.00000000000000000
total area (km^2) = 0.00000000000000000E+00 0.00000000000000000E+00
total ice volume (m^3) = 0.00000000000000000E+00 0.00000000000000000E+00
total snw volume (m^3) = 0.00000000000000000E+00 0.00000000000000000E+00
average albedo = 0.00000000000000000 0.00000000000000000
max u, v (m/s) = 0.00000000000000000 0.00000000000000000
----------------------------
arwt rain h2o kg in dt = 0.00000000000000000E+00 0.00000000000000000E+00
arwt snow h2o kg in dt = 0.00000000000000000E+00 0.00000000000000000E+00
arwt evap h2o kg in dt = 0.00000000000000000E+00 0.00000000000000000E+00
arwt frzl h2o kg in dt = 0.00000000000000000E+00 0.00000000000000000E+00
arwt frsh h2o kg in dt = 0.00000000000000000E+00 0.00000000000000000E+00
arwt ice mass (kg) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt snw mass (kg) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt tot mass (kg) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt tot mass chng(kg) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt water flux = 0.00000000000000000E+00 0.00000000000000000E+00
(=rain+snow+evap+frzl-fresh)
water flux error = 0.00000000000000000E+00 0.00000000000000000E+00
----------------------------
arwt atm heat flux (W) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt ocn heat flux (W) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt frzl heat flux(W) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt tot energy (J) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt net heat (J) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt tot energy chng(J)= 0.00000000000000000E+00 0.00000000000000000E+00
arwt heat error = 0.00000000000000000E+00 0.00000000000000000E+00
----------------------------
arwt salt mass (kg) = 0.00000000000000000E+00 0.00000000000000000E+00
arwt salt mass chng(kg)= 0.00000000000000000E+00 0.00000000000000000E+00
arwt salt flx in dt(kg)= 0.00000000000000000E+00 0.00000000000000000E+00
arwt salt flx error = 0.00000000000000000E+00 0.00000000000000000E+00
----------------------------

istep1: 205512 idate: 240618 sec: 0
Arctic Antarctic
max cH (m) = 0.00883778457489090 0.00000000000000000
total area (km^2) = 2.11156940605259251E+03 0.00000000000000000E+00
total ice volume (m^3) = 2.11156940605259240E+08 0.00000000000000000E+00
total snw volume (m^3) = 2.62462933972209085E-25 0.00000000000000000E+00
average albedo = 0.15762380993742564 0.00000000000000000
max u, v (m/s) = 0.05219158355130621 0.00000000000000000
----------------------------
arwt rain h2o kg in dt = 9.54735867663003206E+07 0.00000000000000000E+00
arwt snow h2o kg in dt = 8.67254961542748261E-23 0.00000000000000000E+00
arwt evap h2o kg in dt = 4.57828760542610544E+05 0.00000000000000000E+00
arwt frzl h2o kg in dt = 8.99911024058391762E+09 0.00000000000000000E+00
arwt frsh h2o kg in dt = 3.19523954741597891E+08 0.00000000000000000E+00
arwt ice mass (kg) = 1.93630914535022736E+11 0.00000000000000000E+00
arwt snw mass (kg) = 8.66127682108289982E-23 0.00000000000000000E+00
arwt tot mass (kg) = 1.93630914535022736E+11 0.00000000000000000E+00
arwt tot mass chng(kg) = 8.77551770136917114E+09 0.00000000000000000E+00
arwt water flux = 8.77551770136916351E+09 0.00000000000000000E+00
(=rain+snow+evap+frzl-fresh)
water flux error = -3.94017378347435400E-17 0.00000000000000000E+00
----------------------------
arwt atm heat flux (W) = 7.60855091209014435E+10 0.00000000000000000E+00
arwt ocn heat flux (W) = -4.16908152487495422E+09 0.00000000000000000E+00
arwt frzl heat flux(W) = 8.34167524245236938E+11 0.00000000000000000E+00
arwt tot energy (J) = -5.88760547395424640E+16 0.00000000000000000E+00
arwt net heat (J) = -2.71408656095805800E+15 0.00000000000000000E+00
arwt tot energy chng(J)= -2.71440967077826400E+15 0.00000000000000000E+00
arwt heat error = -5.48796657037198329E-06 0.00000000000000000E+00
----------------------------
arwt salt mass (kg) = 7.74523658140090942E+08 0.00000000000000000E+00
arwt salt mass chng(kg)= -8.94370156858985894E+05 0.00000000000000000E+00
arwt salt flx in dt(kg)= 8.94370156859019771E+05 0.00000000000000000E+00
arwt salt flx error = 4.37389591032629753E-17 0.00000000000000000E+00
 

pjr

Member
Hi Matt,

Did you get past this problem? If not, email me offline or call and
I will try to make some suggestions. This is not one of those things
I can do much about without more info.

Phil
 

mhuber

New Member
Hi phil,
Yeah, as became apparent through testing, the ocean was actually getting twitchy and was throwing out some bad points which the ice model was trying to deal with by growing ice, and for some reason these problems culminated in fatal errors in the previously mentioned cam routine. Not that that's a problem mind you--in this case ccsm should have been bombing since the ocean was becoming numerically unstable. So the fix was simple, and as pointed out by several helpful people, such as Bruce Briegleb, has been used in some of the higher co2 runs for future conditions. I decreased the ocean model time step, the ocean stopped throwing bad points, the sea ice went away, and cam stopped bombing. So the good news is that the simulation is doing ok, the bad news is that this run is really pushing the model to the limits of what it can handle, and my pop time step is getting very small and the model is slow, slow, slow....

thanks for everyone's help.
-Matthew Huber
Purdue University
http://web.ics.purdue.edu/~huberm
http://roskilde.eas.purdue.edu/~cdpl/phpwiki
http://www.purdue.edu/eas/people/faculty/huber.html
 
Top