Job Started: Mon Dec 28 17:59:08 CST 2015 Job Id: 8811609 12/28/15 17:59:08 Welcome to Task Manager Version 2015. 12/28/15 17:59:08 Writing '.tm_config' $config{"tm_domain"} = "boomer"; $config{"tm_region"} = "casa2015_anal"; $config{"tm_root"} = "/home/kwthomas/rt2015"; $config{"tm_user"} = "/home/kwthomas/rt2015/user"; read_cfg: Reading /home/kwthomas/rt2015/config/boomer.cfg read_cfg: Reading /home/kwthomas/rt2015/user/config/casa2015_anal.cfg 12/28/15 17:59:08 Writing '.rt_config' $config{"acct"} = ""; $config{"allow_mpi"} = "1"; $config{"casa"} = "1"; $config{"is_boomer"} = "1"; $config{"mpi_cmd"} = "/home/kwthomas/rt2015/scripts/mpiwrapper -np"; $config{"msg"} = "BOOMER CASA Edition"; $config{"ncarg_root"} = "/home/ywang/tools/ncarg"; $config{"non_mpi_cmd"} = ""; $config{"plot_queue"} = "casa"; $config{"procs_per_node"} = "16"; $config{"procs_per_node_limit"} = "1"; $config{"queue"} = "casa"; $config{"radar_mpi_cmd"} = "mpirun.lsf -np"; $config{"shm_post"} = "1"; $config{"submit_cmd"} = "bsub < "; $config{"submit_plot"} = "0"; $config{"subvers"} = "openmpi"; $config{"vers"} = "casa2015_anal"; 12/28/15 17:59:08 BOOMER CASA Edition. 12/28/15 17:59:08 MODEL=arps3dvarplt 12/28/15 17:59:08 MODE=run 12/28/15 17:59:08 PREFIX=ar2015122823 12/28/15 17:59:08 DIR1=/work/arpsdata/arpscasa/adas-casa400_dfw/20151228/2350Z 12/28/15 17:59:08 DIR2=/work/arpsdata/arpscasa/adas-casa400_dfw/20151228/2350Z 12/28/15 17:59:08 CONFIG=casa2015_anal 12/28/15 17:59:08 SOFTWARE=casa2015_anal 12/28/15 17:59:08 VERSION=openmpi 12/28/15 17:59:08 MPI=enabled 12/28/15 17:59:08 REGION=adas-casa400_dfw 12/28/15 17:59:08 SOFTDIR=/home/kwthomas/rt2015/user/software/casa2015_anal/openmpi 12/28/15 17:59:08 SCRIPTSDIR=/home/kwthomas/rt2015/scripts 12/28/15 17:59:08 USER_HOME=/home/kwthomas/rt2015/user 12/28/15 17:59:08 MPI_CMD=/home/kwthomas/rt2015/scripts/mpiwrapper -np 12/28/15 17:59:08 'arps' version is 'arps5.3.6_20150513' 12/28/15 17:59:08 'arw' version is not defined 12/28/15 17:59:08 'coamps' version is not defined 12/28/15 17:59:08 DELETE_TASK: arps3dvar_retrieval_run (not retrieving) 12/28/15 17:59:08 DELETE_TASK: arps_retrieval_run (not retrieving) 12/28/15 17:59:08 DELETE_TASK: adas_retrieval_run (not retrieving) 12/28/15 17:59:08 DELETE_TASK: arpsenkf_retrieval_run (not retrieving) 12/28/15 17:59:08 DELETE_TASK: extm_lbc_retrieval_run (not retrieving) 12/28/15 17:59:08 DELETE_TASK: extm_t0_retrieval_run (not retrieving) 12/28/15 17:59:08 DELETE_TASK: arps_submit (non-remote task) 12/28/15 17:59:08 DELETE_TASK: wrf_submit (non-remote task) 12/28/15 17:59:08 DELETE_TASK: cycle_exit_enkf_run (no cycle exit) 12/28/15 17:59:08 DELETE_TASK: cycle_exit_wrf_run (no cycle exit) 12/28/15 17:59:08 DELETE_TASK: enkf_watch_run (not cycled run) 12/28/15 17:59:08 DELETE_TASK: plot_arpsenkf_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: arps2coamps_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: wrf_nmm_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: install_namelist_wrf_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: plot_coamps_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: arpsenkf_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: coamps_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: wrf_arw_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: adas_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: wrf_nmm_ferrier_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: nmm4wrf_lbc_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: real_nmm_ferrier_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: wrfdaupdate_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: real_clean_arw_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: arw4wrf_lbc_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: plot_wrf_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: plot_adas_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: real_clean_nmm_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: real_nmm_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: arw4wrf_t0_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: real_arw_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: coamps_pre_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: plot_arps_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: arps_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: install_namelist_real_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: nmm4wrf_t0_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: extm_lbc_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: nudge_outputs_run (arps3dvar only) 12/28/15 17:59:08 DELETE_TASK: ens_ana_run (no input file) 12/28/15 17:59:08 DELETE_TASK: arw_pre_run (no input file) 12/28/15 17:59:08 DELETE_TASK: enkf_anal_run (no input file) 12/28/15 17:59:08 DELETE_TASK: local_run (nonexistent script 'run_adas-casa400_dfw') 12/28/15 17:59:08 DELETE_TASK: arpsintrp_lbc_run (no input file) 12/28/15 17:59:08 DELETE_TASK: arpsensic_run (no input file) 12/28/15 17:59:08 DELETE_TASK: arpstrn_run (no input file) 12/28/15 17:59:08 DELETE_TASK: verif_run (no input file) 12/28/15 17:59:08 DELETE_TASK: arpssfc_run (no input file) 12/28/15 17:59:08 DELETE_TASK: arpsintrp_t0_run (no input file) 12/28/15 17:59:08 DELETE_TASK: enkf_radar_run (no input file) 12/28/15 17:59:08 DELETE_TASK: nmm_pre_run (no input file) 12/28/15 17:59:08 Will use '/home/kwthomas/rt2015/scripts/pre_task_boomer' for task 'pre_task' 12/28/15 17:59:08 TASK_CHAIN=pre_task_0_run find_extm_0_run extm_t0_0_run arpstintrp_0_run radar_0_run satellite_0_run arps3dvar_0_run plot_arps3dvar_0_run done 12/28/15 17:59:08 TASK=pre_task_0_run 12/28/15 17:59:08 TASK=find_extm_0_run 12/28/15 17:59:08 DEPENDS= pre_task_0_run 12/28/15 17:59:08 TASK=extm_t0_0_run 12/28/15 17:59:08 DEPENDS= find_extm_0_run pre_task_0_run 12/28/15 17:59:08 TASK=arpstintrp_0_run 12/28/15 17:59:08 DEPENDS= find_extm_0_run pre_task_0_run extm_t0_0_run 12/28/15 17:59:08 TASK=radar_0_run 12/28/15 17:59:08 DEPENDS= arpstintrp_0_run find_extm_0_run pre_task_0_run extm_t0_0_run 12/28/15 17:59:08 TASK=satellite_0_run 12/28/15 17:59:08 DEPENDS= arpstintrp_0_run find_extm_0_run radar_0_run pre_task_0_run extm_t0_0_run 12/28/15 17:59:08 TASK=arps3dvar_0_run 12/28/15 17:59:08 DEPENDS= arpstintrp_0_run find_extm_0_run radar_0_run pre_task_0_run extm_t0_0_run satellite_0_run 12/28/15 17:59:08 TASK=plot_arps3dvar_0_run 12/28/15 17:59:08 DEPENDS= arps3dvar_0_run arpstintrp_0_run radar_0_run extm_t0_0_run 12/28/15 17:59:08 TASK=done 12/28/15 17:59:08 DEPENDS= arps3dvar_0_run plot_arps3dvar_0_run extm_t0_0_run pre_task_0_run arpstintrp_0_run find_extm_0_run radar_0_run satellite_0_run 12/28/15 17:59:08 Task 'pre_task_0 run' starts. 12/28/15 17:59:08 /home/kwthomas/rt2015/scripts/pre_task_boomer 12/28/15 17:59:08 read_cfg: Reading .tm_config $config{"tm_domain"} = "boomer"; $config{"tm_region"} = "casa2015_anal"; $config{"tm_root"} = "/home/kwthomas/rt2015"; $config{"tm_user"} = "/home/kwthomas/rt2015/user"; 12/28/15 17:59:08 read_cfg: Reading .rt_config $config{"acct"} = ""; $config{"allow_mpi"} = "1"; $config{"casa"} = "1"; $config{"is_boomer"} = "1"; $config{"mpi_cmd"} = "/home/kwthomas/rt2015/scripts/mpiwrapper -np"; $config{"msg"} = "BOOMER CASA Edition"; $config{"ncarg_root"} = "/home/ywang/tools/ncarg"; $config{"non_mpi_cmd"} = ""; $config{"plot_queue"} = "casa"; $config{"procs_per_node"} = "16"; $config{"procs_per_node_limit"} = "1"; $config{"queue"} = "casa"; $config{"radar_mpi_cmd"} = "mpirun.lsf -np"; $config{"shm_post"} = "1"; $config{"submit_cmd"} = "bsub < "; $config{"submit_plot"} = "0"; $config{"subvers"} = "openmpi"; $config{"vers"} = "casa2015_anal"; 12/28/15 17:59:08 pre_task_boomer: Pretask_Boomer 12/28/15 17:59:08 pre_task_boomer: Command is '/home/kwthomas/rt2015/scripts/boomer_clean_dev_shm' 12/28/15 17:59:08 Welcome to 'boomer_clean_dev_shm' 12/28/15 17:59:08 Checking c129 12/28/15 17:59:08 Checking c122 12/28/15 17:59:08 Checking c118 12/28/15 17:59:08 Checking c364 12/28/15 17:59:08 Checking c142 12/28/15 17:59:08 Checking c131 12/28/15 17:59:08 Checking c125 12/28/15 17:59:08 Checking c115 12/28/15 17:59:08 Checking c126 12/28/15 17:59:08 Checking c127 12/28/15 17:59:08 Checking c124 12/28/15 17:59:08 Checking c149 12/28/15 17:59:09 'boomer_clean_dev_shm' is finished 12/28/15 17:59:09 pre_task_boomer: Command is '/home/kwthomas/rt2015/scripts/boomer_clean_radar_jobs' 12/28/15 17:59:09 Welcome to 'boomer_clean_radar_jobs' 12/28/15 17:59:09 Checking c129 12/28/15 17:59:09 Checking c122 12/28/15 17:59:09 Checking c118 12/28/15 17:59:09 Checking c364 12/28/15 17:59:09 Checking c142 12/28/15 17:59:09 Checking c131 12/28/15 17:59:09 Checking c125 12/28/15 17:59:09 Checking c115 12/28/15 17:59:09 Checking c126 12/28/15 17:59:09 Checking c127 12/28/15 17:59:09 Checking c124 12/28/15 17:59:09 Checking c149 12/28/15 17:59:09 'boomer_clean_radar_jobs' is finished 12/28/15 17:59:09 pre_task_0 run: Exit Status 0. 12/28/15 17:59:09 Task 'pre_task_0 run' finishes. Runtime 00:00:01. 12/28/15 17:59:09 Task 'find_extm_0 run' starts. 12/28/15 17:59:09 /home/kwthomas/rt2015/scripts/find_extm 12/28/15 17:59:09 External data already present. 12/28/15 17:59:10 find_extm_0 run: Exit Status 0. 12/28/15 17:59:10 Task 'find_extm_0 run' finishes. Runtime 00:00:01. 12/28/15 17:59:10 Task 'extm_t0_0 run' starts. 12/28/15 17:59:10 template: reading em2015122823-t0.extin 12/28/15 17:59:10 match for 'nproc_x' on line 211 - nproc_x=8, 12/28/15 17:59:10 match for 'nproc_y' on line 212 - nproc_y=24, 12/28/15 17:59:10 nproc_x/nproc_y=8/24 12/28/15 17:59:10 /home/kwthomas/rt2015/scripts/mpiwrapper -np 192 /home/kwthomas/rt2015/user/software/casa2015_anal/openmpi/arps/abin/ext2arps_mpi < em2015122823-t0.extin >> em2015122823-t0.extout 2>&1 12/28/15 17:59:41 extm_t0_0 run: Exit Status 0. 12/28/15 17:59:41 Task 'extm_t0_0 run' finishes. Runtime 00:00:31. 12/28/15 17:59:41 Task 'arpstintrp_0 run' starts. 12/28/15 17:59:41 template: reading ei2015122823-t0.tintrpin 12/28/15 17:59:41 match for 'nproc_x' on line 70 - nproc_x=8, 12/28/15 17:59:41 match for 'nproc_y' on line 71 - nproc_y=24, 12/28/15 17:59:41 match for 'nproc_x_in' on line 73 - nproc_x_in=8, 12/28/15 17:59:41 match for 'nproc_y_in' on line 74 - nproc_y_in=24, 12/28/15 17:59:41 nproc_x/nproc_y=8/24 12/28/15 17:59:41 /home/kwthomas/rt2015/scripts/mpiwrapper -np 192 /home/kwthomas/rt2015/user/software/casa2015_anal/openmpi/arps/abin/arpstintrp_mpi < ei2015122823-t0.tintrpin >> ei2015122823-t0.tintrpout 2>&1 12/28/15 18:00:03 arpstintrp_0 run: Exit Status 0. 12/28/15 18:00:03 Task 'arpstintrp_0 run' finishes. Runtime 00:00:22. 12/28/15 18:00:03 Task 'radar_0 run' starts. 12/28/15 18:00:03 /home/kwthomas/rt2015/scripts/run_radar 12/28/15 18:00:03 read_cfg: Reading .tm_config $config{"tm_domain"} = "boomer"; $config{"tm_region"} = "casa2015_anal"; $config{"tm_root"} = "/home/kwthomas/rt2015"; $config{"tm_user"} = "/home/kwthomas/rt2015/user"; 12/28/15 18:00:03 read_cfg: Reading .rt_config $config{"acct"} = ""; $config{"allow_mpi"} = "1"; $config{"casa"} = "1"; $config{"is_boomer"} = "1"; $config{"mpi_cmd"} = "/home/kwthomas/rt2015/scripts/mpiwrapper -np"; $config{"msg"} = "BOOMER CASA Edition"; $config{"ncarg_root"} = "/home/ywang/tools/ncarg"; $config{"non_mpi_cmd"} = ""; $config{"plot_queue"} = "casa"; $config{"procs_per_node"} = "16"; $config{"procs_per_node_limit"} = "1"; $config{"queue"} = "casa"; $config{"radar_mpi_cmd"} = "mpirun.lsf -np"; $config{"shm_post"} = "1"; $config{"submit_cmd"} = "bsub < "; $config{"submit_plot"} = "0"; $config{"subvers"} = "openmpi"; $config{"vers"} = "casa2015_anal"; 12/28/15 18:00:03 Welcome to 'run_radar' 12/28/15 18:00:03 12/28/15 18:00:03 run_radar: casa: No 'casa/*.casain' file. 12/28/15 18:00:03 run_radar: nexrad0: No 'nids/*.r88din' file. 12/28/15 18:00:03 template: reading nexrad/r882015122823.r88din 12/28/15 18:00:03 match for 'nproc_x' on line 88 - nproc_x=2, 12/28/15 18:00:03 match for 'nproc_y' on line 89 - nproc_y=8, 12/28/15 18:00:03 template: reading nids/nd2015122823.nidsin 12/28/15 18:00:03 match for 'nproc_x' on line 88 - nproc_x=2, 12/28/15 18:00:03 match for 'nproc_y' on line 89 - nproc_y=8, 12/28/15 18:00:03 template: reading tdwr/tdwr2015122823.tdwrin 12/28/15 18:00:03 match for 'nproc_x' on line 88 - nproc_x=2, 12/28/15 18:00:03 match for 'nproc_y' on line 89 - nproc_y=8, 12/28/15 18:00:03 template: reading em2015122823-t0.extin 12/28/15 18:00:03 match for 'nproc_x' on line 211 - nproc_x=8, 12/28/15 18:00:03 match for 'nproc_y' on line 212 - nproc_y=24, 12/28/15 18:00:03 match for 'nproc_x_out' on line 216 - nproc_x_out=1, 12/28/15 18:00:03 match for 'nproc_y_out' on line 217 - nproc_y_out=1, 12/28/15 18:00:03 match for 'dmp_out_joined' on line 2160 - dmp_out_joined=0, 12/28/15 18:00:03 template: reading ei2015122823-t0.tintrpin 12/28/15 18:00:03 match for 'nproc_x' on line 70 - nproc_x=8, 12/28/15 18:00:03 match for 'nproc_y' on line 71 - nproc_y=24, 12/28/15 18:00:03 match for 'nproc_x_out' on line 76 - nproc_x_out=8, 12/28/15 18:00:03 match for 'nproc_y_out' on line 77 - nproc_y_out=24, 12/28/15 18:00:03 Splitfiles detected. 12/28/15 18:00:03 Making directory 'radar' 12/28/15 18:00:04 Number of processors available is 192. 12/28/15 18:00:04 Number of processors per node is 1. 12/28/15 18:00:04 nslots=12 12/28/15 18:00:04 njobs=8 12/28/15 18:00:04 nprocs=16 12/28/15 18:00:04 12/28/15 18:00:04 max=1 12/28/15 18:00:04 cmd=radar1_0_radar 12/28/15 18:00:04 cmd=radar2_0_radar 12/28/15 18:00:04 cmd=radar3_0_radar 12/28/15 18:00:04 cmd=radar4_0_radar 12/28/15 18:00:04 cmd=radar5_0_radar 12/28/15 18:00:04 cmd=radar6_0_radar 12/28/15 18:00:04 cmd=radar7_0_radar 12/28/15 18:00:04 cmd=radar8_0_radar 12/28/15 18:00:04 cmd=radar9_0_radar 12/28/15 18:00:04 cmd=radar10_0_radar 12/28/15 18:00:04 cmd=radar11_0_radar 12/28/15 18:00:04 cmd=radar12_0_radar 12/28/15 18:00:52 BOOMER radar cleanup. 12/28/15 18:00:52 Welcome to 'boomer_clean_radar_jobs' 12/28/15 18:00:52 Checking c129 12/28/15 18:00:52 Checking c122 12/28/15 18:00:52 Checking c118 12/28/15 18:00:52 Checking c364 12/28/15 18:00:52 Checking c142 12/28/15 18:00:52 Checking c131 12/28/15 18:00:52 Checking c125 12/28/15 18:00:52 Checking c115 12/28/15 18:00:52 Checking c126 12/28/15 18:00:52 Checking c127 12/28/15 18:00:52 Checking c124 12/28/15 18:00:52 Checking c149 12/28/15 18:00:53 'boomer_clean_radar_jobs' is finished 12/28/15 18:00:53 Running /home/kwthomas/rt2015/scripts/casa_post for casa. 12/28/15 18:00:53 Running /home/kwthomas/rt2015/scripts/nexrad_post for nexrad. 12/28/15 18:00:53 Running /home/kwthomas/rt2015/scripts/radar_post for nids. 12/28/15 18:00:53 Running /home/kwthomas/rt2015/scripts/tdwr_post for tdwr. 12/28/15 18:00:53 NEXRAD/NIDS/CASA/TDWR processing is finished. 12/28/15 18:00:53 radar_0 run: Exit Status 0. 12/28/15 18:00:53 Task 'radar_0 run' finishes. Runtime 00:00:50. 12/28/15 18:00:53 Task 'satellite_0 run' starts. 12/28/15 18:00:53 /home/kwthomas/rt2015/scripts/run_satellite 12/28/15 18:00:53 read_cfg: Reading .tm_config $config{"tm_domain"} = "boomer"; $config{"tm_region"} = "casa2015_anal"; $config{"tm_root"} = "/home/kwthomas/rt2015"; $config{"tm_user"} = "/home/kwthomas/rt2015/user"; 12/28/15 18:00:53 read_cfg: Reading .rt_config $config{"acct"} = ""; $config{"allow_mpi"} = "1"; $config{"casa"} = "1"; $config{"is_boomer"} = "1"; $config{"mpi_cmd"} = "/home/kwthomas/rt2015/scripts/mpiwrapper -np"; $config{"msg"} = "BOOMER CASA Edition"; $config{"ncarg_root"} = "/home/ywang/tools/ncarg"; $config{"non_mpi_cmd"} = ""; $config{"plot_queue"} = "casa"; $config{"procs_per_node"} = "16"; $config{"procs_per_node_limit"} = "1"; $config{"queue"} = "casa"; $config{"radar_mpi_cmd"} = "mpirun.lsf -np"; $config{"shm_post"} = "1"; $config{"submit_cmd"} = "bsub < "; $config{"submit_plot"} = "0"; $config{"subvers"} = "openmpi"; $config{"vers"} = "casa2015_anal"; 12/28/15 18:00:53 /home/kwthomas/rt2015/user/software/casa2015_anal/openmpi/arps/abin/mci2arps goes13vis_20151228_2315 -hdf 1 < ar2015122823.vis_goes13_20151228_2315.satin > ar2015122823.vis_goes13_20151228_2315.satout 12/28/15 18:00:54 mv ar2015122823_goes13.satalb.hdf ar2015122823_goes13_20151228_2315.satalb.hdf 12/28/15 18:00:54 mv ar2015122823_goes13.satalb.hdf4 ar2015122823_goes13_20151228_2315.satalb.hdf4 12/28/15 18:00:54 /home/kwthomas/rt2015/user/software/casa2015_anal/openmpi/arps/abin/mci2arps goes15vis_20151228_2330 -hdf 1 < ar2015122823.vis_goes15_20151228_2330.satin > ar2015122823.vis_goes15_20151228_2330.satout 12/28/15 18:00:55 mv ar2015122823_goes15.satalb.hdf ar2015122823_goes15_20151228_2330.satalb.hdf 12/28/15 18:00:55 mv ar2015122823_goes15.satalb.hdf4 ar2015122823_goes15_20151228_2330.satalb.hdf4 12/28/15 18:00:55 satellite_0 run: Exit Status 0. 12/28/15 18:00:55 Task 'satellite_0 run' finishes. Runtime 00:00:02. 12/28/15 18:00:55 Task 'arps3dvar_0 run' starts. 12/28/15 18:00:55 template: reading ad2015122823.3dvarin 12/28/15 18:00:55 match for 'nproc_x' on line 211 - nproc_x=8, 12/28/15 18:00:55 match for 'nproc_y' on line 212 - nproc_y=24, 12/28/15 18:00:55 nproc_x/nproc_y=8/24 12/28/15 18:00:55 /home/kwthomas/rt2015/scripts/mpiwrapper -np 192 /home/kwthomas/rt2015/user/software/casa2015_anal/openmpi/arps/abin/arps3dvar_mpi < ad2015122823.3dvarin >> ad2015122823.3dvarout 2>&1 12/28/15 18:01:59 arps3dvar_0 run: Exit Status 0. 12/28/15 18:01:59 Task 'arps3dvar_0 run' finishes. Runtime 00:01:04. 12/28/15 18:01:59 Task 'plot_arps3dvar_0 run' starts. 12/28/15 18:01:59 /home/kwthomas/rt2015/scripts/run_post 12/28/15 18:02:00 read_cfg: Reading .tm_config $config{"tm_domain"} = "boomer"; $config{"tm_region"} = "casa2015_anal"; $config{"tm_root"} = "/home/kwthomas/rt2015"; $config{"tm_user"} = "/home/kwthomas/rt2015/user"; 12/28/15 18:02:00 read_cfg: Reading .rt_config $config{"acct"} = ""; $config{"allow_mpi"} = "1"; $config{"casa"} = "1"; $config{"is_boomer"} = "1"; $config{"mpi_cmd"} = "/home/kwthomas/rt2015/scripts/mpiwrapper -np"; $config{"msg"} = "BOOMER CASA Edition"; $config{"ncarg_root"} = "/home/ywang/tools/ncarg"; $config{"non_mpi_cmd"} = ""; $config{"plot_queue"} = "casa"; $config{"procs_per_node"} = "16"; $config{"procs_per_node_limit"} = "1"; $config{"queue"} = "casa"; $config{"radar_mpi_cmd"} = "mpirun.lsf -np"; $config{"shm_post"} = "1"; $config{"submit_cmd"} = "bsub < "; $config{"submit_plot"} = "0"; $config{"subvers"} = "openmpi"; $config{"vers"} = "casa2015_anal"; 12/28/15 18:02:00 run_post: t_offset=9999 t_end=0 12/28/15 18:02:00 run_post: is_wrf=0 is_coamps=0 soundings=1 12/28/15 18:02:00 run_post: file=ad2015122823.3dvarin 12/28/15 18:02:00 run_post: match for 'nproc_x' on line 211 - nproc_x=8, 12/28/15 18:02:00 run_post: match for 'nproc_y' on line 212 - nproc_y=24, 12/28/15 18:02:00 run_post: match for 'runname' on line 248 - runname='ad2015122823', 12/28/15 18:02:00 run_post: match for 'initime' on line 417 - initime='2015-12-28.23:50:00', 12/28/15 18:02:00 run_post: match for 'nudgopt' on line 533 - nudgopt=0, 12/28/15 18:02:00 run_post: match for 'ndstop' on line 535 - ndstop = 300.0, 12/28/15 18:02:00 run_post: match for 'dmp_out_joined' on line 2160 - dmp_out_joined=0, 12/28/15 18:02:00 run_post: match for 'hdmpfmt' on line 2161 - hdmpfmt=3, 12/28/15 18:02:00 run_post: match for 'dirname' on line 2344 - dirname='./adasdata/', 12/28/15 18:02:00 run_post: match for 'readyfl' on line 2346 - readyfl=2, 12/28/15 18:02:00 run_post: NUDGE=0 12/28/15 18:02:00 run_post: arps_subdirs=1 wrf_subdirs=0 12/28/15 18:02:00 run_post: Runname is ad2015122823 12/28/15 18:02:00 run_post: Data uses splitfiles. 12/28/15 18:02:00 run_post: match for 'nproc_x' on line 3794 - nproc_x=4, 12/28/15 18:02:00 run_post: match for 'nproc_y' on line 3794 - nproc_y=8, 12/28/15 18:02:00 run_post: Region is casa400_dfw 12/28/15 18:02:00 run_post: t_current now 0 t_end=0 12/28/15 18:02:00 run_post: p_string=000000 h_string=0000 t_string=000000 12/28/15 18:02:00 run_post: Checking plot/0000/arpsplt_0000.nqs 12/28/15 18:02:00 run_post: template: reading /home/kwthomas/rt2015/templates/boomer_pre 12/28/15 18:02:00 run_post: template: reading /home/kwthomas/rt2015/templates/graphics.nqs_template 12/28/15 18:02:00 run_post: Processing sfc.pltin 12/28/15 18:02:00 run_post: Processing sfcchar.pltin 12/28/15 18:02:00 run_post: Processing ua.pltin 12/28/15 18:02:00 run_post: Processing tmp.aein 12/28/15 18:02:00 run_post: Job Started: Mon Dec 28 18:02:00 CST 2015 Job Id: 8811609 Mon Dec 28 18:02:00 CST 2015 12/28/15 18:02:00 read_cfg: Reading ../../.tm_config $config{"tm_domain"} = "boomer"; $config{"tm_region"} = "casa2015_anal"; $config{"tm_root"} = "/home/kwthomas/rt2015"; $config{"tm_user"} = "/home/kwthomas/rt2015/user"; 12/28/15 18:02:00 read_cfg: Reading ../../.rt_config $config{"acct"} = ""; $config{"allow_mpi"} = "1"; $config{"casa"} = "1"; $config{"is_boomer"} = "1"; $config{"mpi_cmd"} = "/home/kwthomas/rt2015/scripts/mpiwrapper -np"; $config{"msg"} = "BOOMER CASA Edition"; $config{"ncarg_root"} = "/home/ywang/tools/ncarg"; $config{"non_mpi_cmd"} = ""; $config{"plot_queue"} = "casa"; $config{"procs_per_node"} = "16"; $config{"procs_per_node_limit"} = "1"; $config{"queue"} = "casa"; $config{"radar_mpi_cmd"} = "mpirun.lsf -np"; $config{"shm_post"} = "1"; $config{"submit_cmd"} = "bsub < "; $config{"submit_plot"} = "0"; $config{"subvers"} = "openmpi"; $config{"vers"} = "casa2015_anal"; 12/28/15 18:02:00 match for 'nprocx_in' on line 83 - nprocx_in=8, 12/28/15 18:02:00 match for 'nprocy_in' on line 84 - nprocy_in=24, 12/28/15 18:02:00 match for 'hisfile\(1\)' on line 149 - hisfile(1)='../../adasdata/ad2015122823.hdf000000', pwd=/work/arpsdata/arpscasa/adas-casa400_dfw/20151228/2350Z/plot/0000 Command=/home/kwthomas/rt2015/user/software/casa2015_anal/openmpi/arps/abin/arps2wdssii ../../adasdata/ad2015122823.hdf000000 8 24 /dev/shm/anal_casa400 >& arps2wdssii_out Mon Dec 28 18:02:05 CST 2015 12/28/15 18:02:21 read_cfg: Reading ../../.tm_config $config{"tm_domain"} = "boomer"; $config{"tm_region"} = "casa2015_anal"; $config{"tm_root"} = "/home/kwthomas/rt2015"; $config{"tm_user"} = "/home/kwthomas/rt2015/user"; 12/28/15 18:02:21 read_cfg: Reading ../../.rt_config $config{"acct"} = ""; $config{"allow_mpi"} = "1"; $config{"casa"} = "1"; $config{"is_boomer"} = "1"; $config{"mpi_cmd"} = "/home/kwthomas/rt2015/scripts/mpiwrapper -np"; $config{"msg"} = "BOOMER CASA Edition"; $config{"ncarg_root"} = "/home/ywang/tools/ncarg"; $config{"non_mpi_cmd"} = ""; $config{"plot_queue"} = "casa"; $config{"procs_per_node"} = "16"; $config{"procs_per_node_limit"} = "1"; $config{"queue"} = "casa"; $config{"radar_mpi_cmd"} = "mpirun.lsf -np"; $config{"shm_post"} = "1"; $config{"submit_cmd"} = "bsub < "; $config{"submit_plot"} = "0"; $config{"subvers"} = "openmpi"; $config{"vers"} = "casa2015_anal"; 12/28/15 18:02:21 Welcome to 'run_arpsplt' 12/28/15 18:02:21 match for 'nproc_x' on line 0 - nproc_x=4, 12/28/15 18:02:21 match for 'nproc_y' on line 0 - nproc_y=8, nprocs=32 12/28/15 18:02:21 Number of processors available is 192. 12/28/15 18:02:21 Number of processors per node is 16. nnprocs=32 nslots=3 12/28/15 18:02:21 nslots=3 12/28/15 18:02:21 njobs=3 12/28/15 18:02:21 nprocs=32 12/28/15 18:02:21 12/28/15 18:02:21 max=1 12/28/15 18:02:21 cmd=arpsplt1_0_arpsplt 12/28/15 18:02:21 cmd=arpsplt2_0_arpsplt 12/28/15 18:02:21 cmd=arpsplt3_0_arpsplt 12/28/15 18:02:53 Arpsplt processing is finished. end Mon Dec 28 18:02:53 CST 2015 12/28/15 18:02:53 read_cfg: Reading ../../.tm_config $config{"tm_domain"} = "boomer"; $config{"tm_region"} = "casa2015_anal"; $config{"tm_root"} = "/home/kwthomas/rt2015"; $config{"tm_user"} = "/home/kwthomas/rt2015/user"; 12/28/15 18:02:53 read_cfg: Reading ../../.rt_config $config{"acct"} = ""; $config{"allow_mpi"} = "1"; $config{"casa"} = "1"; $config{"is_boomer"} = "1"; $config{"mpi_cmd"} = "/home/kwthomas/rt2015/scripts/mpiwrapper -np"; $config{"msg"} = "BOOMER CASA Edition"; $config{"ncarg_root"} = "/home/ywang/tools/ncarg"; $config{"non_mpi_cmd"} = ""; $config{"plot_queue"} = "casa"; $config{"procs_per_node"} = "16"; $config{"procs_per_node_limit"} = "1"; $config{"queue"} = "casa"; $config{"radar_mpi_cmd"} = "mpirun.lsf -np"; $config{"shm_post"} = "1"; $config{"submit_cmd"} = "bsub < "; $config{"submit_plot"} = "0"; $config{"subvers"} = "openmpi"; $config{"vers"} = "casa2015_anal"; 12/28/15 18:02:53 max=16 12/28/15 18:02:53 use_shm=1 12/28/15 18:02:53 Start 'med' Reading 'sfc.pltin' Reading 'ua.pltin' Reading 'sfcchar.pltin' 12/28/15 18:02:57 Start 'ctrans' 12/28/15 18:02:57 Start 'convert' cmd=/bin/rm -rf /dev/shm/* 12/28/15 18:03:02 arpsplt_post finished Job run time: 00:01 12/28/15 18:03:02 plot_arps3dvar_0 run: Exit Status 0. 12/28/15 18:03:02 Task 'plot_arps3dvar_0 run' finishes. Runtime 00:01:03. 12/28/15 18:03:02 Task Manager finishes. Runtime 00:03:54. Job run time: 00:03 ------------------------------------------------------------ Sender: LSF System Subject: Job 8811609: Done Job was submitted from host by user in cluster . Job was executed on host(s) <16*c129>, in queue , as user in cluster . <16*c122> <16*c118> <16*c364> <16*c142> <16*c131> <16*c125> <16*c115> <16*c126> <16*c127> <16*c124> <16*c149> was used as the home directory. was used as the working directory. Started at Mon Dec 28 17:58:30 2015 Results reported at Mon Dec 28 18:03:02 2015 Your job looked like: ------------------------------------------------------------ # LSBATCH: User input #!/bin/csh #BSUB -J casa4-122823-00 #BSUB -R "span[ptile=16]" #BSUB -W 00:10 #BSUB -a openmpi #BSUB -e ar2015122823.err #BSUB -n 192 #BSUB -o ar2015122823.run #BSUB -q casa #BSUB -x set time1=`perl -e "print time"` echo -n "Job Started: " date echo "Job Id: $LSB_JOBID" echo " " set echo chmod 644 *run *err cd /work/arpsdata/arpscasa/adas-casa400_dfw/20151228/2350Z /home/kwthomas/rt2015/tm/task_manager5 arps3dvarplt local ar2015122823 /work/arpsdata/arpscasa/adas-casa400_dfw/20151228/2350Z /work/arpsdata/arpscasa/adas-casa400_dfw/20151228/2350Z casa2015_anal unset echo set time2=`perl -e "print time"` @ diff = $time2 - $time1 @ hour = $diff / 3600 @ diff = $diff % 3600 @ min = $diff / 60 printf '\nJob run time: %02d:%02d\n' $hour $min ------------------------------------------------------------ Successfully completed. Resource usage summary: CPU time : 12760.62 sec. Max Memory : 5 MB Max Swap : 128 MB Max Processes : 5 Max Threads : 5 The output (if any) is above this job summary. PS: Read file for stderr output of this job.