Job Started: Tue Nov 3 03:49:06 CST 2015 Job Id: 8598140 11/03/15 03:49:06 Welcome to Task Manager Version 2015. 11/03/15 03:49:06 Writing '.tm_config' $config{"tm_domain"} = "boomer"; $config{"tm_region"} = "casa2015_anal"; $config{"tm_root"} = "/home/kwthomas/rt2015"; $config{"tm_user"} = "/home/kwthomas/rt2015/user"; read_cfg: Reading /home/kwthomas/rt2015/config/boomer.cfg read_cfg: Reading /home/kwthomas/rt2015/user/config/casa2015_anal.cfg 11/03/15 03:49:06 Writing '.rt_config' $config{"acct"} = ""; $config{"allow_mpi"} = "1"; $config{"casa"} = "1"; $config{"is_boomer"} = "1"; $config{"mpi_cmd"} = "/home/kwthomas/rt2015/scripts/mpiwrapper -np"; $config{"msg"} = "BOOMER CASA Edition"; $config{"ncarg_root"} = "/home/ywang/tools/ncarg"; $config{"non_mpi_cmd"} = ""; $config{"plot_queue"} = "casa"; $config{"procs_per_node"} = "16"; $config{"procs_per_node_limit"} = "1"; $config{"queue"} = "casa"; $config{"radar_mpi_cmd"} = "mpirun.lsf -np"; $config{"shm_post"} = "1"; $config{"submit_cmd"} = "bsub < "; $config{"submit_plot"} = "0"; $config{"subvers"} = "openmpi"; $config{"vers"} = "casa2015_anal"; 11/03/15 03:49:06 BOOMER CASA Edition. 11/03/15 03:49:06 MODEL=arps3dvarplt 11/03/15 03:49:06 MODE=run 11/03/15 03:49:06 PREFIX=ar2015110309 11/03/15 03:49:06 DIR1=/work/arpsdata/arpscasa/adas-casa400_dfw/20151103/0940Z 11/03/15 03:49:06 DIR2=/work/arpsdata/arpscasa/adas-casa400_dfw/20151103/0940Z 11/03/15 03:49:06 CONFIG=casa2015_anal 11/03/15 03:49:06 SOFTWARE=casa2015_anal 11/03/15 03:49:06 VERSION=openmpi 11/03/15 03:49:06 MPI=enabled 11/03/15 03:49:06 REGION=adas-casa400_dfw 11/03/15 03:49:06 SOFTDIR=/home/kwthomas/rt2015/user/software/casa2015_anal/openmpi 11/03/15 03:49:06 SCRIPTSDIR=/home/kwthomas/rt2015/scripts 11/03/15 03:49:06 USER_HOME=/home/kwthomas/rt2015/user 11/03/15 03:49:06 MPI_CMD=/home/kwthomas/rt2015/scripts/mpiwrapper -np 11/03/15 03:49:06 'arps' version is 'arps5.3.6_20150513' 11/03/15 03:49:06 'arw' version is not defined 11/03/15 03:49:06 'coamps' version is not defined 11/03/15 03:49:06 DELETE_TASK: arps3dvar_retrieval_run (not retrieving) 11/03/15 03:49:06 DELETE_TASK: arps_retrieval_run (not retrieving) 11/03/15 03:49:06 DELETE_TASK: adas_retrieval_run (not retrieving) 11/03/15 03:49:06 DELETE_TASK: arpsenkf_retrieval_run (not retrieving) 11/03/15 03:49:06 DELETE_TASK: extm_lbc_retrieval_run (not retrieving) 11/03/15 03:49:06 DELETE_TASK: extm_t0_retrieval_run (not retrieving) 11/03/15 03:49:06 DELETE_TASK: arps_submit (non-remote task) 11/03/15 03:49:06 DELETE_TASK: wrf_submit (non-remote task) 11/03/15 03:49:06 DELETE_TASK: cycle_exit_enkf_run (no cycle exit) 11/03/15 03:49:06 DELETE_TASK: cycle_exit_wrf_run (no cycle exit) 11/03/15 03:49:06 DELETE_TASK: enkf_watch_run (not cycled run) 11/03/15 03:49:06 DELETE_TASK: plot_arpsenkf_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: arps2coamps_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: wrf_nmm_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: install_namelist_wrf_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: plot_coamps_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: arpsenkf_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: coamps_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: wrf_arw_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: adas_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: wrf_nmm_ferrier_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: nmm4wrf_lbc_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: real_nmm_ferrier_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: wrfdaupdate_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: real_clean_arw_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: arw4wrf_lbc_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: plot_wrf_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: plot_adas_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: real_clean_nmm_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: real_nmm_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: arw4wrf_t0_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: real_arw_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: coamps_pre_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: plot_arps_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: arps_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: install_namelist_real_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: nmm4wrf_t0_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: extm_lbc_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: nudge_outputs_run (arps3dvar only) 11/03/15 03:49:06 DELETE_TASK: ens_ana_run (no input file) 11/03/15 03:49:06 DELETE_TASK: arw_pre_run (no input file) 11/03/15 03:49:06 DELETE_TASK: enkf_anal_run (no input file) 11/03/15 03:49:06 DELETE_TASK: local_run (nonexistent script 'run_adas-casa400_dfw') 11/03/15 03:49:06 DELETE_TASK: arpsintrp_lbc_run (no input file) 11/03/15 03:49:06 DELETE_TASK: arpsensic_run (no input file) 11/03/15 03:49:06 DELETE_TASK: arpstrn_run (no input file) 11/03/15 03:49:06 DELETE_TASK: verif_run (no input file) 11/03/15 03:49:06 DELETE_TASK: arpssfc_run (no input file) 11/03/15 03:49:06 DELETE_TASK: arpsintrp_t0_run (no input file) 11/03/15 03:49:06 DELETE_TASK: enkf_radar_run (no input file) 11/03/15 03:49:06 DELETE_TASK: nmm_pre_run (no input file) 11/03/15 03:49:06 Will use '/home/kwthomas/rt2015/scripts/pre_task_boomer' for task 'pre_task' 11/03/15 03:49:06 TASK_CHAIN=pre_task_0_run find_extm_0_run extm_t0_0_run arpstintrp_0_run radar_0_run satellite_0_run arps3dvar_0_run plot_arps3dvar_0_run done 11/03/15 03:49:06 TASK=pre_task_0_run 11/03/15 03:49:06 TASK=find_extm_0_run 11/03/15 03:49:06 DEPENDS= pre_task_0_run 11/03/15 03:49:06 TASK=extm_t0_0_run 11/03/15 03:49:06 DEPENDS= find_extm_0_run pre_task_0_run 11/03/15 03:49:06 TASK=arpstintrp_0_run 11/03/15 03:49:06 DEPENDS= find_extm_0_run pre_task_0_run extm_t0_0_run 11/03/15 03:49:06 TASK=radar_0_run 11/03/15 03:49:06 DEPENDS= arpstintrp_0_run find_extm_0_run pre_task_0_run extm_t0_0_run 11/03/15 03:49:06 TASK=satellite_0_run 11/03/15 03:49:06 DEPENDS= arpstintrp_0_run find_extm_0_run radar_0_run pre_task_0_run extm_t0_0_run 11/03/15 03:49:06 TASK=arps3dvar_0_run 11/03/15 03:49:06 DEPENDS= arpstintrp_0_run find_extm_0_run radar_0_run pre_task_0_run extm_t0_0_run satellite_0_run 11/03/15 03:49:06 TASK=plot_arps3dvar_0_run 11/03/15 03:49:06 DEPENDS= arps3dvar_0_run arpstintrp_0_run radar_0_run extm_t0_0_run 11/03/15 03:49:06 TASK=done 11/03/15 03:49:06 DEPENDS= arps3dvar_0_run plot_arps3dvar_0_run extm_t0_0_run pre_task_0_run arpstintrp_0_run find_extm_0_run radar_0_run satellite_0_run 11/03/15 03:49:06 Task 'pre_task_0 run' starts. 11/03/15 03:49:06 /home/kwthomas/rt2015/scripts/pre_task_boomer 11/03/15 03:49:06 read_cfg: Reading .tm_config $config{"tm_domain"} = "boomer"; $config{"tm_region"} = "casa2015_anal"; $config{"tm_root"} = "/home/kwthomas/rt2015"; $config{"tm_user"} = "/home/kwthomas/rt2015/user"; 11/03/15 03:49:06 read_cfg: Reading .rt_config $config{"acct"} = ""; $config{"allow_mpi"} = "1"; $config{"casa"} = "1"; $config{"is_boomer"} = "1"; $config{"mpi_cmd"} = "/home/kwthomas/rt2015/scripts/mpiwrapper -np"; $config{"msg"} = "BOOMER CASA Edition"; $config{"ncarg_root"} = "/home/ywang/tools/ncarg"; $config{"non_mpi_cmd"} = ""; $config{"plot_queue"} = "casa"; $config{"procs_per_node"} = "16"; $config{"procs_per_node_limit"} = "1"; $config{"queue"} = "casa"; $config{"radar_mpi_cmd"} = "mpirun.lsf -np"; $config{"shm_post"} = "1"; $config{"submit_cmd"} = "bsub < "; $config{"submit_plot"} = "0"; $config{"subvers"} = "openmpi"; $config{"vers"} = "casa2015_anal"; 11/03/15 03:49:06 pre_task_boomer: Pretask_Boomer 11/03/15 03:49:06 pre_task_boomer: Command is '/home/kwthomas/rt2015/scripts/boomer_clean_dev_shm' 11/03/15 03:49:06 Welcome to 'boomer_clean_dev_shm' 11/03/15 03:49:06 Checking c143 11/03/15 03:49:06 Checking c129 11/03/15 03:49:06 Checking c126 11/03/15 03:49:06 Checking c141 11/03/15 03:49:06 Checking c123 11/03/15 03:49:06 Checking c114 11/03/15 03:49:06 Checking c132 11/03/15 03:49:06 Checking c154 11/03/15 03:49:06 Checking c152 11/03/15 03:49:06 Checking c128 11/03/15 03:49:06 Checking c149 11/03/15 03:49:06 Checking c124 11/03/15 03:49:06 'boomer_clean_dev_shm' is finished 11/03/15 03:49:06 pre_task_boomer: Command is '/home/kwthomas/rt2015/scripts/boomer_clean_radar_jobs' 11/03/15 03:49:06 Welcome to 'boomer_clean_radar_jobs' 11/03/15 03:49:06 Checking c143 11/03/15 03:49:06 Checking c129 11/03/15 03:49:06 Checking c126 11/03/15 03:49:06 Checking c141 11/03/15 03:49:06 Checking c123 11/03/15 03:49:06 Checking c114 11/03/15 03:49:06 Checking c132 11/03/15 03:49:06 Checking c154 11/03/15 03:49:06 Checking c152 11/03/15 03:49:06 Checking c128 11/03/15 03:49:06 Checking c149 11/03/15 03:49:06 Checking c124 11/03/15 03:49:06 'boomer_clean_radar_jobs' is finished 11/03/15 03:49:07 pre_task_0 run: Exit Status 0. 11/03/15 03:49:07 Task 'pre_task_0 run' finishes. Runtime 00:00:01. 11/03/15 03:49:07 Task 'find_extm_0 run' starts. 11/03/15 03:49:07 /home/kwthomas/rt2015/scripts/find_extm 11/03/15 03:49:07 External data already present. 11/03/15 03:49:08 find_extm_0 run: Exit Status 0. 11/03/15 03:49:08 Task 'find_extm_0 run' finishes. Runtime 00:00:01. 11/03/15 03:49:08 Task 'extm_t0_0 run' starts. 11/03/15 03:49:08 template: reading em2015110309-t0.extin 11/03/15 03:49:08 match for 'nproc_x' on line 211 - nproc_x=8, 11/03/15 03:49:08 match for 'nproc_y' on line 212 - nproc_y=24, 11/03/15 03:49:08 nproc_x/nproc_y=8/24 11/03/15 03:49:08 /home/kwthomas/rt2015/scripts/mpiwrapper -np 192 /home/kwthomas/rt2015/user/software/casa2015_anal/openmpi/arps/abin/ext2arps_mpi < em2015110309-t0.extin >> em2015110309-t0.extout 2>&1 11/03/15 03:49:38 extm_t0_0 run: Exit Status 0. 11/03/15 03:49:38 Task 'extm_t0_0 run' finishes. Runtime 00:00:30. 11/03/15 03:49:38 Task 'arpstintrp_0 run' starts. 11/03/15 03:49:38 template: reading ei2015110309-t0.tintrpin 11/03/15 03:49:38 match for 'nproc_x' on line 70 - nproc_x=8, 11/03/15 03:49:38 match for 'nproc_y' on line 71 - nproc_y=24, 11/03/15 03:49:38 match for 'nproc_x_in' on line 73 - nproc_x_in=8, 11/03/15 03:49:38 match for 'nproc_y_in' on line 74 - nproc_y_in=24, 11/03/15 03:49:38 nproc_x/nproc_y=8/24 11/03/15 03:49:38 /home/kwthomas/rt2015/scripts/mpiwrapper -np 192 /home/kwthomas/rt2015/user/software/casa2015_anal/openmpi/arps/abin/arpstintrp_mpi < ei2015110309-t0.tintrpin >> ei2015110309-t0.tintrpout 2>&1 11/03/15 03:50:02 arpstintrp_0 run: Exit Status 0. 11/03/15 03:50:02 Task 'arpstintrp_0 run' finishes. Runtime 00:00:24. 11/03/15 03:50:02 Task 'radar_0 run' starts. 11/03/15 03:50:02 /home/kwthomas/rt2015/scripts/run_radar 11/03/15 03:50:02 read_cfg: Reading .tm_config $config{"tm_domain"} = "boomer"; $config{"tm_region"} = "casa2015_anal"; $config{"tm_root"} = "/home/kwthomas/rt2015"; $config{"tm_user"} = "/home/kwthomas/rt2015/user"; 11/03/15 03:50:02 read_cfg: Reading .rt_config $config{"acct"} = ""; $config{"allow_mpi"} = "1"; $config{"casa"} = "1"; $config{"is_boomer"} = "1"; $config{"mpi_cmd"} = "/home/kwthomas/rt2015/scripts/mpiwrapper -np"; $config{"msg"} = "BOOMER CASA Edition"; $config{"ncarg_root"} = "/home/ywang/tools/ncarg"; $config{"non_mpi_cmd"} = ""; $config{"plot_queue"} = "casa"; $config{"procs_per_node"} = "16"; $config{"procs_per_node_limit"} = "1"; $config{"queue"} = "casa"; $config{"radar_mpi_cmd"} = "mpirun.lsf -np"; $config{"shm_post"} = "1"; $config{"submit_cmd"} = "bsub < "; $config{"submit_plot"} = "0"; $config{"subvers"} = "openmpi"; $config{"vers"} = "casa2015_anal"; 11/03/15 03:50:02 Welcome to 'run_radar' 11/03/15 03:50:02 11/03/15 03:50:02 run_radar: casa: No 'casa/*.casain' file. 11/03/15 03:50:02 run_radar: nexrad0: No 'nids/*.r88din' file. 11/03/15 03:50:02 template: reading nexrad/r882015110309.r88din 11/03/15 03:50:02 match for 'nproc_x' on line 88 - nproc_x=2, 11/03/15 03:50:02 match for 'nproc_y' on line 89 - nproc_y=8, 11/03/15 03:50:02 template: reading nids/nd2015110309.nidsin 11/03/15 03:50:02 match for 'nproc_x' on line 88 - nproc_x=2, 11/03/15 03:50:02 match for 'nproc_y' on line 89 - nproc_y=8, 11/03/15 03:50:02 template: reading tdwr/tdwr2015110309.tdwrin 11/03/15 03:50:02 match for 'nproc_x' on line 88 - nproc_x=2, 11/03/15 03:50:02 match for 'nproc_y' on line 89 - nproc_y=8, 11/03/15 03:50:02 template: reading em2015110309-t0.extin 11/03/15 03:50:02 match for 'nproc_x' on line 211 - nproc_x=8, 11/03/15 03:50:02 match for 'nproc_y' on line 212 - nproc_y=24, 11/03/15 03:50:02 match for 'nproc_x_out' on line 216 - nproc_x_out=1, 11/03/15 03:50:02 match for 'nproc_y_out' on line 217 - nproc_y_out=1, 11/03/15 03:50:02 match for 'dmp_out_joined' on line 2160 - dmp_out_joined=0, 11/03/15 03:50:02 template: reading ei2015110309-t0.tintrpin 11/03/15 03:50:02 match for 'nproc_x' on line 70 - nproc_x=8, 11/03/15 03:50:02 match for 'nproc_y' on line 71 - nproc_y=24, 11/03/15 03:50:02 match for 'nproc_x_out' on line 76 - nproc_x_out=8, 11/03/15 03:50:02 match for 'nproc_y_out' on line 77 - nproc_y_out=24, 11/03/15 03:50:02 Splitfiles detected. 11/03/15 03:50:02 Making directory 'radar' 11/03/15 03:50:02 Number of processors available is 192. 11/03/15 03:50:02 Number of processors per node is 1. 11/03/15 03:50:02 nslots=12 11/03/15 03:50:02 njobs=6 11/03/15 03:50:02 nprocs=16 11/03/15 03:50:02 11/03/15 03:50:02 max=1 11/03/15 03:50:02 cmd=radar1_0_radar 11/03/15 03:50:02 cmd=radar2_0_radar 11/03/15 03:50:02 cmd=radar3_0_radar 11/03/15 03:50:02 cmd=radar4_0_radar 11/03/15 03:50:02 cmd=radar5_0_radar 11/03/15 03:50:02 cmd=radar6_0_radar 11/03/15 03:50:02 cmd=radar7_0_radar 11/03/15 03:50:02 cmd=radar8_0_radar 11/03/15 03:50:02 cmd=radar9_0_radar 11/03/15 03:50:02 cmd=radar10_0_radar 11/03/15 03:50:02 cmd=radar11_0_radar 11/03/15 03:50:02 cmd=radar12_0_radar 11/03/15 03:50:36 BOOMER radar cleanup. 11/03/15 03:50:36 Welcome to 'boomer_clean_radar_jobs' 11/03/15 03:50:36 Checking c143 11/03/15 03:50:36 Checking c129 11/03/15 03:50:36 Checking c126 11/03/15 03:50:36 Checking c141 11/03/15 03:50:36 Checking c123 11/03/15 03:50:36 Checking c114 11/03/15 03:50:36 Checking c132 11/03/15 03:50:36 Checking c154 11/03/15 03:50:36 Checking c152 11/03/15 03:50:36 Checking c128 11/03/15 03:50:36 Checking c149 11/03/15 03:50:36 Checking c124 11/03/15 03:50:40 'boomer_clean_radar_jobs' is finished 11/03/15 03:50:40 Running /home/kwthomas/rt2015/scripts/casa_post for casa. 11/03/15 03:50:40 Running /home/kwthomas/rt2015/scripts/nexrad_post for nexrad. 11/03/15 03:50:41 Running /home/kwthomas/rt2015/scripts/radar_post for nids. 11/03/15 03:50:41 Running /home/kwthomas/rt2015/scripts/tdwr_post for tdwr. 11/03/15 03:50:41 NEXRAD/NIDS/CASA/TDWR processing is finished. 11/03/15 03:50:41 radar_0 run: Exit Status 0. 11/03/15 03:50:41 Task 'radar_0 run' finishes. Runtime 00:00:39. 11/03/15 03:50:41 Task 'satellite_0 run' starts. 11/03/15 03:50:41 /home/kwthomas/rt2015/scripts/run_satellite 11/03/15 03:50:41 read_cfg: Reading .tm_config $config{"tm_domain"} = "boomer"; $config{"tm_region"} = "casa2015_anal"; $config{"tm_root"} = "/home/kwthomas/rt2015"; $config{"tm_user"} = "/home/kwthomas/rt2015/user"; 11/03/15 03:50:41 read_cfg: Reading .rt_config $config{"acct"} = ""; $config{"allow_mpi"} = "1"; $config{"casa"} = "1"; $config{"is_boomer"} = "1"; $config{"mpi_cmd"} = "/home/kwthomas/rt2015/scripts/mpiwrapper -np"; $config{"msg"} = "BOOMER CASA Edition"; $config{"ncarg_root"} = "/home/ywang/tools/ncarg"; $config{"non_mpi_cmd"} = ""; $config{"plot_queue"} = "casa"; $config{"procs_per_node"} = "16"; $config{"procs_per_node_limit"} = "1"; $config{"queue"} = "casa"; $config{"radar_mpi_cmd"} = "mpirun.lsf -np"; $config{"shm_post"} = "1"; $config{"submit_cmd"} = "bsub < "; $config{"submit_plot"} = "0"; $config{"subvers"} = "openmpi"; $config{"vers"} = "casa2015_anal"; 11/03/15 03:50:41 /home/kwthomas/rt2015/user/software/casa2015_anal/openmpi/arps/abin/mci2arps goes13vis_20151103_0915 -hdf 1 < ar2015110309.vis_goes13_20151103_0915.satin > ar2015110309.vis_goes13_20151103_0915.satout 11/03/15 03:50:42 mv ar2015110309_goes13.satalb.hdf ar2015110309_goes13_20151103_0915.satalb.hdf 11/03/15 03:50:42 mv ar2015110309_goes13.satalb.hdf4 ar2015110309_goes13_20151103_0915.satalb.hdf4 11/03/15 03:50:42 satellite_0 run: Exit Status 0. 11/03/15 03:50:42 Task 'satellite_0 run' finishes. Runtime 00:00:01. 11/03/15 03:50:42 Task 'arps3dvar_0 run' starts. 11/03/15 03:50:42 template: reading ad2015110309.3dvarin 11/03/15 03:50:42 match for 'nproc_x' on line 211 - nproc_x=8, 11/03/15 03:50:42 match for 'nproc_y' on line 212 - nproc_y=24, 11/03/15 03:50:42 nproc_x/nproc_y=8/24 11/03/15 03:50:42 /home/kwthomas/rt2015/scripts/mpiwrapper -np 192 /home/kwthomas/rt2015/user/software/casa2015_anal/openmpi/arps/abin/arps3dvar_mpi < ad2015110309.3dvarin >> ad2015110309.3dvarout 2>&1 11/03/15 03:51:58 arps3dvar_0 run: Exit Status 0. 11/03/15 03:51:58 Task 'arps3dvar_0 run' finishes. Runtime 00:01:16. 11/03/15 03:51:58 Task 'plot_arps3dvar_0 run' starts. 11/03/15 03:51:58 /home/kwthomas/rt2015/scripts/run_post 11/03/15 03:51:58 read_cfg: Reading .tm_config $config{"tm_domain"} = "boomer"; $config{"tm_region"} = "casa2015_anal"; $config{"tm_root"} = "/home/kwthomas/rt2015"; $config{"tm_user"} = "/home/kwthomas/rt2015/user"; 11/03/15 03:51:58 read_cfg: Reading .rt_config $config{"acct"} = ""; $config{"allow_mpi"} = "1"; $config{"casa"} = "1"; $config{"is_boomer"} = "1"; $config{"mpi_cmd"} = "/home/kwthomas/rt2015/scripts/mpiwrapper -np"; $config{"msg"} = "BOOMER CASA Edition"; $config{"ncarg_root"} = "/home/ywang/tools/ncarg"; $config{"non_mpi_cmd"} = ""; $config{"plot_queue"} = "casa"; $config{"procs_per_node"} = "16"; $config{"procs_per_node_limit"} = "1"; $config{"queue"} = "casa"; $config{"radar_mpi_cmd"} = "mpirun.lsf -np"; $config{"shm_post"} = "1"; $config{"submit_cmd"} = "bsub < "; $config{"submit_plot"} = "0"; $config{"subvers"} = "openmpi"; $config{"vers"} = "casa2015_anal"; 11/03/15 03:51:58 run_post: t_offset=9999 t_end=0 11/03/15 03:51:58 run_post: is_wrf=0 is_coamps=0 soundings=1 11/03/15 03:51:58 run_post: file=ad2015110309.3dvarin 11/03/15 03:51:58 run_post: match for 'nproc_x' on line 211 - nproc_x=8, 11/03/15 03:51:58 run_post: match for 'nproc_y' on line 212 - nproc_y=24, 11/03/15 03:51:58 run_post: match for 'runname' on line 248 - runname='ad2015110309', 11/03/15 03:51:58 run_post: match for 'initime' on line 417 - initime='2015-11-03.09:40:00', 11/03/15 03:51:58 run_post: match for 'nudgopt' on line 533 - nudgopt=0, 11/03/15 03:51:58 run_post: match for 'ndstop' on line 535 - ndstop = 300.0, 11/03/15 03:51:58 run_post: match for 'dmp_out_joined' on line 2160 - dmp_out_joined=0, 11/03/15 03:51:58 run_post: match for 'hdmpfmt' on line 2161 - hdmpfmt=3, 11/03/15 03:51:58 run_post: match for 'dirname' on line 2344 - dirname='./adasdata/', 11/03/15 03:51:58 run_post: match for 'readyfl' on line 2346 - readyfl=2, 11/03/15 03:51:58 run_post: NUDGE=0 11/03/15 03:51:58 run_post: arps_subdirs=1 wrf_subdirs=0 11/03/15 03:51:58 run_post: Runname is ad2015110309 11/03/15 03:51:58 run_post: Data uses splitfiles. 11/03/15 03:51:58 run_post: match for 'nproc_x' on line 3791 - nproc_x=4, 11/03/15 03:51:58 run_post: match for 'nproc_y' on line 3791 - nproc_y=8, 11/03/15 03:51:58 run_post: Region is casa400_dfw 11/03/15 03:51:58 run_post: t_current now 0 t_end=0 11/03/15 03:51:58 run_post: p_string=000000 h_string=0000 t_string=000000 11/03/15 03:51:58 run_post: Checking plot/0000/arpsplt_0000.nqs 11/03/15 03:51:58 run_post: template: reading /home/kwthomas/rt2015/templates/boomer_pre 11/03/15 03:51:58 run_post: template: reading /home/kwthomas/rt2015/templates/graphics.nqs_template 11/03/15 03:51:58 run_post: Processing sfc.pltin 11/03/15 03:51:58 run_post: Processing sfcchar.pltin 11/03/15 03:51:58 run_post: Processing ua.pltin 11/03/15 03:51:58 run_post: Processing tmp.aein 11/03/15 03:51:58 run_post: Job Started: Tue Nov 3 03:51:59 CST 2015 Job Id: 8598140 Tue Nov 3 03:51:59 CST 2015 11/03/15 03:51:59 read_cfg: Reading ../../.tm_config $config{"tm_domain"} = "boomer"; $config{"tm_region"} = "casa2015_anal"; $config{"tm_root"} = "/home/kwthomas/rt2015"; $config{"tm_user"} = "/home/kwthomas/rt2015/user"; 11/03/15 03:51:59 read_cfg: Reading ../../.rt_config $config{"acct"} = ""; $config{"allow_mpi"} = "1"; $config{"casa"} = "1"; $config{"is_boomer"} = "1"; $config{"mpi_cmd"} = "/home/kwthomas/rt2015/scripts/mpiwrapper -np"; $config{"msg"} = "BOOMER CASA Edition"; $config{"ncarg_root"} = "/home/ywang/tools/ncarg"; $config{"non_mpi_cmd"} = ""; $config{"plot_queue"} = "casa"; $config{"procs_per_node"} = "16"; $config{"procs_per_node_limit"} = "1"; $config{"queue"} = "casa"; $config{"radar_mpi_cmd"} = "mpirun.lsf -np"; $config{"shm_post"} = "1"; $config{"submit_cmd"} = "bsub < "; $config{"submit_plot"} = "0"; $config{"subvers"} = "openmpi"; $config{"vers"} = "casa2015_anal"; 11/03/15 03:51:59 match for 'nprocx_in' on line 83 - nprocx_in=8, 11/03/15 03:51:59 match for 'nprocy_in' on line 84 - nprocy_in=24, 11/03/15 03:51:59 match for 'hisfile\(1\)' on line 149 - hisfile(1)='../../adasdata/ad2015110309.hdf000000', pwd=/work/arpsdata/arpscasa/adas-casa400_dfw/20151103/0940Z/plot/0000 Command=/home/kwthomas/rt2015/user/software/casa2015_anal/openmpi/arps/abin/arps2wdssii ../../adasdata/ad2015110309.hdf000000 8 24 /dev/shm/anal_casa400 >& arps2wdssii_out Tue Nov 3 03:52:03 CST 2015 11/03/15 03:52:19 read_cfg: Reading ../../.tm_config $config{"tm_domain"} = "boomer"; $config{"tm_region"} = "casa2015_anal"; $config{"tm_root"} = "/home/kwthomas/rt2015"; $config{"tm_user"} = "/home/kwthomas/rt2015/user"; 11/03/15 03:52:19 read_cfg: Reading ../../.rt_config $config{"acct"} = ""; $config{"allow_mpi"} = "1"; $config{"casa"} = "1"; $config{"is_boomer"} = "1"; $config{"mpi_cmd"} = "/home/kwthomas/rt2015/scripts/mpiwrapper -np"; $config{"msg"} = "BOOMER CASA Edition"; $config{"ncarg_root"} = "/home/ywang/tools/ncarg"; $config{"non_mpi_cmd"} = ""; $config{"plot_queue"} = "casa"; $config{"procs_per_node"} = "16"; $config{"procs_per_node_limit"} = "1"; $config{"queue"} = "casa"; $config{"radar_mpi_cmd"} = "mpirun.lsf -np"; $config{"shm_post"} = "1"; $config{"submit_cmd"} = "bsub < "; $config{"submit_plot"} = "0"; $config{"subvers"} = "openmpi"; $config{"vers"} = "casa2015_anal"; 11/03/15 03:52:19 Welcome to 'run_arpsplt' 11/03/15 03:52:19 match for 'nproc_x' on line 0 - nproc_x=4, 11/03/15 03:52:19 match for 'nproc_y' on line 0 - nproc_y=8, nprocs=32 11/03/15 03:52:19 Number of processors available is 192. 11/03/15 03:52:19 Number of processors per node is 16. nnprocs=32 nslots=3 11/03/15 03:52:19 nslots=3 11/03/15 03:52:19 njobs=3 11/03/15 03:52:19 nprocs=32 11/03/15 03:52:19 11/03/15 03:52:19 max=1 11/03/15 03:52:19 cmd=arpsplt1_0_arpsplt 11/03/15 03:52:19 cmd=arpsplt2_0_arpsplt 11/03/15 03:52:19 cmd=arpsplt3_0_arpsplt 11/03/15 03:52:50 Arpsplt processing is finished. end Tue Nov 3 03:52:50 CST 2015 11/03/15 03:52:51 read_cfg: Reading ../../.tm_config $config{"tm_domain"} = "boomer"; $config{"tm_region"} = "casa2015_anal"; $config{"tm_root"} = "/home/kwthomas/rt2015"; $config{"tm_user"} = "/home/kwthomas/rt2015/user"; 11/03/15 03:52:51 read_cfg: Reading ../../.rt_config $config{"acct"} = ""; $config{"allow_mpi"} = "1"; $config{"casa"} = "1"; $config{"is_boomer"} = "1"; $config{"mpi_cmd"} = "/home/kwthomas/rt2015/scripts/mpiwrapper -np"; $config{"msg"} = "BOOMER CASA Edition"; $config{"ncarg_root"} = "/home/ywang/tools/ncarg"; $config{"non_mpi_cmd"} = ""; $config{"plot_queue"} = "casa"; $config{"procs_per_node"} = "16"; $config{"procs_per_node_limit"} = "1"; $config{"queue"} = "casa"; $config{"radar_mpi_cmd"} = "mpirun.lsf -np"; $config{"shm_post"} = "1"; $config{"submit_cmd"} = "bsub < "; $config{"submit_plot"} = "0"; $config{"subvers"} = "openmpi"; $config{"vers"} = "casa2015_anal"; 11/03/15 03:52:51 max=16 11/03/15 03:52:51 use_shm=1 11/03/15 03:52:51 Start 'med' Reading 'sfc.pltin' Reading 'ua.pltin' Reading 'sfcchar.pltin' 11/03/15 03:52:54 Start 'ctrans' 11/03/15 03:52:55 Start 'convert' cmd=/bin/rm -rf /dev/shm/* 11/03/15 03:53:00 arpsplt_post finished Job run time: 00:01 11/03/15 03:53:00 plot_arps3dvar_0 run: Exit Status 0. 11/03/15 03:53:00 Task 'plot_arps3dvar_0 run' finishes. Runtime 00:01:02. 11/03/15 03:53:00 Task Manager finishes. Runtime 00:03:54. Job run time: 00:03 ------------------------------------------------------------ Sender: LSF System Subject: Job 8598140: Done Job was submitted from host by user in cluster . Job was executed on host(s) <16*c143>, in queue , as user in cluster . <16*c129> <16*c126> <16*c141> <16*c123> <16*c114> <16*c132> <16*c154> <16*c152> <16*c128> <16*c149> <16*c124> was used as the home directory. was used as the working directory. Started at Tue Nov 3 03:48:28 2015 Results reported at Tue Nov 3 03:53:00 2015 Your job looked like: ------------------------------------------------------------ # LSBATCH: User input #!/bin/csh #BSUB -J casa4-110309-00 #BSUB -R "span[ptile=16]" #BSUB -W 00:10 #BSUB -a openmpi #BSUB -e ar2015110309.err #BSUB -n 192 #BSUB -o ar2015110309.run #BSUB -q casa #BSUB -x set time1=`perl -e "print time"` echo -n "Job Started: " date echo "Job Id: $LSB_JOBID" echo " " set echo chmod 644 *run *err cd /work/arpsdata/arpscasa/adas-casa400_dfw/20151103/0940Z /home/kwthomas/rt2015/tm/task_manager5 arps3dvarplt local ar2015110309 /work/arpsdata/arpscasa/adas-casa400_dfw/20151103/0940Z /work/arpsdata/arpscasa/adas-casa400_dfw/20151103/0940Z casa2015_anal unset echo set time2=`perl -e "print time"` @ diff = $time2 - $time1 @ hour = $diff / 3600 @ diff = $diff % 3600 @ min = $diff / 60 printf '\nJob run time: %02d:%02d\n' $hour $min ------------------------------------------------------------ Successfully completed. Resource usage summary: CPU time : 13539.06 sec. Max Memory : 5 MB Max Swap : 128 MB Max Processes : 5 Max Threads : 5 The output (if any) is above this job summary. PS: Read file for stderr output of this job.