DM7宕机问题记录
1 环境介绍
- x86 ,Linux环境
- DM7 主备集群
- V7.6.0.184-Build(2019.08.08-110764)ENT
- 数据库运行一周后,备库第一次数据库崩溃,下面是相关日志信息,逐步定位问题
2 dmmonitor 日志
- 根据监视器日志定位数据库故障时间 2024-02-23 02:18:43
dmmonitor
show
2024-02-17 10:12:31
#================================================================================#
GROUP OGUID MON_CONFIRM MODE MPP_FLAG
GRP1 20122 FALSE AUTO FALSE
IP INST_PORT MAL_DW_PORT WTIME WTYPE WCTLSTAT WSTATUS INST_OK INAME ISTATUS IMODE RTYPE RSTAT N_OPEN N_TASK TASK_MEM_USED FLSN CLSN SSLSN SLSN
192.*.*.* 5237 5267 2024-02-17 10:12:30 GLOBAL VALID OPEN OK GRP1_RT_02 OPEN PRIMARY REALTIME VALID 7 0 0 4754595310 4754595310 4754595310 4754595310
192.*.*.* 5237 5267 2024-02-17 10:12:31 GLOBAL VALID OPEN OK GRP1_RT_01 OPEN STANDBY REALTIME VALID 7 0 0 4754595310 4754595310 4754595310 4754595310
#================================================================================#
[monitor] 2024-02-23 02:18:43: Dmwatcher process GRP1_RT_02 status switching [OPEN-->MON CONFIRM]
WTIME WSTATUS INST_OK INAME ISTATUS IMODE RSTAT N_OPEN FLSN CLSN SSLSN SLSN
2024-02-23 02:18:43 MON CONFIRM OK GRP1_RT_02 SUSPEND PRIMARY VALID 7 9861691402 9861691403 9861691403 9861691403
[monitor] 2024-02-23 02:18:43: Dmwatcher process GRP1_RT_02 status switching [MON CONFIRM-->FAILOVER]
WTIME WSTATUS INST_OK INAME ISTATUS IMODE RSTAT N_OPEN FLSN CLSN SSLSN SLSN
2024-02-23 02:18:43 FAILOVER OK GRP1_RT_02 SUSPEND PRIMARY VALID 7 9861691402 9861691403 9861691403 9861691403
[monitor] 2024-02-23 02:18:44: Dmwatcher process GRP1_RT_02 status switching [FAILOVER-->OPEN]
WTIME WSTATUS INST_OK INAME ISTATUS IMODE RSTAT N_OPEN FLSN CLSN SSLSN SLSN
2024-02-23 02:18:44 OPEN OK GRP1_RT_02 OPEN PRIMARY VALID 7 9861691402 9861691403 9861691403 9861691403
[monitor] 2024-02-23 02:19:50: Instance GRP1_RT_01[STANDBY, OPEN] error
WTIME WSTATUS INST_OK INAME ISTATUS IMODE RSTAT N_OPEN FLSN CLSN SSLSN SLSN
2024-02-23 02:19:50 OPEN ERROR GRP1_RT_01 OPEN STANDBY INVALID 7 9861542495 9861542500 9861691402 9861691402
[monitor] 2024-02-23 02:19:50: [!!! Instance GRP1_RT_01 dmwatcher's DW_MODE is configed as AUTO, but this dmmonitor is not in CONFIRM mode, cannot takeover instance GRP1_RT_01 automatically !!!]
[monitor] 2024-02-23 02:22:36: Dmwatcher process GRP1_RT_01 status switching [OPEN-->STARTUP]
WTIME WSTATUS INST_OK INAME ISTATUS IMODE RSTAT N_OPEN FLSN CLSN SSLSN SLSN
2024-02-23 02:22:36 STARTUP ERROR GRP1_RT_01 OPEN STANDBY INVALID 7 9861542495 9861542500 9861691402 9861691402
[monitor] 2024-02-23 02:22:44: Instance GRP1_RT_01[STANDBY, STARTUP] recover to OK
WTIME WSTATUS INST_OK INAME ISTATUS IMODE RSTAT N_OPEN FLSN CLSN SSLSN SLSN
2024-02-23 02:22:45 STARTUP OK GRP1_RT_01 STARTUP STANDBY INVALID 0 9859729433 9859729433 0 9859729433
[monitor] 2024-02-23 02:23:01: Dmwatcher process GRP1_RT_01 status switching [STARTUP-->OPEN]
WTIME WSTATUS INST_OK INAME ISTATUS IMODE RSTAT N_OPEN FLSN CLSN SSLSN SLSN
2024-02-23 02:23:02 OPEN OK GRP1_RT_01 OPEN STANDBY INVALID 7 9861553531 9861553531 9861553531 9861553531
[monitor] 2024-02-23 02:23:01: Dmwatcher process GRP1_RT_02 status switching [OPEN-->RECOVERY]
WTIME WSTATUS INST_OK INAME ISTATUS IMODE RSTAT N_OPEN FLSN CLSN SSLSN SLSN
2024-02-23 02:23:01 RECOVERY OK GRP1_RT_02 OPEN PRIMARY VALID 7 9870244844 9870247022 9870247022 9870247022
[monitor] 2024-02-23 09:35:15: Dmwatcher process GRP1_RT_02 status switching [RECOVERY-->OPEN]
WTIME WSTATUS INST_OK INAME ISTATUS IMODE RSTAT N_OPEN FLSN CLSN SSLSN SLSN
2024-02-23 09:35:15 OPEN OK GRP1_RT_02 OPEN PRIMARY VALID 7 10485616655 10485616658 10485616658 10485616658
3 dmwatcher 日志
- 响应时间超过180秒,超过dmwatcher.ini 中陪孩子的故障认定时间
- current time - last time when receive db server msg = 181s (maybe system is busy) broadcast thread go on wait, receive thread change instance to ERROR
- 继续分析dmserver 日志
2024-02-17 10:09:25 [INFO] DM watch P0000029496 T0000139688106911488 Instance: dmwatcher status(OPEN) Instance status(OK) Instance Name(GRP1_RT_02) Mode(PRIMARY) Instance status(OPEN) Arch status(UNKNOWN) POCNT(7) FLSN(4754595310) CLSN(4754595310) SLSN(4754595310) SSLSN(4754595310).
2024-02-21 17:41:01 [INFO] DM watch P0000029496 T0000139688088418048 multi confirm monitor try to connect£¬close it
2024-02-21 18:00:06 [INFO] DM watch P0000029496 T0000139688088418048 dw2_send_port_set from dmmonitor vio(9) set, mid(1708512823), from name:monitor, ip:::ffff:192.*.*.*, mon_confirm:FALSE
2024-02-21 18:00:52 [INFO] DM watch P0000029496 T0000139688103741184 dw2_group_tcp_recv_thread, receive tcp msg failed, close tcp port, vio:9, mid:1708512823, from_flag:1, errno:0, error:Failure occurs in data_recv_inet_once, code 0, code:-6007
2024-02-21 18:00:52 [INFO] DM watch P0000029496 T0000139688103741184 Tcp port from dmmonitor vio(9) close, mid(1708512823), is confirm(FALSE), from name:monitor
2024-02-21 18:00:55 [INFO] DM watch P0000029496 T0000139688088418048 dw2_send_port_set from dmmonitor vio(9) set, mid(1708512871), from name:monitor, ip:::ffff:192.*.*.*, mon_confirm:FALSE
2024-02-21 18:00:56 [INFO] DM watch P0000029496 T0000139688103741184 dw2_group_tcp_recv_thread, receive tcp msg failed, close tcp port, vio:9, mid:1708512871, from_flag:1, errno:107, error:Failure occurs in data_recv_inet_once, code 107, code:-6007
2024-02-21 18:00:56 [INFO] DM watch P0000029496 T0000139688103741184 Tcp port from dmmonitor vio(9) close, mid(1708512871), is confirm(FALSE), from name:monitor
2024-02-23 02:16:33 [INFO] DM watch P0000029496 T0000139688110610176 current time - last time when receive db server msg = 181s (maybe system is busy) broadcast thread go on wait, receive thread change instance to ERROR
2024-02-23 02:16:34 [INFO] DM watch P0000029496 T0000139688087361280 dw2_inst_active_check_thread, server seq not change overtime(180)s, set svr_hb_active FALSE.
2024-02-23 02:18:43 [INFO] DM watch P0000029496 T0000139688106911488 The mode or status or real time arch status of remote instance changed, original status is:
2024-02-23 02:18:43 [INFO] DM watch P0000029496 T0000139688106911488 Instance: dmwatcher status(OPEN) Instance status(OK) Instance Name(GRP1_RT_02) Mode(PRIMARY) Instance status(OPEN) Arch status(UNKNOWN) POCNT(7) FLSN(9861691402) CLSN(9861691403) SLSN(9861691403) SSLSN(9861691403).
2024-02-23 02:18:43 [INFO] DM watch P0000029496 T0000139688106911488 The mode or status or real time arch status of remote instance changed, new status is:
2024-02-23 02:18:43 [INFO] DM watch P0000029496 T0000139688106911488 Instance: dmwatcher status(CONFIRM) Instance status(OK) Instance Name(GRP1_RT_02) Mode(PRIMARY) Instance status(SUSPEND) Arch status(UNKNOWN) POCNT(7) FLSN(9861691402) CLSN(9861691403) SLSN(9861691403) SSLSN(9861691403).
2024-02-23 02:18:44 [INFO] DM watch P0000029496 T0000139688106911488 The mode or status or real time arch status of remote instance changed, original status is:
2024-02-23 02:18:44 [INFO] DM watch P0000029496 T0000139688106911488 Instance: dmwatcher status(CONFIRM) Instance status(OK) Instance Name(GRP1_RT_02) Mode(PRIMARY) Instance status(SUSPEND) Arch status(UNKNOWN) POCNT(7) FLSN(9861691402) CLSN(9861691403) SLSN(9861691403) SSLSN(9861691403).
2024-02-23 02:18:44 [INFO] DM watch P0000029496 T0000139688106911488 The mode or status or real time arch status of remote instance changed, new status is:
2024-02-23 02:18:44 [INFO] DM watch P0000029496 T0000139688106911488 Instance: dmwatcher status(FAILOVER) Instance status(OK) Instance Name(GRP1_RT_02) Mode(PRIMARY) Instance status(SUSPEND) Arch status(UNKNOWN) POCNT(7) FLSN(9861691402) CLSN(9861691403) SLSN(9861691403) SSLSN(9861691403).
2024-02-23 02:18:44 [INFO] DM watch P0000029496 T0000139688106911488 The mode or status or real time arch status of remote instance changed, original status is:
2024-02-23 02:18:44 [INFO] DM watch P0000029496 T0000139688106911488 Instance: dmwatcher status(FAILOVER) Instance status(OK) Instance Name(GRP1_RT_02) Mode(PRIMARY) Instance status(SUSPEND) Arch status(UNKNOWN) POCNT(7) FLSN(9861691402) CLSN(9861691403) SLSN(9861691403) SSLSN(9861691403).
2024-02-23 02:18:44 [INFO] DM watch P0000029496 T0000139688106911488 The mode or status or real time arch status of remote instance changed, new status is:
2024-02-23 02:18:44 [INFO] DM watch P0000029496 T0000139688106911488 Instance: dmwatcher status(OPEN) Instance status(OK) Instance Name(GRP1_RT_02) Mode(PRIMARY) Instance status(OPEN) Arch status(UNKNOWN) POCNT(7) FLSN(9861691402) CLSN(9861691403) SLSN(9861691403) SSLSN(9861691403).
2024-02-23 02:19:46 [INFO] DM watch P0000029496 T0000139688108496640 dw2_group_tcp_recv_thread, receive tcp msg failed, close tcp port, vio:7, mid:-1, from_flag:2, errno:104, error:Failure occurs in data_recv_inet_once, code 104, code:-6007
2024-02-23 02:19:46 [INFO] DM watch P0000029496 T0000139688108496640 Tcp port from dmserver vio(7) close, mid(-1), is confirm(FALSE), from name:GRP1_RT_01
2024-02-23 02:19:50 [INFO] DM watch P0000029496 T0000139688087889664 dw2_inst_pid_check_thread, check server pid(30496) not exist, shutdown flag:0, close server conn port.
2024-02-23 02:19:50 [INFO] DM watch P0000029496 T0000139688087889664 Tcp port from dmserver vio(0) close, mid(-1), is confirm(FALSE), from name:GRP1_RT_01
2024-02-23 02:19:50 [INFO] DM watch P0000029496 T0000139688087889664 dw2_inst_pid_check_thread, check server pid(30496) not exist, set svr_pid_exist FALSE.
2024-02-23 02:22:36 [INFO] DM watch P0000029496 T0000139688110610176 Dmwatcher not receive local instance message over 180(s), switch local dmwatcher to STARTUP status
2024-02-23 02:22:36 [INFO] DM watch P0000029496 T0000139688110610176 dw2_group_set_restart_flag, flag is TRUE, last msg time:1708626156
2024-02-23 02:22:36 [INFO] DM watch P0000029496 T0000139688109553408 Set GRP1 dmwatcher process to STARTUP(SUB:STARTUP) status
2024-02-23 02:22:36 [INFO] DM watch P0000029496 T0000139688110081792 [!!! Local instance restarted by dmwatcher. !!!]
2024-02-23 02:22:45 [INFO] DM watch P0000029496 T0000139688109025024 dw2_send_port_set to dmserver vio(7) set, mid(-1), to name:GRP1_RT_01, ip:
2024-02-23 02:22:45 [INFO] DM watch P0000029496 T0000139688108496640 MAL connect status between local instance(GRP1_RT_01) and remote instance GRP1_RT_02 changed: CONNECTED --> DISCONNECTED
2024-02-23 02:22:45 [INFO] DM watch P0000029496 T0000139688108496640 Server public key changed, broadcast new value to monitor
2024-02-23 02:22:45 [INFO] DM watch P0000029496 T0000139688109553408 dw2_group_process_startup, restart flag is TRUE, set restart flag FALSE, inst_status:-1375911480, last msg time:1708626165, time differ:0
2024-02-23 02:22:46 [INFO] DM watch P0000029496 T0000139688108496640 MAL connect status between local instance(GRP1_RT_01) and remote instance GRP1_RT_02 changed: DISCONNECTED --> CONNECTED
2024-02-23 02:23:02 [INFO] DM watch P0000029496 T0000139688109553408 dw2_notify_sql_exec, dseq = 1708135572, sql: ALTER DATABASE OPEN FORCE
2024-02-23 02:23:02 [INFO] DM watch P0000029496 T0000139688109553408 Local instance GRP1_RT_01 (STANDBY & MOUNT),can join remote instance GRP1_RT_02 (PRIMARY & OPEN), notify open force
2024-02-23 02:23:02 [INFO] DM watch P0000029496 T0000139688109553408 dw2_notify_sql_exec, dseq = 1708135573, sql: ALTER DATABASE OPEN FORCE
2024-02-23 02:23:02 [INFO] DM watch P0000029496 T0000139688109553408 dw2_notify_sql_exec, dseq = 1708135574, sql: ALTER DATABASE OPEN FORCE
2024-02-23 02:23:02 [INFO] DM watch P0000029496 T0000139688109553408 Set GRP1 dmwatcher process to OPEN(SUB:STARTUP) status
2024-02-23 02:23:02 [INFO] DM watch P0000029496 T0000139688106911488 The mode or status or real time arch status of remote instance changed, original status is:
2024-02-23 02:23:02 [INFO] DM watch P0000029496 T0000139688106911488 Instance: dmwatcher status(OPEN) Instance status(OK) Instance Name(GRP1_RT_02) Mode(PRIMARY) Instance status(OPEN) Arch status(UNKNOWN) POCNT(7) FLSN(9870244844) CLSN(9870247022) SLSN(9870247022) SSLSN(9870247022).
2024-02-23 02:23:02 [INFO] DM watch P0000029496 T0000139688106911488 The mode or status or real time arch status of remote instance changed, new status is:
2024-02-23 02:23:02 [INFO] DM watch P0000029496 T0000139688106911488 Instance: dmwatcher status(RECOVERY) Instance status(OK) Instance Name(GRP1_RT_02) Mode(PRIMARY) Instance status(OPEN) Arch status(UNKNOWN) POCNT(7) FLSN(9870244844) CLSN(9870247022) SLSN(9870247022) SSLSN(9870247022).
2024-02-23 09:35:15 [INFO] DM watch P0000029496 T0000139688106911488 The mode or status or real time arch status of remote instance changed, original status is:
2024-02-23 09:35:15 [INFO] DM watch P0000029496 T0000139688106911488 Instance: dmwatcher status(RECOVERY) Instance status(OK) Instance Name(GRP1_RT_02) Mode(PRIMARY) Instance status(OPEN) Arch status(UNKNOWN) POCNT(7) FLSN(10485616655) CLSN(10485616655) SLSN(10485616655) SSLSN(10485616655).
2024-02-23 09:35:15 [INFO] DM watch P0000029496 T0000139688106911488 The mode or status or real time arch status of remote instance changed, new status is:
2024-02-23 09:35:15 [INFO] DM watch P0000029496 T0000139688106911488 Instance: dmwatcher status(RECOVERY) Instance status(OK) Instance Name(GRP1_RT_02) Mode(PRIMARY) Instance status(SUSPEND) Arch status(UNKNOWN) POCNT(7) FLSN(10485616655) CLSN(10485616658) SLSN(10485616658) SSLSN(10485616658).
2024-02-23 09:35:15 [INFO] DM watch P0000029496 T0000139688106911488 The mode or status or real time arch status of remote instance changed, original status is:
2024-02-23 09:35:15 [INFO] DM watch P0000029496 T0000139688106911488 Instance: dmwatcher status(RECOVERY) Instance status(OK) Instance Name(GRP1_RT_02) Mode(PRIMARY) Instance status(SUSPEND) Arch status(UNKNOWN) POCNT(7) FLSN(10485616655) CLSN(10485616658) SLSN(10485616658) SSLSN(10485616658).
2024-02-23 09:35:15 [INFO] DM watch P0000029496 T0000139688106911488 The mode or status or real time arch status of remote instance changed, new status is:
2024-02-23 09:35:15 [INFO] DM watch P0000029496 T0000139688106911488 Instance: dmwatcher status(OPEN) Instance status(OK) Instance Name(GRP1_RT_02) Mode(PRIMARY) Instance status(OPEN) Arch status(UNKNOWN) POCNT(7) FLSN(10485616655) CLSN(10485616658) SLSN(10485616658) SSLSN(10485616658).
2024-02-26 09:53:47 [INFO] DM watch P0000029496 T0000139688088418048 dw2_send_port_set from dmmonitor vio(9) set, mid(1708915645), from name:monitor, ip:::ffff:192.*.*.*, mon_confirm:FALSE
2024-02-26 11:07:46 [INFO] DM watch P0000029496 T0000139688104797952 dw2_group_tcp_recv_thread, receive tcp msg failed, close tcp port, vio:6, mid:1708135346, from_flag:1, errno:0, error:Failure occurs in data_recv_inet_once, code 0, code:-6007
2024-02-26 11:07:46 [INFO] DM watch P0000029496 T0000139688104797952 Tcp port from dmmonitor vio(6) close, mid(1708135346), is confirm(FALSE), from name:monitor
2024-02-26 11:07:51 [INFO] DM watch P0000029496 T0000139688088418048 dw2_send_port_set from dmmonitor vio(6) set, mid(1708916870), from name:monitor, ip:::ffff:172.19.12.37, mon_confirm:FALSE
2024-02-26 11:09:23 [INFO] DM watch P0000029496 T0000139688088418048 dw2_send_port_set from dmmonitor vio(10) set, mid(1708920181), from name:monitor, ip:::ffff:192.*.*.*, mon_confirm:FALSE
2024-02-26 11:09:31 [INFO] DM watch P0000029496 T0000139688102684416 dw2_group_tcp_recv_thread, receive tcp msg failed, close tcp port, vio:10, mid:1708920181, from_flag:1, errno:0, error:Failure occurs in data_recv_inet_once, code 0, code:-6007
2024-02-26 11:09:31 [INFO] DM watch P0000029496 T0000139688102684416 Tcp port from dmmonitor vio(10) close, mid(1708920181), is confirm(FALSE), from name:monitor
2024-02-26 13:02:40 [INFO] DM watch P0000029496 T0000139688103741184 dw2_group_tcp_recv_thread, receive tcp msg failed, close tcp port, vio:9, mid:1708915645, from_flag:1, errno:104, error:Failure occurs in data_recv_inet_once, code 104, code:-6007
2024-02-26 13:02:40 [INFO] DM watch P0000029496 T0000139688103741184 Tcp port from dmmonitor vio(9) close, mid(1708915645), is confirm(FALSE), from name:monitor
2024-02-26 15:38:42 [INFO] DM watch P0000029496 T0000139688088418048 dw2_send_port_set from dmmonitor vio(9) set, mid(1708936341), from name:monitor, ip:::ffff:192.*.*.*, mon_confirm:FALSE
2024-02-26 15:40:46 [INFO] DM watch P0000029496 T0000139688103741184 dw2_group_tcp_recv_thread, receive tcp msg failed, close tcp port, vio:9, mid:1708936341, from_flag:1, errno:107, error:Failure occurs in data_recv_inet_once, code 107, code:-6007
2024-02-26 15:40:46 [INFO] DM watch P0000029496 T0000139688103741184 Tcp port from dmmonitor vio(9) close, mid(1708936341), is confirm(FALSE), from name:monitor
4 dmserver 日志
- 无明显错误信息,继续查看操作系统日志
2024-02-23 02:13:32 [INFO] database P0000030496 main_thread ckpt info adjust: ckpt_lsn(9859728414), ckpt_fil(1), ckpt_off(1562003456), cur_lsn(9861542452), next_seq(-1758687872), cur_free(2147483648)
2024-02-23 02:13:32 [INFO] database P0000030496 main_thread ckpt info adjust: ckpt_lsn(9859728615), ckpt_fil(1), ckpt_off(1564035584), cur_lsn(9861542866), next_seq(-1758676779), cur_free(2147483648)
2024-02-23 02:13:32 [INFO] database P0000030496 main_thread ckpt info adjust: ckpt_lsn(9859728830), ckpt_fil(1), ckpt_off(1566557696), cur_lsn(9861543257), next_seq(-1758665890), cur_free(2147483648)
2024-02-23 02:13:32 [INFO] database P0000030496 main_thread ckpt info adjust: ckpt_lsn(9859729038), ckpt_fil(1), ckpt_off(1568316928), cur_lsn(9861543688), next_seq(-1758654624), cur_free(2147483648)
2024-02-23 02:13:32 [INFO] database P0000030496 main_thread ckpt info adjust: ckpt_lsn(9859729244), ckpt_fil(1), ckpt_off(1570089472), cur_lsn(9861544052), next_seq(-1758645330), cur_free(2147483648)
2024-02-23 02:13:32 [INFO] database P0000030496 main_thread ckpt info adjust: ckpt_lsn(9859729433), ckpt_fil(1), ckpt_off(1571884032), cur_lsn(9861546732), next_seq(-1758634839), cur_free(2147483648)
2024-02-23 02:16:33 [INFO] DM watch P0000029496 T0000139688110610176 current time - last time when receive db server msg = 181s (maybe system is busy) broadcast thread go on wait, receive thread change instance to ERROR
2024-02-23 02:16:34 [INFO] DM watch P0000029496 T0000139688087361280 dw2_inst_active_check_thread, server seq not change overtime(180)s, set svr_hb_active FALSE.
2024-02-23 02:18:43 [INFO] DM watch P0000029496 T0000139688106911488 The mode or status or real time arch status of remote instance changed, original status is:
2024-02-23 02:18:43 [INFO] DM watch P0000029496 T0000139688106911488 Instance: dmwatcher status(OPEN) Instance status(OK) Instance Name(GRP1_RT_02) Mode(PRIMARY) Instance status(OPEN) Arch status(UNKNOWN) POCNT(7) FLSN(9861691402) CLSN(9861691403) SLSN(9861691403) SSLSN(9861691403).
2024-02-23 02:18:43 [INFO] DM watch P0000029496 T0000139688106911488 The mode or status or real time arch status of remote instance changed, new status is:
2024-02-23 02:18:43 [INFO] DM watch P0000029496 T0000139688106911488 Instance: dmwatcher status(CONFIRM) Instance status(OK) Instance Name(GRP1_RT_02) Mode(PRIMARY) Instance status(SUSPEND) Arch status(UNKNOWN) POCNT(7) FLSN(9861691402) CLSN(9861691403) SLSN(9861691403) SSLSN(9861691403).
2024-02-23 02:18:44 [INFO] DM watch P0000029496 T0000139688106911488 The mode or status or real time arch status of remote instance changed, original status is:
2024-02-23 02:18:44 [INFO] DM watch P0000029496 T0000139688106911488 Instance: dmwatcher status(CONFIRM) Instance status(OK) Instance Name(GRP1_RT_02) Mode(PRIMARY) Instance status(SUSPEND) Arch status(UNKNOWN) POCNT(7) FLSN(9861691402) CLSN(9861691403) SLSN(9861691403) SSLSN(9861691403).
2024-02-23 02:18:44 [INFO] DM watch P0000029496 T0000139688106911488 The mode or status or real time arch status of remote instance changed, new status is:
2024-02-23 02:18:44 [INFO] DM watch P0000029496 T0000139688106911488 Instance: dmwatcher status(FAILOVER) Instance status(OK) Instance Name(GRP1_RT_02) Mode(PRIMARY) Instance status(SUSPEND) Arch status(UNKNOWN) POCNT(7) FLSN(9861691402) CLSN(9861691403) SLSN(9861691403) SSLSN(9861691403).
2024-02-23 02:18:44 [INFO] DM watch P0000029496 T0000139688106911488 The mode or status or real time arch status of remote instance changed, original status is:
2024-02-23 02:18:44 [INFO] DM watch P0000029496 T0000139688106911488 Instance: dmwatcher status(FAILOVER) Instance status(OK) Instance Name(GRP1_RT_02) Mode(PRIMARY) Instance status(SUSPEND) Arch status(UNKNOWN) POCNT(7) FLSN(9861691402) CLSN(9861691403) SLSN(9861691403) SSLSN(9861691403).
2024-02-23 02:18:44 [INFO] DM watch P0000029496 T0000139688106911488 The mode or status or real time arch status of remote instance changed, new status is:
2024-02-23 02:18:44 [INFO] DM watch P0000029496 T0000139688106911488 Instance: dmwatcher status(OPEN) Instance status(OK) Instance Name(GRP1_RT_02) Mode(PRIMARY) Instance status(OPEN) Arch status(UNKNOWN) POCNT(7) FLSN(9861691402) CLSN(9861691403) SLSN(9861691403) SSLSN(9861691403).
2024-02-23 02:19:46 [INFO] DM watch P0000029496 T0000139688108496640 dw2_group_tcp_recv_thread, receive tcp msg failed, close tcp port, vio:7, mid:-1, from_flag:2, errno:104, error:Failure occurs in data_recv_inet_once, code 104, code:-6007
2024-02-23 02:19:46 [INFO] DM watch P0000029496 T0000139688108496640 Tcp port from dmserver vio(7) close, mid(-1), is confirm(FALSE), from name:GRP1_RT_01
2024-02-23 02:19:46 [WARNING] DM watch P0000029496 T0000139688087889664 os_prcs_get_name failed, execute command(ps -e |awk '{print $4, $1}' |grep 30496$ |awk '{print $1}'), result: , pid: 30496.
2024-02-23 02:19:46 [ERROR] DM watch P0000029496 T0000139688087889664 os_prcs_is_dmsvr_prcs failed, progress(pid:30496) name() is not DMSERVER.
2024-02-23 02:19:47 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:19:48 [WARNING] DM watch P0000029496 T0000139688087889664 os_prcs_get_name failed, execute command(ps -e |awk '{print $4, $1}' |grep 30496$ |awk '{print $1}'), result: , pid: 30496.
2024-02-23 02:19:48 [ERROR] DM watch P0000029496 T0000139688087889664 os_prcs_is_dmsvr_prcs failed, progress(pid:30496) name() is not DMSERVER.
2024-02-23 02:19:48 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:19:49 [WARNING] DM watch P0000029496 T0000139688087889664 os_prcs_get_name failed, execute command(ps -e |awk '{print $4, $1}' |grep 30496$ |awk '{print $1}'), result: , pid: 30496.
2024-02-23 02:19:49 [ERROR] DM watch P0000029496 T0000139688087889664 os_prcs_is_dmsvr_prcs failed, progress(pid:30496) name() is not DMSERVER.
2024-02-23 02:19:49 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:19:50 [WARNING] DM watch P0000029496 T0000139688087889664 os_prcs_get_name failed, execute command(ps -e |awk '{print $4, $1}' |grep 30496$ |awk '{print $1}'), result: , pid: 30496.
2024-02-23 02:19:50 [ERROR] DM watch P0000029496 T0000139688087889664 os_prcs_is_dmsvr_prcs failed, progress(pid:30496) name() is not DMSERVER.
2024-02-23 02:19:50 [INFO] DM watch P0000029496 T0000139688087889664 dw2_inst_pid_check_thread, check server pid(30496) not exist, shutdown flag:0, close server conn port.
2024-02-23 02:19:50 [INFO] DM watch P0000029496 T0000139688087889664 Tcp port from dmserver vio(0) close, mid(-1), is confirm(FALSE), from name:GRP1_RT_01
2024-02-23 02:19:50 [INFO] DM watch P0000029496 T0000139688087889664 dw2_inst_pid_check_thread, check server pid(30496) not exist, set svr_pid_exist FALSE.
2024-02-23 02:19:50 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:19:51 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:19:52 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:19:53 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:19:54 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:19:55 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:19:56 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:19:57 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:19:58 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:19:59 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:00 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:01 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:02 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:03 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:04 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:05 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:06 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:07 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:08 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:09 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:10 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:11 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:12 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:13 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:14 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:15 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:16 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:17 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:18 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:19 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:20 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:21 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:22 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:23 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:24 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:25 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:26 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:27 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:28 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:29 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:30 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:31 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:32 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:33 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:34 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:35 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:36 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:37 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:38 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:39 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:40 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:41 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:42 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:43 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:44 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:45 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:46 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:47 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:48 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:49 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:50 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:51 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:52 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:53 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:54 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:55 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:56 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:57 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:58 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:20:59 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:00 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:01 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:02 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:03 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:04 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:05 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:06 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:07 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:08 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:09 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:10 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:11 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:12 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:13 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:14 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:15 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:16 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:17 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:18 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:19 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:20 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:21 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:22 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:23 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:24 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:25 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:26 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:27 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:28 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:29 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:30 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:31 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:32 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:33 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:34 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:35 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:36 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:37 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:38 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:39 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:40 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:41 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:42 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:43 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:44 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:45 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:46 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:47 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:48 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:49 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:50 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:51 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:52 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:53 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:54 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:55 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:56 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:57 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:58 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:21:59 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:00 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:01 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:02 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:03 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:04 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:05 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:06 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:07 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:08 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:09 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:10 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:11 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:12 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:13 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:14 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:15 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:16 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:17 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:18 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:19 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:20 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:21 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:22 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:23 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:24 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:25 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:26 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:27 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:28 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:29 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:30 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:31 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:32 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:33 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:34 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:35 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:36 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:36 [INFO] DM watch P0000029496 T0000139688110610176 Dmwatcher not receive local instance message over 180(s), switch local dmwatcher to STARTUP status
2024-02-23 02:22:36 [INFO] DM watch P0000029496 T0000139688110610176 dw2_group_set_restart_flag, flag is TRUE, last msg time:1708626156
2024-02-23 02:22:36 [INFO] DM watch P0000029496 T0000139688109553408 Set GRP1 dmwatcher process to STARTUP(SUB:STARTUP) status
2024-02-23 02:22:36 [INFO] DM watch P0000029496 T0000139688110081792 [!!! Local instance restarted by dmwatcher. !!!]
2024-02-23 02:22:37 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:37 [INFO] database P0000065117 main_thread version info: enterprise
2024-02-23 02:22:37 [INFO] database P0000065117 main_thread DM Database Server x64 V7.6.6.31-Build(2017.11.24-86894)ENT startup...
2024-02-23 02:22:37 [WARNING] database P0000065117 main_thread os_prcs_get_name failed, execute command(ps -e |awk '{print $4, $1}' |grep 30496$ |awk '{print $1}'), result: , pid: 30496.
2024-02-23 02:22:37 [ERROR] database P0000065117 main_thread os_prcs_is_dmsvr_prcs failed, progress(pid:30496) name() is not DMSERVER.
2024-02-23 02:22:38 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:39 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:40 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:41 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:42 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:43 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:44 [INFO] database P0000065117 main_thread fil_sys_init
2024-02-23 02:22:44 [WARNING] DM watch P0000029496 T0000139688109025024 Can't connect to DM server on '127.0.0.1' (111)
2024-02-23 02:22:44 [INFO] database P0000065117 main_thread ep 0 set rac status to 1
2024-02-23 02:22:44 [INFO] database P0000065117 main_thread rfil[/data1/FGWHA_RT/DAMENG/DAMENG01.log] sta: 0, arch_lsn = 0, arch_seq = 0, clsn = 9859729433, clsn_fil = 1, clsn_off = 1571884032, next_seq = -1758634839, free = 1532961280
2024-02-23 02:22:44 [INFO] database P0000065117 main_thread main rfil[/data1/FGWHA_RT/DAMENG/DAMENG01.log]'s sta is active
2024-02-23 02:22:44 [INFO] database P0000065117 main_thread rfil[/data1/FGWHA_RT/DAMENG/DAMENG02.log], first redo rpag seq = -1762753114, is_valid = 1, first_startup = 0
2024-02-23 02:22:44 [INFO] database P0000065117 main_thread begin redo pwr log collect, last ckpt lsn: 9859729433 ...
2024-02-23 02:22:45 [INFO] database P0000065117 main_thread mal_site_ctl_link_create startup from mal_site(0) to mal_site(0)!
2024-02-23 02:22:45 [INFO] database P0000065117 main_thread site[0] mal_site_ctl_port_set to site[0, IP: 192.*.*.*, port_num: 5257], socket handle = 15
2024-02-23 02:22:45 [INFO] database P0000065117 main_thread site[0] mal_site_data_port_set from site[0, IP: ::ffff:192.*.*.*, port_num: 35833], socket handle = 16
2024-02-23 02:22:45 [INFO] database P0000065117 main_thread mal_site_ctl_link_create startup from mal_site(0) to mal_site(1)!
2024-02-23 02:22:45 [INFO] database P0000065117 main_thread site[0] mal_site_ctl_port_set to site[1, IP: 192.*.*.*, port_num: 5257], socket handle = 17
2024-02-23 02:22:45 [INFO] DM watch P0000029496 T0000139688109025024 dw2_send_port_set to dmserver vio(7) set, mid(-1), to name:GRP1_RT_01, ip:
2024-02-23 02:22:45 [INFO] DM watch P0000029496 T0000139688108496640 MAL connect status between local instance(GRP1_RT_01) and remote instance GRP1_RT_02 changed: CONNECTED --> DISCONNECTED
2024-02-23 02:22:45 [INFO] database P0000065117 main_thread site[0] mal_site_data_port_set from site[1, IP: ::ffff:192.*.*.*, port_num: 43877], socket handle = 18
2024-02-23 02:22:45 [INFO] DM watch P0000029496 T0000139688108496640 Server public key changed, broadcast new value to monitor
2024-02-23 02:22:45 [INFO] DM watch P0000029496 T0000139688109553408 dw2_group_process_startup, restart flag is TRUE, set restart flag FALSE, inst_status:-1375911480, last msg time:1708626165, time differ:0
5 messages 操作系统日志
- Saved core dump 保存了 core 文件,继续分析core文件
Feb 22 23:25:26 dmha1 guard-pmc[79925]: get_task:reply {"Data":[{"Category":1000,"Content":"","CreateTime":"2024-02-22 23:51:56","GUID":"a7b9067c-e8ff-4c1a-a926-58023ad25f6d","ProductGUID":"3DBEEC99-FE41-4d8a-999D-E196EA9E8664","State":0}],"Error":0,"Total":0}
Feb 22 23:25:27 dmha1 ravupgrade[37333]: Grant flag 1
Feb 22 23:25:27 dmha1 ravupgrade[37333]: Up center update.
Feb 22 23:25:27 dmha1 ravupgrade[37333]: Get center address: 192.*.*.*.253:29088
Feb 22 23:25:27 dmha1 ravupgrade[37333]: Get center IP success.
Feb 22 23:25:37 dmha1 guard-pmc: Start PMCAGENT.
Feb 22 23:35:37 dmha1 guard-pmc[37427]: g_flag : 0
Feb 22 23:45:37 dmha1 guard-pmc[37427]: g_flag : 0
Feb 22 23:55:37 dmha1 guard-pmc[37427]: g_flag : 0
Feb 23 00:05:37 dmha1 guard-pmc[37427]: g_flag : 0
Feb 23 00:15:37 dmha1 guard-pmc[37427]: g_flag : 0
Feb 23 00:25:37 dmha1 guard-pmc[37427]: g_flag : 0
Feb 23 00:25:37 dmha1 guard-pmc[37427]: get_task:get request {#012#011"EpGuid":#011"430A725F-3C78-B412-E711-0FCF3CFF4408",#012#011"Products":#011["A4A099A5-39E1-4264-B285-3E93EC8F7920", "3DBEEC99-FE41-4d8a-999D-E196EA9E8664"]#012}
Feb 23 00:25:37 dmha1 guard-pmc[37427]: get_task:get url https://192.*.*.*.253:29443/rvsmc/Service/GetTasks
Feb 23 00:25:37 dmha1 guard-pmc[37427]: get_task:reply {"Data":[{"Category":1000,"Content":"","CreateTime":"2024-02-23 00:52:07","GUID":"2cbecce2-8c29-420b-a5c7-f6ac0e7b1c47","ProductGUID":"3DBEEC99-FE41-4d8a-999D-E196EA9E8664","State":0}],"Error":0,"Total":0}
Feb 23 00:25:37 dmha1 ravupgrade[74530]: Grant flag 1
Feb 23 00:25:37 dmha1 ravupgrade[74530]: Up center update.
Feb 23 00:25:37 dmha1 ravupgrade[74530]: Get center address: 192.*.*.*.253:29088
Feb 23 00:25:37 dmha1 ravupgrade[74530]: Get center IP success.
Feb 23 00:25:39 dmha1 guard-pmc[37427]: get_task:get request {#012#011"EpGuid":#011"430A725F-3C78-B412-E711-0FCF3CFF4408",#012#011"Products":#011["A4A099A5-39E1-4264-B285-3E93EC8F7920", "3DBEEC99-FE41-4d8a-999D-E196EA9E8664"]#012}
Feb 23 00:25:39 dmha1 guard-pmc[37427]: get_task:get url https://192.*.*.*.253:29443/rvsmc/Service/GetTasks
Feb 23 00:25:39 dmha1 guard-pmc[37427]: get_task:reply {"Data":[],"Error":0,"Total":0}
Feb 23 00:25:47 dmha1 guard-pmc: Start PMCAGENT.
Feb 23 00:35:48 dmha1 guard-pmc[74652]: g_flag : 0
Feb 23 00:45:48 dmha1 guard-pmc[74652]: g_flag : 0
Feb 23 00:55:48 dmha1 guard-pmc[74652]: g_flag : 0
Feb 23 01:05:48 dmha1 guard-pmc[74652]: g_flag : 0
Feb 23 01:15:48 dmha1 guard-pmc[74652]: g_flag : 0
Feb 23 01:25:48 dmha1 guard-pmc[74652]: g_flag : 0
Feb 23 01:25:49 dmha1 guard-pmc[74652]: get_task:get request {#012#011"EpGuid":#011"430A725F-3C78-B412-E711-0FCF3CFF4408",#012#011"Products":#011["A4A099A5-39E1-4264-B285-3E93EC8F7920", "3DBEEC99-FE41-4d8a-999D-E196EA9E8664"]#012}
Feb 23 01:25:49 dmha1 guard-pmc[74652]: get_task:get url https://192.*.*.*.253:29443/rvsmc/Service/GetTasks
Feb 23 01:25:49 dmha1 guard-pmc[74652]: get_task:reply {"Data":[{"Category":1000,"Content":"","CreateTime":"2024-02-23 01:52:20","GUID":"08f80e2e-2b0e-4dbc-80c9-7693ffa8ec8b","ProductGUID":"3DBEEC99-FE41-4d8a-999D-E196EA9E8664","State":0}],"Error":0,"Total":0}
Feb 23 01:25:49 dmha1 ravupgrade[32572]: Grant flag 1
Feb 23 01:25:49 dmha1 ravupgrade[32572]: Up center update.
Feb 23 01:25:49 dmha1 ravupgrade[32572]: Get center address: 192.*.*.*.253:29088
Feb 23 01:25:49 dmha1 ravupgrade[32572]: Get center IP success.
Feb 23 01:25:51 dmha1 guard-pmc[74652]: get_task:get request {#012#011"EpGuid":#011"430A725F-3C78-B412-E711-0FCF3CFF4408",#012#011"Products":#011["A4A099A5-39E1-4264-B285-3E93EC8F7920", "3DBEEC99-FE41-4d8a-999D-E196EA9E8664"]#012}
Feb 23 01:25:51 dmha1 guard-pmc[74652]: get_task:get url https://192.*.*.*.253:29443/rvsmc/Service/GetTasks
Feb 23 01:25:51 dmha1 guard-pmc[74652]: get_task:reply {"Data":[],"Error":0,"Total":0}
Feb 23 01:25:59 dmha1 guard-pmc: Start PMCAGENT.
Feb 23 01:35:59 dmha1 guard-pmc[32660]: g_flag : 0
Feb 23 01:45:59 dmha1 guard-pmc[32660]: g_flag : 0
Feb 23 01:55:59 dmha1 guard-pmc[32660]: g_flag : 0
Feb 23 02:05:59 dmha1 guard-pmc[32660]: g_flag : 0
Feb 23 02:13:32 dmha1 kernel: dm_sql_thd[8999]: segfault at 7f9e590cd34f ip 000000000133a7b0 sp 00007f9d590cd350 error 4 in dmserver[400000+1995000]
Feb 23 02:15:59 dmha1 guard-pmc[32660]: g_flag : 0
Feb 23 02:19:45 dmha1 abrt[61819]: Saved core dump of pid 30496 (/home/dmdba/dmdbms/bin/dmserver) to /var/spool/abrt/ccpp-2024-02-23-02:13:33-30496 (26388373504 bytes)
Feb 23 02:19:45 dmha1 abrtd: Directory 'ccpp-2024-02-23-02:13:33-30496' creation detected
Feb 23 02:19:45 dmha1 abrtd: Executable '/home/dmdba/dmdbms/bin/dmserver' doesn't belong to any package and ProcessUnpackaged is set to 'no'
Feb 23 02:19:45 dmha1 abrtd: 'post-create' on '/var/spool/abrt/ccpp-2024-02-23-02:13:33-30496' exited with 1
Feb 23 02:19:45 dmha1 abrtd: Deleting problem directory '/var/spool/abrt/ccpp-2024-02-23-02:13:33-30496'
Feb 23 02:25:59 dmha1 guard-pmc[32660]: g_flag : 0
Feb 23 02:26:00 dmha1 guard-pmc[32660]: get_task:get request {#012#011"EpGuid":#011"430A725F-3C78-B412-E711-0FCF3CFF4408",#012#011"Products":#011["A4A099A5-39E1-4264-B285-3E93EC8F7920", "3DBEEC99-FE41-4d8a-999D-E196EA9E8664"]#012}
Feb 23 02:26:00 dmha1 guard-pmc[32660]: get_task:get url https://192.*.*.*.253:29443/rvsmc/Service/GetTasks
Feb 23 02:26:00 dmha1 guard-pmc[32660]: get_task:reply {"Data":[{"Category":1000,"Content":"","CreateTime":"2024-02-23 02:52:33","GUID":"2ea68fb1-c1b3-4747-bd05-eb88521fc913","ProductGUID":"3DBEEC99-FE41-4d8a-999D-E196EA9E8664","State":0}],"Error":0,"Total":0}
Feb 23 02:26:00 dmha1 ravupgrade[67557]: Grant flag 1
Feb 23 02:26:00 dmha1 ravupgrade[67557]: Up center update.
Feb 23 02:26:00 dmha1 ravupgrade[67557]: Get center address: 192.*.*.*.253:29088
Feb 23 02:26:00 dmha1 ravupgrade[67557]: Get center IP success.
Feb 23 02:26:04 dmha1 guard-pmc[32660]: get_task:get request {#012#011"EpGuid":#011"430A725F-3C78-B412-E711-0FCF3CFF4408",#012#011"Products":#011["A4A099A5-39E1-4264-B285-3E93EC8F7920", "3DBEEC99-FE41-4d8a-999D-E196EA9E8664"]#012}
Feb 23 02:26:04 dmha1 guard-pmc[32660]: get_task:get url https://192.*.*.*.253:29443/rvsmc/Service/GetTasks
Feb 23 02:26:04 dmha1 guard-pmc[32660]: get_task:reply {"Data":[],"Error":0,"Total":0}
Feb 23 02:26:10 dmha1 guard-pmc: Start PMCAGENT.
Feb 23 02:36:10 dmha1 guard-pmc[67646]: g_flag : 0
Feb 23 02:46:10 dmha1 guard-pmc[67646]: g_flag : 0
Feb 23 02:56:10 dmha1 guard-pmc[67646]: g_flag : 0
Feb 23 03:06:10 dmha1 guard-pmc[67646]: g_flag : 0
Feb 23 03:16:10 dmha1 guard-pmc[67646]: g_flag : 0
Feb 23 03:26:10 dmha1 guard-pmc[67646]: g_flag : 0
Feb 23 03:26:11 dmha1 guard-pmc[67646]: get_task:get request {#012#011"EpGuid":#011"430A725F-3C78-B412-E711-0FCF3CFF4408",#012#011"Products":#011["A4A099A5-39E1-4264-B285-3E93EC8F7920", "3DBEEC99-FE41-4d8a-999D-E196EA9E8664"]#012}
Feb 23 03:26:11 dmha1 guard-pmc[67646]: get_task:get url https://192.*.*.*.253:29443/rvsmc/Service/GetTasks
Feb 23 03:26:11 dmha1 guard-pmc[67646]: get_task:reply {"Data":[{"Category":1000,"Content":"","CreateTime":"2024-02-23 03:52:47","GUID":"f33ecebe-ba7f-49c4-bb7d-eed3eb7d4353","ProductGUID":"3DBEEC99-FE41-4d8a-999D-E196EA9E8664","State":0}],"Error":0,"Total":0}
Feb 23 03:26:11 dmha1 ravupgrade[25233]: Grant flag 1
Feb 23 03:26:11 dmha1 ravupgrade[25233]: Up center update.
Feb 23 03:26:11 dmha1 ravupgrade[25233]: Get center address: 192.*.*.*.253:29088
Feb 23 03:26:11 dmha1 ravupgrade[25233]: Get center IP success.
Feb 23 03:26:16 dmha1 guard-pmc[67646]: get_task:get request {#012#011"EpGuid":#011"430A725F-3C78-B412-E711-0FCF3CFF4408",#012#011"Products":#011["A4A099A5-39E1-4264-B285-3E93EC8F7920", "3DBEEC99-FE41-4d8a-999D-E196EA9E8664"]#012}
Feb 23 03:26:16 dmha1 guard-pmc[67646]: get_task:get url https://192.*.*.*.253:29443/rvsmc/Service/GetTasks
Feb 23 03:26:16 dmha1 guard-pmc[67646]: get_task:reply {"Data":[],"Error":0,"Total":0}
Feb 23 03:26:21 dmha1 guard-pmc: Start PMCAGENT.
Feb 23 03:36:21 dmha1 guard-pmc[25325]: g_flag : 0
Feb 23 03:46:21 dmha1 guard-pmc[25325]: g_flag : 0
Feb 23 03:56:21 dmha1 guard-pmc[25325]: g_flag : 0
Feb 23 04:06:21 dmha1 guard-pmc[25325]: g_flag : 0
Feb 23 04:16:21 dmha1 guard-pmc[25325]: g_flag : 0
Feb 23 04:26:21 dmha1 guard-pmc[25325]: g_flag : 0
Feb 23 04:26:21 dmha1 guard-pmc[25325]: get_task:get request {#012#011"EpGuid":#011"430A725F-3C78-B412-E711-0FCF3CFF4408",#012#011"Products":#011["A4A099A5-39E1-4264-B285-3E93EC8F7920", "3DBEEC99-FE41-4d8a-999D-E196EA9E8664"]#012}
Feb 23 04:26:21 dmha1 guard-pmc[25325]: get_task:get url https://192.*.*.*.253:29443/rvsmc/Service/GetTasks
Feb 23 04:26:21 dmha1 guard-pmc[25325]: get_task:reply {"Data":[{"Category":1000,"Content":"","CreateTime":"2024-02-23 04:52:56","GUID":"afee0987-39a5-4131-a2dc-5c960df5e534","ProductGUID":"3DBEEC99-FE41-4d8a-999D-E196EA9E8664","State":0}],"Error":0,"Total":0}
6 gdb dmserver core 分析core
- 定位到数据库崩溃时线程信息
Thread 1 (Thread 0x7f9d590d0700 (LWP 8999)):
#0 0x000000000133a7b0 in ifun_like_high_bound ()
#1 0x0000000000e4ee6c in ninv_internal_exec ()
#2 0x0000000000ed8c7a in vm_nexp_run_low ()
#3 0x0000000000eaf70e in slct2_exec_start ()
#4 0x0000000000eaf890 in slct2_exec ()
#5 0x0000000000eda077 in vm_run ()
#6 0x0000000000edaf6f in vm_run_pln_low ()
#7 0x0000000001269c65 in ntsk_process_exec_low ()
#8 0x000000000126ece2 in ntsk_process_exec ()
#9 0x00000000012784fb in ntsk_process_cop ()
#10 0x00000000011a6a8a in uthr_db_main_for_sess ()
#11 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#12 0x0000003b518e893d in clone () from /lib64/libc.so.6
-
定位到数据库崩溃时线程号
-
- 1 Thread 0x7f9d590d0700 (LWP 8999) 0x000000000133a7b0 in ifun_like_high_bound ()
-
信息提示和 like 有关,继续分析core 文件中的sql
[dmdba@dmha1 ~]$ more core240226.txt
#0 0x000000000133a7b0 in ifun_like_high_bound ()
#1 0x0000000000e4ee6c in ninv_internal_exec ()
#2 0x0000000000ed8c7a in vm_nexp_run_low ()
#3 0x0000000000eaf70e in slct2_exec_start ()
#4 0x0000000000eaf890 in slct2_exec ()
#5 0x0000000000eda077 in vm_run ()
#6 0x0000000000edaf6f in vm_run_pln_low ()
#7 0x0000000001269c65 in ntsk_process_exec_low ()
#8 0x000000000126ece2 in ntsk_process_exec ()
#9 0x00000000012784fb in ntsk_process_cop ()
#10 0x00000000011a6a8a in uthr_db_main_for_sess ()
#11 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#12 0x0000003b518e893d in clone () from /lib64/libc.so.6
#0 0x000000000133a7b0 in ifun_like_high_bound ()
#1 0x0000000000e4ee6c in ninv_internal_exec ()
#2 0x0000000000ed8c7a in vm_nexp_run_low ()
#3 0x0000000000eaf70e in slct2_exec_start ()
#4 0x0000000000eaf890 in slct2_exec ()
#5 0x0000000000eda077 in vm_run ()
#6 0x0000000000edaf6f in vm_run_pln_low ()
#7 0x0000000001269c65 in ntsk_process_exec_low ()
#8 0x000000000126ece2 in ntsk_process_exec ()
#9 0x00000000012784fb in ntsk_process_cop ()
#10 0x00000000011a6a8a in uthr_db_main_for_sess ()
#11 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#12 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 256 (Thread 0x7f9f8abeb700 (LWP 8271)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 255 (Thread 0x7f9f8b3f3700 (LWP 8263)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 254 (Thread 0x7f9f8b0f0700 (LWP 8266)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 253 (Thread 0x7f9f8b9f9700 (LWP 8257)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 252 (Thread 0x7f9c5a8e8700 (LWP 9045)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 251 (Thread 0x7f9c5aded700 (LWP 9040)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 250 (Thread 0x7f9c5a9e9700 (LWP 9044)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 249 (Thread 0x7f9c5abeb700 (LWP 9042)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 248 (Thread 0x7f9c5aaea700 (LWP 9043)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 247 (Thread 0x7f9c5acec700 (LWP 9041)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 246 (Thread 0x7f9c5afef700 (LWP 9038)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 245 (Thread 0x7f9c5b0f0700 (LWP 9037)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 244 (Thread 0x7f9c5b4f4700 (LWP 9033)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 243 (Thread 0x7f9f926f5700 (LWP 8235)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 242 (Thread 0x7fa0195b4700 (LWP 30596)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000045d29c in os_event2_wait ()
#2 0x00000000011a2a89 in uevent_wait ()
#3 0x0000000000d65d6c in lthd_worker_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 241 (Thread 0x7fa0197b6700 (LWP 30594)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000045d29c in os_event2_wait ()
#2 0x00000000011a2a89 in uevent_wait ()
#3 0x0000000000d65d6c in lthd_worker_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 240 (Thread 0x7fa0199b8700 (LWP 30592)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000045d29c in os_event2_wait ()
#2 0x00000000011a2a89 in uevent_wait ()
#3 0x0000000000d65d6c in lthd_worker_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 239 (Thread 0x7fa019ab9700 (LWP 30591)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000045d29c in os_event2_wait ()
#2 0x00000000011a2a89 in uevent_wait ()
#3 0x0000000000d65d6c in lthd_worker_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 238 (Thread 0x7fa019cbb700 (LWP 30589)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000045d29c in os_event2_wait ()
#2 0x00000000011a2a89 in uevent_wait ()
#3 0x0000000000d65d6c in lthd_worker_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 237 (Thread 0x7fa019dbc700 (LWP 30588)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000045d29c in os_event2_wait ()
#2 0x00000000011a2a89 in uevent_wait ()
#3 0x0000000000d65d6c in lthd_worker_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 236 (Thread 0x7f9f8a6e6700 (LWP 8532)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 235 (Thread 0x7f9f8a3e3700 (LWP 8535)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 234 (Thread 0x7f9f923f2700 (LWP 8239)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 233 (Thread 0x7f9f907da700 (LWP 8243)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 232 (Thread 0x7f9d5b7f7700 (LWP 8774)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 231 (Thread 0x7f9f899d9700 (LWP 8545)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 230 (Thread 0x7f9f89bdb700 (LWP 8543)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 229 (Thread 0x7f9f8befe700 (LWP 8251)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 228 (Thread 0x7f9f8bbfb700 (LWP 8255)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 227 (Thread 0x7f9d5bfff700 (LWP 8576)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 226 (Thread 0x7f9f89ddd700 (LWP 8541)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 225 (Thread 0x7f9f8b6f6700 (LWP 8260)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 224 (Thread 0x7f9f8a0e0700 (LWP 8538)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 223 (Thread 0x7f9f8a1e1700 (LWP 8537)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 222 (Thread 0x7f9f8a4e4700 (LWP 8534)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 221 (Thread 0x7fa0196b5700 (LWP 30595)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000045d29c in os_event2_wait ()
#2 0x00000000011a2a89 in uevent_wait ()
#3 0x0000000000d65d6c in lthd_worker_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 220 (Thread 0x7fa0198b7700 (LWP 30593)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000045d29c in os_event2_wait ()
#2 0x00000000011a2a89 in uevent_wait ()
#3 0x0000000000d65d6c in lthd_worker_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 219 (Thread 0x7fa019bba700 (LWP 30590)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000045d29c in os_event2_wait ()
#2 0x00000000011a2a89 in uevent_wait ()
#3 0x0000000000d65d6c in lthd_worker_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 218 (Thread 0x7f9f8aaea700 (LWP 8272)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 217 (Thread 0x7f9f8a9e9700 (LWP 8273)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 216 (Thread 0x7f9f8a7e7700 (LWP 8275)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 215 (Thread 0x7f9d5a9e9700 (LWP 8788)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 214 (Thread 0x7f9d5b3f3700 (LWP 8778)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 213 (Thread 0x7f9d5aeee700 (LWP 8783)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 212 (Thread 0x7f9d5bcfc700 (LWP 8579)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 211 (Thread 0x7f9f882c2700 (LWP 8574)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 210 (Thread 0x7f9d5bdfd700 (LWP 8580)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 209 (Thread 0x7f9d5befe700 (LWP 8577)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 208 (Thread 0x7f9f886c6700 (LWP 8570)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 207 (Thread 0x7f9f889c9700 (LWP 8567)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 206 (Thread 0x7f9f883c3700 (LWP 8573)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 205 (Thread 0x7f9f881c1700 (LWP 8575)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 204 (Thread 0x7f9f888c8700 (LWP 8568)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 203 (Thread 0x7f9f884c4700 (LWP 8572)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 202 (Thread 0x7fa01a2c1700 (LWP 30584)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x00000000011d6b17 in hio_thread_sema ()
#3 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#4 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 201 (Thread 0x7f9f8bfff700 (LWP 30585)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x00000000011d6b17 in hio_thread_sema ()
#3 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#4 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 200 (Thread 0x7fa01a1c0700 (LWP 30586)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x00000000011d6b17 in hio_thread_sema ()
#3 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#4 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 199 (Thread 0x7fa01a3c2700 (LWP 30583)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x00000000011d6b17 in hio_thread_sema ()
#3 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#4 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 198 (Thread 0x7fa019ebd700 (LWP 30587)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000045d29c in os_event2_wait ()
#2 0x00000000011a2a89 in uevent_wait ()
#3 0x0000000000d65d6c in lthd_worker_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 197 (Thread 0x7f9f8b5f5700 (LWP 8261)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 196 (Thread 0x7f9f906d9700 (LWP 8245)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 195 (Thread 0x7fa050478700 (LWP 30575)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x00000000010b687c in rtsk_queue_check ()
#3 0x00000000010b48f3 in rsys_work_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 194 (Thread 0x7fa050579700 (LWP 30574)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x00000000010b687c in rtsk_queue_check ()
#3 0x00000000010b48f3 in rsys_work_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 193 (Thread 0x7f9f91ef0700 (LWP 8244)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 192 (Thread 0x7fa0189a8700 (LWP 30608)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000045d29c in os_event2_wait ()
#2 0x00000000011a2a89 in uevent_wait ()
#3 0x00000000010a4bef in aud_tsk_check ()
#4 0x00000000010a45ce in aud_flush_thread ()
#5 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#6 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 191 (Thread 0x7fa0190af700 (LWP 30601)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x00000000012063a2 in trc_task_thread ()
#3 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#4 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 190 (Thread 0x7f9f88bcb700 (LWP 8565)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 189 (Thread 0x7f9f88ece700 (LWP 8562)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 188 (Thread 0x7f9d5acec700 (LWP 8785)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 187 (Thread 0x7f9c5b9f9700 (LWP 9027)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 186 (Thread 0x7f9d5b0f0700 (LWP 8781)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 185 (Thread 0x7f9f88ccc700 (LWP 8564)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 184 (Thread 0x7f9f88fcf700 (LWP 8561)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 183 (Thread 0x7f9d593d3700 (LWP 8817)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 182 (Thread 0x7f9d598d8700 (LWP 8812)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 181 (Thread 0x7f9d5a0e0700 (LWP 8803)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 180 (Thread 0x7f9f8a8e8700 (LWP 8274)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 179 (Thread 0x7f9f8aded700 (LWP 8269)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 178 (Thread 0x7f9f92af9700 (LWP 8227)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 177 (Thread 0x7fa0185a4700 (LWP 8234)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 176 (Thread 0x7f9f8afef700 (LWP 8267)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 175 (Thread 0x7f9f8acec700 (LWP 8270)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 174 (Thread 0x7f9f8aeee700 (LWP 8268)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 173 (Thread 0x7f9f8b4f4700 (LWP 8262)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 172 (Thread 0x7f9f887c7700 (LWP 8569)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 171 (Thread 0x7f9f8a2e2700 (LWP 8536)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 170 (Thread 0x7f9d5b2f2700 (LWP 8779)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 169 (Thread 0x7f9f8b2f2700 (LWP 8264)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 168 (Thread 0x7f9f904d7700 (LWP 8247)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 167 (Thread 0x7f9f905d8700 (LWP 8246)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 166 (Thread 0x7f9d597d7700 (LWP 8813)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 165 (Thread 0x7f9f8b8f8700 (LWP 8258)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 164 (Thread 0x7f9f901d4700 (LWP 8250)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 163 (Thread 0x7f9f895d5700 (LWP 8554)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 162 (Thread 0x7f9d5aaea700 (LWP 8787)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 161 (Thread 0x7f9d59bdb700 (LWP 8809)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 160 (Thread 0x7f9f921f0700 (LWP 8241)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 159 (Thread 0x7f9f922f1700 (LWP 8240)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 158 (Thread 0x7f9f8b7f7700 (LWP 8259)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 157 (Thread 0x7f9f8bdfd700 (LWP 8252)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 156 (Thread 0x7f9f8bcfc700 (LWP 8253)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 155 (Thread 0x7f9f902d5700 (LWP 8249)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 154 (Thread 0x7f9f89ada700 (LWP 8544)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 153 (Thread 0x7f9d5b6f6700 (LWP 8775)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 152 (Thread 0x7f9d59ada700 (LWP 8810)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 151 (Thread 0x7f9c5b3f3700 (LWP 9034)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 150 (Thread 0x7f9d5afef700 (LWP 8782)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 149 (Thread 0x7f9d5b1f1700 (LWP 8780)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 148 (Thread 0x7f9d59cdc700 (LWP 8808)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 147 (Thread 0x7f9d5b5f5700 (LWP 8776)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 146 (Thread 0x7fa07067a700 (LWP 30566)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000006be30d in mal_site_letter_recv ()
#6 0x00000000006be8fc in mal_site_recv_thread ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 145 (Thread 0x7f9f89fdf700 (LWP 8539)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 144 (Thread 0x7f9d59ddd700 (LWP 8806)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 143 (Thread 0x7f9d59fdf700 (LWP 8807)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 142 (Thread 0x7f9f892d2700 (LWP 8557)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 141 (Thread 0x7f9f896d6700 (LWP 8553)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 140 (Thread 0x7f9f89ede700 (LWP 8540)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 139 (Thread 0x7f9c5b2f2700 (LWP 9035)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 138 (Thread 0x7f9f903d6700 (LWP 8248)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 137 (Thread 0x7f9f924f3700 (LWP 8238)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 136 (Thread 0x7f9c5b6f6700 (LWP 9032)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 135 (Thread 0x7f9c5b7f7700 (LWP 9029)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 134 (Thread 0x7f9c5bdfd700 (LWP 9024)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 133 (Thread 0x7f9d5a1e1700 (LWP 8802)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 132 (Thread 0x7f9f925f4700 (LWP 8237)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 131 (Thread 0x7f9c5bbfb700 (LWP 9025)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 130 (Thread 0x7f9f92dfb700 (LWP 8236)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 129 (Thread 0x7f9c5bfff700 (LWP 9020)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 128 (Thread 0x7f9f893d3700 (LWP 8556)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 127 (Thread 0x7f9d582c2700 (LWP 9018)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 126 (Thread 0x7f9f898d8700 (LWP 8546)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 125 (Thread 0x7f9d5a7e7700 (LWP 8790)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 124 (Thread 0x7f9c5befe700 (LWP 9021)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 123 (Thread 0x7f9d5bbfb700 (LWP 8770)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 122 (Thread 0x7f9d584c4700 (LWP 9016)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 121 (Thread 0x7f9d596d6700 (LWP 8814)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 120 (Thread 0x7fa09dc4f700 (LWP 30508)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x000000000125eb52 in linux_watch_quit_thread ()
#3 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#4 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 119 (Thread 0x7f9d585c5700 (LWP 9010)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 118 (Thread 0x7f9d591d1700 (LWP 8998)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 117 (Thread 0x7f9d5a8e8700 (LWP 8789)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 116 (Thread 0x7f9f897d7700 (LWP 8552)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 115 (Thread 0x7f9f89cdc700 (LWP 8542)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 114 (Thread 0x7f9f88aca700 (LWP 8566)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 113 (Thread 0x7f9d5a4e4700 (LWP 8799)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 112 (Thread 0x7f9f891d1700 (LWP 8559)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 111 (Thread 0x7f9c5aeee700 (LWP 9039)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 110 (Thread 0x7f9d5abeb700 (LWP 8786)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 109 (Thread 0x7f9c5b1f1700 (LWP 9036)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 108 (Thread 0x7f9f894d4700 (LWP 8555)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 107 (Thread 0x7f9d5b4f4700 (LWP 8777)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 106 (Thread 0x7f9d5a6e6700 (LWP 8797)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 105 (Thread 0x7f9f885c5700 (LWP 8571)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 104 (Thread 0x7f9d59ede700 (LWP 8805)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 103 (Thread 0x7f9d599d9700 (LWP 8811)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 102 (Thread 0x7f9c5b8f8700 (LWP 9028)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 101 (Thread 0x7f9c5b5f5700 (LWP 9031)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 100 (Thread 0x7f9d5aded700 (LWP 8784)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 99 (Thread 0x7f9d583c3700 (LWP 9017)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 98 (Thread 0x7f9c5bcfc700 (LWP 9023)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 97 (Thread 0x7f9d5a3e3700 (LWP 8800)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 96 (Thread 0x7f9d592d2700 (LWP 8818)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 95 (Thread 0x7f9f8b1f1700 (LWP 8265)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 94 (Thread 0x7f9d5a2e2700 (LWP 8801)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 93 (Thread 0x7f9d58ece700 (LWP 9001)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 92 (Thread 0x7f9d581c1700 (LWP 9019)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 91 (Thread 0x7f9d58dcd700 (LWP 9002)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 90 (Thread 0x7f9f88dcd700 (LWP 8563)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 89 (Thread 0x7f9d595d5700 (LWP 8815)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 88 (Thread 0x7f9d594d4700 (LWP 8816)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 87 (Thread 0x7f9d5a5e5700 (LWP 8798)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 86 (Thread 0x7fa01a6c5700 (LWP 30580)):
#0 0x0000003b51c0ba5e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000045d1af in os_event2_wait_timeout ()
#2 0x00000000012851bd in utsk_dw_udp_bro_thread ()
#3 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#4 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 85 (Thread 0x7f9d5bafa700 (LWP 8771)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 84 (Thread 0x7fa0181a1700 (LWP 46676)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 83 (Thread 0x7fa050175700 (LWP 30578)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x00000000007cb49d in rapply_worker_thread ()
#3 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#4 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 82 (Thread 0x7f9f890d0700 (LWP 8560)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 81 (Thread 0x7fa018ead700 (LWP 30603)):
#0 0x0000003b518df113 in poll () from /lib64/libc.so.6
#1 0x00000000011a1718 in iocp_queue_check ()
#2 0x00000000011a58eb in uthr_master_for_os ()
#3 0x00000000011a7399 in uthr_worker_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 80 (Thread 0x7f9f8bafa700 (LWP 8256)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 79 (Thread 0x7f9f8a5e5700 (LWP 8533)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 78 (Thread 0x7fa0186a5700 (LWP 30611)):
#0 0x0000003b518e13b3 in select () from /lib64/libc.so.6
#1 0x000000000125cd8f in nsvr_lsnr_thread ()
#2 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#3 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 77 (Thread 0x7fa0188a7700 (LWP 30609)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x0000000001283b00 in utsk_dw_tcp_recv_thread ()
#6 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#7 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 76 (Thread 0x7f9d5b8f8700 (LWP 8773)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 75 (Thread 0x7fa0191b0700 (LWP 30600)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x00000000012623b7 in ntsk_queue_check ()
#3 0x0000000001279468 in ntsk_worker_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 74 (Thread 0x7fa018cab700 (LWP 30605)):
#0 0x0000003b518df113 in poll () from /lib64/libc.so.6
#1 0x00000000011a1718 in iocp_queue_check ()
#2 0x00000000011a58eb in uthr_master_for_os ()
#3 0x00000000011a7399 in uthr_worker_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 73 (Thread 0x7fa0194b3700 (LWP 30597)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x00000000012623b7 in ntsk_queue_check ()
#3 0x0000000001279468 in ntsk_worker_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 72 (Thread 0x7fa018aa9700 (LWP 30607)):
#0 0x0000003b518df113 in poll () from /lib64/libc.so.6
#1 0x00000000011a1718 in iocp_queue_check ()
#2 0x00000000011a58eb in uthr_master_for_os ()
#3 0x00000000011a7399 in uthr_worker_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 71 (Thread 0x7f9d5b9f9700 (LWP 8772)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 70 (Thread 0x7fa0192b1700 (LWP 30599)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x00000000012623b7 in ntsk_queue_check ()
#3 0x0000000001279468 in ntsk_worker_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 69 (Thread 0x7fa05067a700 (LWP 30573)):
#0 0x0000003b518e171d in fdatasync () from /lib64/libc.so.6
#1 0x0000000000462a31 in os_file_flush ()
#2 0x00000000010b6392 in rtsk_process_local ()
#3 0x00000000010b654c in rtsk_process_local_sync ()
#4 0x00000000010b67e8 in rtsk_process ()
#5 0x00000000010b4944 in rsys_work_thread ()
#6 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#7 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 68 (Thread 0x7f9f91ff1700 (LWP 48267)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 67 (Thread 0x7f9c59ada700 (LWP 44182)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 66 (Thread 0x7f9f919ec700 (LWP 44400)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 65 (Thread 0x7fa01a8c7700 (LWP 30579)):
#0 0x0000003b518e13b3 in select () from /lib64/libc.so.6
#1 0x000000000127fb57 in utsk_lsnr_thread ()
#2 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#3 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 64 (Thread 0x7fa050377700 (LWP 30576)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000045d29c in os_event2_wait ()
#2 0x00000000011a2a89 in uevent_wait ()
#3 0x00000000010add12 in rarch_local_flush_wait_low ()
#4 0x000000000080a13c in ckpt2_log_adjust ()
#5 0x000000000080a6f7 in ckpt2_flush_single_ctl ()
#6 0x000000000080a88d in ckpt2_flush_it ()
#7 0x000000000080d0e4 in ckpt2_try_exec_org ()
#8 0x000000000080a012 in ckpt2_flush_thread ()
#9 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#10 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 63 (Thread 0x7fa098909700 (LWP 30561)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x000000000046554e in os_io_thread_sema ()
#3 0x00000000004673d0 in os_io_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 62 (Thread 0x7fa050276700 (LWP 30577)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x00000000010b6a2f in rtsk_enqueue ()
#3 0x00000000004d3982 in rlog4_write_to_file ()
#4 0x00000000004d52b7 in rlog4_flush_thread ()
#5 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#6 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 61 (Thread 0x7f9f913e6700 (LWP 61455)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 60 (Thread 0x7fa018baa700 (LWP 30606)):
#0 0x0000003b518df113 in poll () from /lib64/libc.so.6
#1 0x00000000011a1718 in iocp_queue_check ()
#2 0x00000000011a58eb in uthr_master_for_os ()
#3 0x00000000011a7399 in uthr_worker_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 59 (Thread 0x7f9c59ede700 (LWP 44378)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 58 (Thread 0x7f9f909dc700 (LWP 68447)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 57 (Thread 0x7f9c5a6e6700 (LWP 50620)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 56 (Thread 0x7fa070175700 (LWP 30571)):
#0 0x0000003b518e13b3 in select () from /lib64/libc.so.6
#1 0x00000000006b4f55 in mal_lsnr_thread ()
#2 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#3 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 55 (Thread 0x7fa01a5c4700 (LWP 30581)):
#0 0x0000003b51c0ba5e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000045d1af in os_event2_wait_timeout ()
#2 0x000000000128c415 in slog_flush_thread ()
#3 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#4 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 54 (Thread 0x7fa01a4c3700 (LWP 30582)):
#0 0x0000003b51c0ba5e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000045d1af in os_event2_wait_timeout ()
#2 0x0000000000760d81 in purg2_thread ()
#3 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#4 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 53 (Thread 0x7fa098808700 (LWP 30562)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x000000000046554e in os_io_thread_sema ()
#3 0x00000000004673d0 in os_io_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 52 (Thread 0x7fa018dac700 (LWP 30604)):
#0 0x0000003b518df113 in poll () from /lib64/libc.so.6
#1 0x00000000011a1718 in iocp_queue_check ()
#2 0x00000000011a58eb in uthr_master_for_os ()
#3 0x00000000011a7399 in uthr_worker_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 51 (Thread 0x7fa0187a6700 (LWP 30610)):
#0 0x0000003b51c0f00d in nanosleep () from /lib64/libpthread.so.0
#1 0x000000000046aad9 in os_thread_sleep_low ()
#2 0x000000000125ad8a in nsvr_schedule_thread ()
#3 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#4 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 50 (Thread 0x7f9f915e8700 (LWP 8233)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 49 (Thread 0x7fa05077b700 (LWP 30572)):
#0 0x0000003b51c0f00d in nanosleep () from /lib64/libpthread.so.0
#1 0x000000000046aad9 in os_thread_sleep_low ()
#2 0x00000000006ad41a in mal_sys_mgr_thread ()
#3 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#4 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 48 (Thread 0x7fa018fae700 (LWP 30602)):
#0 0x0000003b518df113 in poll () from /lib64/libc.so.6
#1 0x00000000011a1718 in iocp_queue_check ()
#2 0x00000000011a58eb in uthr_master_for_os ()
#3 0x00000000011a7399 in uthr_worker_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 47 (Thread 0x7fa0193b2700 (LWP 30598)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000045d29c in os_event2_wait ()
#2 0x00000000011a2ebf in uevent_wait_wevt ()
#3 0x00000000004d47ea in rlog4_flush_for_db ()
#4 0x00000000007d0c71 in redos_log_buf ()
#5 0x000000000126f13a in ntsk_process_rlog_apply ()
#6 0x0000000001279278 in ntsk_process ()
#7 0x0000000001279497 in ntsk_worker_thread ()
#8 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#9 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 46 (Thread 0x7fa070276700 (LWP 30570)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000006be30d in mal_site_letter_recv ()
#6 0x00000000006be8fc in mal_site_recv_thread ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 45 (Thread 0x7fa070478700 (LWP 30568)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000006be30d in mal_site_letter_recv ()
#6 0x00000000006be8fc in mal_site_recv_thread ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 44 (Thread 0x7fa070579700 (LWP 30567)):
#0 0x0000003b51c0ba5e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000045d1af in os_event2_wait_timeout ()
#2 0x00000000006beead in mal_site_tsk_thread ()
#3 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#4 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 43 (Thread 0x7fa070377700 (LWP 30569)):
#0 0x0000003b51c0ba5e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000045d1af in os_event2_wait_timeout ()
#2 0x00000000006bd9f3 in mal_site_rac_recv_thread ()
#3 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#4 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 42 (Thread 0x7fa098b0b700 (LWP 30559)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x000000000046554e in os_io_thread_sema ()
#3 0x00000000004673d0 in os_io_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 41 (Thread 0x7fa07077b700 (LWP 30565)):
#0 0x0000003b51c0ba5e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000045d1af in os_event2_wait_timeout ()
#2 0x00000000006beead in mal_site_tsk_thread ()
#3 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#4 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 40 (Thread 0x7fa098707700 (LWP 30563)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x000000000046554e in os_io_thread_sema ()
#3 0x00000000004673d0 in os_io_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 39 (Thread 0x7fa098606700 (LWP 30564)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x000000000046554e in os_io_thread_sema ()
#3 0x00000000004673d0 in os_io_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 38 (Thread 0x7fa099313700 (LWP 30551)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x000000000046554e in os_io_thread_sema ()
#3 0x00000000004673d0 in os_io_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 37 (Thread 0x7fa098f0f700 (LWP 30555)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x000000000046554e in os_io_thread_sema ()
#3 0x00000000004673d0 in os_io_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 36 (Thread 0x7fa098a0a700 (LWP 30560)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x000000000046554e in os_io_thread_sema ()
#3 0x00000000004673d0 in os_io_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 35 (Thread 0x7fa098c0c700 (LWP 30558)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x000000000046554e in os_io_thread_sema ()
#3 0x00000000004673d0 in os_io_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 34 (Thread 0x7fa098d0d700 (LWP 30557)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x000000000046554e in os_io_thread_sema ()
#3 0x00000000004673d0 in os_io_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 33 (Thread 0x7fa098e0e700 (LWP 30556)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x000000000046554e in os_io_thread_sema ()
#3 0x00000000004673d0 in os_io_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 32 (Thread 0x7fa099010700 (LWP 30554)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x000000000046554e in os_io_thread_sema ()
#3 0x00000000004673d0 in os_io_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 31 (Thread 0x7fa099111700 (LWP 30553)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x000000000046554e in os_io_thread_sema ()
#3 0x00000000004673d0 in os_io_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 30 (Thread 0x7fa099212700 (LWP 30552)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x000000000046554e in os_io_thread_sema ()
#3 0x00000000004673d0 in os_io_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 29 (Thread 0x7f9f916e9700 (LWP 61619)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 28 (Thread 0x7fa099414700 (LWP 30550)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x000000000046554e in os_io_thread_sema ()
#3 0x00000000004673d0 in os_io_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 27 (Thread 0x7f9f928f7700 (LWP 61598)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 26 (Thread 0x7fa099515700 (LWP 30549)):
#0 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x000000000046a8d2 in os_semaphore_p ()
#2 0x000000000046554e in os_io_thread_sema ()
#3 0x00000000004673d0 in os_io_thread ()
#4 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 25 (Thread 0x7fa09dd50700 (LWP 30500)):
#0 0x0000003b51c0f00d in nanosleep () from /lib64/libpthread.so.0
#1 0x000000000046aad9 in os_thread_sleep_low ()
#2 0x000000000125a9c9 in nsvr_mult_inst_check_thread ()
#3 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#4 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 24 (Thread 0x7fa58930d720 (LWP 30496)):
#0 0x0000003b51c0f00d in nanosleep () from /lib64/libpthread.so.0
#1 0x000000000046aad9 in os_thread_sleep_low ()
#2 0x00000000012604d2 in main ()
Thread 23 (Thread 0x7f9c5a4e4700 (LWP 61417)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 22 (Thread 0x7f9c59fdf700 (LWP 60021)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 21 (Thread 0x7f9c5a1e1700 (LWP 45735)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 20 (Thread 0x7f9f918eb700 (LWP 60400)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 19 (Thread 0x7f9f930fd700 (LWP 44379)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 18 (Thread 0x7f9c5a7e7700 (LWP 9046)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 17 (Thread 0x7f9f92bfa700 (LWP 44098)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 16 (Thread 0x7f9f917ea700 (LWP 61689)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 15 (Thread 0x7f9c59cdc700 (LWP 45342)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 14 (Thread 0x7f9f90add700 (LWP 60313)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 13 (Thread 0x7f9c5a0e0700 (LWP 45085)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 12 (Thread 0x7f9c59bdb700 (LWP 57981)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 11 (Thread 0x7f9f927f6700 (LWP 28259)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 10 (Thread 0x7f9c5bafa700 (LWP 9026)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 9 (Thread 0x7f9d586c6700 (LWP 9009)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 8 (Thread 0x7f9d58aca700 (LWP 9005)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 7 (Thread 0x7f9d588c8700 (LWP 9007)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 6 (Thread 0x7f9d587c7700 (LWP 9008)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 5 (Thread 0x7f9d58bcb700 (LWP 9004)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 4 (Thread 0x7f9d589c9700 (LWP 9006)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 3 (Thread 0x7f9d58ccc700 (LWP 9003)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 2 (Thread 0x7f9d58fcf700 (LWP 9000)):
#0 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
#1 0x000000000058eb87 in viosocket_recv ()
#2 0x000000000058d5fd in data_recv_inet_once ()
#3 0x000000000058da37 in comm_inet_msg_recv ()
#4 0x000000000058c3ca in comm_msg_recv_with_memobj ()
#5 0x00000000007aec9d in sess4_msg_recv ()
#6 0x00000000011a69e5 in uthr_db_main_for_sess ()
#7 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#8 0x0000003b518e893d in clone () from /lib64/libc.so.6
Thread 1 (Thread 0x7f9d590d0700 (LWP 8999)):
#0 0x000000000133a7b0 in ifun_like_high_bound ()
#1 0x0000000000e4ee6c in ninv_internal_exec ()
#2 0x0000000000ed8c7a in vm_nexp_run_low ()
#3 0x0000000000eaf70e in slct2_exec_start ()
#4 0x0000000000eaf890 in slct2_exec ()
#5 0x0000000000eda077 in vm_run ()
#6 0x0000000000edaf6f in vm_run_pln_low ()
#7 0x0000000001269c65 in ntsk_process_exec_low ()
#8 0x000000000126ece2 in ntsk_process_exec ()
#9 0x00000000012784fb in ntsk_process_cop ()
#10 0x00000000011a6a8a in uthr_db_main_for_sess ()
#11 0x0000003b51c07aa1 in start_thread () from /lib64/libpthread.so.0
#12 0x0000003b518e893d in clone () from /lib64/libc.so.6
256 Thread 0x7f9f8abeb700 (LWP 8271) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
255 Thread 0x7f9f8b3f3700 (LWP 8263) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
254 Thread 0x7f9f8b0f0700 (LWP 8266) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
253 Thread 0x7f9f8b9f9700 (LWP 8257) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
252 Thread 0x7f9c5a8e8700 (LWP 9045) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
251 Thread 0x7f9c5aded700 (LWP 9040) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
250 Thread 0x7f9c5a9e9700 (LWP 9044) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
249 Thread 0x7f9c5abeb700 (LWP 9042) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
248 Thread 0x7f9c5aaea700 (LWP 9043) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
247 Thread 0x7f9c5acec700 (LWP 9041) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
246 Thread 0x7f9c5afef700 (LWP 9038) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
245 Thread 0x7f9c5b0f0700 (LWP 9037) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
244 Thread 0x7f9c5b4f4700 (LWP 9033) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
243 Thread 0x7f9f926f5700 (LWP 8235) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
242 Thread 0x7fa0195b4700 (LWP 30596) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
241 Thread 0x7fa0197b6700 (LWP 30594) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
240 Thread 0x7fa0199b8700 (LWP 30592) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
239 Thread 0x7fa019ab9700 (LWP 30591) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
238 Thread 0x7fa019cbb700 (LWP 30589) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
237 Thread 0x7fa019dbc700 (LWP 30588) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
236 Thread 0x7f9f8a6e6700 (LWP 8532) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
235 Thread 0x7f9f8a3e3700 (LWP 8535) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
234 Thread 0x7f9f923f2700 (LWP 8239) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
233 Thread 0x7f9f907da700 (LWP 8243) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
232 Thread 0x7f9d5b7f7700 (LWP 8774) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
231 Thread 0x7f9f899d9700 (LWP 8545) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
230 Thread 0x7f9f89bdb700 (LWP 8543) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
229 Thread 0x7f9f8befe700 (LWP 8251) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
228 Thread 0x7f9f8bbfb700 (LWP 8255) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
227 Thread 0x7f9d5bfff700 (LWP 8576) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
226 Thread 0x7f9f89ddd700 (LWP 8541) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
225 Thread 0x7f9f8b6f6700 (LWP 8260) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
224 Thread 0x7f9f8a0e0700 (LWP 8538) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
223 Thread 0x7f9f8a1e1700 (LWP 8537) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
222 Thread 0x7f9f8a4e4700 (LWP 8534) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
221 Thread 0x7fa0196b5700 (LWP 30595) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
220 Thread 0x7fa0198b7700 (LWP 30593) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
219 Thread 0x7fa019bba700 (LWP 30590) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
218 Thread 0x7f9f8aaea700 (LWP 8272) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
217 Thread 0x7f9f8a9e9700 (LWP 8273) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
216 Thread 0x7f9f8a7e7700 (LWP 8275) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
215 Thread 0x7f9d5a9e9700 (LWP 8788) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
214 Thread 0x7f9d5b3f3700 (LWP 8778) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
213 Thread 0x7f9d5aeee700 (LWP 8783) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
212 Thread 0x7f9d5bcfc700 (LWP 8579) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
211 Thread 0x7f9f882c2700 (LWP 8574) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
210 Thread 0x7f9d5bdfd700 (LWP 8580) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
209 Thread 0x7f9d5befe700 (LWP 8577) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
208 Thread 0x7f9f886c6700 (LWP 8570) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
207 Thread 0x7f9f889c9700 (LWP 8567) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
206 Thread 0x7f9f883c3700 (LWP 8573) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
205 Thread 0x7f9f881c1700 (LWP 8575) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
204 Thread 0x7f9f888c8700 (LWP 8568) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
203 Thread 0x7f9f884c4700 (LWP 8572) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
202 Thread 0x7fa01a2c1700 (LWP 30584) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
201 Thread 0x7f9f8bfff700 (LWP 30585) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
200 Thread 0x7fa01a1c0700 (LWP 30586) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
199 Thread 0x7fa01a3c2700 (LWP 30583) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
198 Thread 0x7fa019ebd700 (LWP 30587) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
197 Thread 0x7f9f8b5f5700 (LWP 8261) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
196 Thread 0x7f9f906d9700 (LWP 8245) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
195 Thread 0x7fa050478700 (LWP 30575) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
194 Thread 0x7fa050579700 (LWP 30574) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
193 Thread 0x7f9f91ef0700 (LWP 8244) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
192 Thread 0x7fa0189a8700 (LWP 30608) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
191 Thread 0x7fa0190af700 (LWP 30601) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
190 Thread 0x7f9f88bcb700 (LWP 8565) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
189 Thread 0x7f9f88ece700 (LWP 8562) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
188 Thread 0x7f9d5acec700 (LWP 8785) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
187 Thread 0x7f9c5b9f9700 (LWP 9027) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
186 Thread 0x7f9d5b0f0700 (LWP 8781) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
185 Thread 0x7f9f88ccc700 (LWP 8564) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
184 Thread 0x7f9f88fcf700 (LWP 8561) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
183 Thread 0x7f9d593d3700 (LWP 8817) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
182 Thread 0x7f9d598d8700 (LWP 8812) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
181 Thread 0x7f9d5a0e0700 (LWP 8803) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
180 Thread 0x7f9f8a8e8700 (LWP 8274) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
179 Thread 0x7f9f8aded700 (LWP 8269) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
178 Thread 0x7f9f92af9700 (LWP 8227) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
177 Thread 0x7fa0185a4700 (LWP 8234) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
176 Thread 0x7f9f8afef700 (LWP 8267) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
175 Thread 0x7f9f8acec700 (LWP 8270) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
174 Thread 0x7f9f8aeee700 (LWP 8268) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
173 Thread 0x7f9f8b4f4700 (LWP 8262) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
172 Thread 0x7f9f887c7700 (LWP 8569) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
171 Thread 0x7f9f8a2e2700 (LWP 8536) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
170 Thread 0x7f9d5b2f2700 (LWP 8779) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
169 Thread 0x7f9f8b2f2700 (LWP 8264) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
168 Thread 0x7f9f904d7700 (LWP 8247) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
167 Thread 0x7f9f905d8700 (LWP 8246) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
166 Thread 0x7f9d597d7700 (LWP 8813) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
165 Thread 0x7f9f8b8f8700 (LWP 8258) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
164 Thread 0x7f9f901d4700 (LWP 8250) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
163 Thread 0x7f9f895d5700 (LWP 8554) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
162 Thread 0x7f9d5aaea700 (LWP 8787) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
161 Thread 0x7f9d59bdb700 (LWP 8809) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
160 Thread 0x7f9f921f0700 (LWP 8241) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
159 Thread 0x7f9f922f1700 (LWP 8240) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
158 Thread 0x7f9f8b7f7700 (LWP 8259) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
157 Thread 0x7f9f8bdfd700 (LWP 8252) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
156 Thread 0x7f9f8bcfc700 (LWP 8253) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
155 Thread 0x7f9f902d5700 (LWP 8249) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
154 Thread 0x7f9f89ada700 (LWP 8544) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
153 Thread 0x7f9d5b6f6700 (LWP 8775) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
152 Thread 0x7f9d59ada700 (LWP 8810) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
151 Thread 0x7f9c5b3f3700 (LWP 9034) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
150 Thread 0x7f9d5afef700 (LWP 8782) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
149 Thread 0x7f9d5b1f1700 (LWP 8780) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
148 Thread 0x7f9d59cdc700 (LWP 8808) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
147 Thread 0x7f9d5b5f5700 (LWP 8776) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
146 Thread 0x7fa07067a700 (LWP 30566) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
145 Thread 0x7f9f89fdf700 (LWP 8539) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
144 Thread 0x7f9d59ddd700 (LWP 8806) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
143 Thread 0x7f9d59fdf700 (LWP 8807) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
142 Thread 0x7f9f892d2700 (LWP 8557) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
141 Thread 0x7f9f896d6700 (LWP 8553) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
140 Thread 0x7f9f89ede700 (LWP 8540) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
139 Thread 0x7f9c5b2f2700 (LWP 9035) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
138 Thread 0x7f9f903d6700 (LWP 8248) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
137 Thread 0x7f9f924f3700 (LWP 8238) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
136 Thread 0x7f9c5b6f6700 (LWP 9032) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
135 Thread 0x7f9c5b7f7700 (LWP 9029) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
134 Thread 0x7f9c5bdfd700 (LWP 9024) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
133 Thread 0x7f9d5a1e1700 (LWP 8802) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
132 Thread 0x7f9f925f4700 (LWP 8237) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
131 Thread 0x7f9c5bbfb700 (LWP 9025) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
130 Thread 0x7f9f92dfb700 (LWP 8236) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
129 Thread 0x7f9c5bfff700 (LWP 9020) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
128 Thread 0x7f9f893d3700 (LWP 8556) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
127 Thread 0x7f9d582c2700 (LWP 9018) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
126 Thread 0x7f9f898d8700 (LWP 8546) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
125 Thread 0x7f9d5a7e7700 (LWP 8790) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
124 Thread 0x7f9c5befe700 (LWP 9021) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
123 Thread 0x7f9d5bbfb700 (LWP 8770) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
122 Thread 0x7f9d584c4700 (LWP 9016) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
121 Thread 0x7f9d596d6700 (LWP 8814) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
120 Thread 0x7fa09dc4f700 (LWP 30508) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
119 Thread 0x7f9d585c5700 (LWP 9010) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
118 Thread 0x7f9d591d1700 (LWP 8998) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
117 Thread 0x7f9d5a8e8700 (LWP 8789) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
116 Thread 0x7f9f897d7700 (LWP 8552) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
115 Thread 0x7f9f89cdc700 (LWP 8542) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
114 Thread 0x7f9f88aca700 (LWP 8566) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
113 Thread 0x7f9d5a4e4700 (LWP 8799) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
112 Thread 0x7f9f891d1700 (LWP 8559) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
111 Thread 0x7f9c5aeee700 (LWP 9039) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
110 Thread 0x7f9d5abeb700 (LWP 8786) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
109 Thread 0x7f9c5b1f1700 (LWP 9036) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
108 Thread 0x7f9f894d4700 (LWP 8555) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
107 Thread 0x7f9d5b4f4700 (LWP 8777) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
106 Thread 0x7f9d5a6e6700 (LWP 8797) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
105 Thread 0x7f9f885c5700 (LWP 8571) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
104 Thread 0x7f9d59ede700 (LWP 8805) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
103 Thread 0x7f9d599d9700 (LWP 8811) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
102 Thread 0x7f9c5b8f8700 (LWP 9028) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
101 Thread 0x7f9c5b5f5700 (LWP 9031) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
100 Thread 0x7f9d5aded700 (LWP 8784) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
99 Thread 0x7f9d583c3700 (LWP 9017) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
98 Thread 0x7f9c5bcfc700 (LWP 9023) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
97 Thread 0x7f9d5a3e3700 (LWP 8800) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
96 Thread 0x7f9d592d2700 (LWP 8818) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
95 Thread 0x7f9f8b1f1700 (LWP 8265) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
94 Thread 0x7f9d5a2e2700 (LWP 8801) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
93 Thread 0x7f9d58ece700 (LWP 9001) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
92 Thread 0x7f9d581c1700 (LWP 9019) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
91 Thread 0x7f9d58dcd700 (LWP 9002) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
90 Thread 0x7f9f88dcd700 (LWP 8563) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
89 Thread 0x7f9d595d5700 (LWP 8815) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
88 Thread 0x7f9d594d4700 (LWP 8816) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
87 Thread 0x7f9d5a5e5700 (LWP 8798) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
86 Thread 0x7fa01a6c5700 (LWP 30580) 0x0000003b51c0ba5e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
85 Thread 0x7f9d5bafa700 (LWP 8771) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
84 Thread 0x7fa0181a1700 (LWP 46676) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
83 Thread 0x7fa050175700 (LWP 30578) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
82 Thread 0x7f9f890d0700 (LWP 8560) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
81 Thread 0x7fa018ead700 (LWP 30603) 0x0000003b518df113 in poll () from /lib64/libc.so.6
80 Thread 0x7f9f8bafa700 (LWP 8256) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
79 Thread 0x7f9f8a5e5700 (LWP 8533) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
78 Thread 0x7fa0186a5700 (LWP 30611) 0x0000003b518e13b3 in select () from /lib64/libc.so.6
77 Thread 0x7fa0188a7700 (LWP 30609) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
76 Thread 0x7f9d5b8f8700 (LWP 8773) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
75 Thread 0x7fa0191b0700 (LWP 30600) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
74 Thread 0x7fa018cab700 (LWP 30605) 0x0000003b518df113 in poll () from /lib64/libc.so.6
73 Thread 0x7fa0194b3700 (LWP 30597) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
72 Thread 0x7fa018aa9700 (LWP 30607) 0x0000003b518df113 in poll () from /lib64/libc.so.6
71 Thread 0x7f9d5b9f9700 (LWP 8772) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
70 Thread 0x7fa0192b1700 (LWP 30599) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
69 Thread 0x7fa05067a700 (LWP 30573) 0x0000003b518e171d in fdatasync () from /lib64/libc.so.6
68 Thread 0x7f9f91ff1700 (LWP 48267) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
67 Thread 0x7f9c59ada700 (LWP 44182) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
66 Thread 0x7f9f919ec700 (LWP 44400) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
65 Thread 0x7fa01a8c7700 (LWP 30579) 0x0000003b518e13b3 in select () from /lib64/libc.so.6
64 Thread 0x7fa050377700 (LWP 30576) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
63 Thread 0x7fa098909700 (LWP 30561) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
62 Thread 0x7fa050276700 (LWP 30577) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
61 Thread 0x7f9f913e6700 (LWP 61455) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
60 Thread 0x7fa018baa700 (LWP 30606) 0x0000003b518df113 in poll () from /lib64/libc.so.6
59 Thread 0x7f9c59ede700 (LWP 44378) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
58 Thread 0x7f9f909dc700 (LWP 68447) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
57 Thread 0x7f9c5a6e6700 (LWP 50620) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
56 Thread 0x7fa070175700 (LWP 30571) 0x0000003b518e13b3 in select () from /lib64/libc.so.6
55 Thread 0x7fa01a5c4700 (LWP 30581) 0x0000003b51c0ba5e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
54 Thread 0x7fa01a4c3700 (LWP 30582) 0x0000003b51c0ba5e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
53 Thread 0x7fa098808700 (LWP 30562) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
52 Thread 0x7fa018dac700 (LWP 30604) 0x0000003b518df113 in poll () from /lib64/libc.so.6
51 Thread 0x7fa0187a6700 (LWP 30610) 0x0000003b51c0f00d in nanosleep () from /lib64/libpthread.so.0
50 Thread 0x7f9f915e8700 (LWP 8233) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
49 Thread 0x7fa05077b700 (LWP 30572) 0x0000003b51c0f00d in nanosleep () from /lib64/libpthread.so.0
48 Thread 0x7fa018fae700 (LWP 30602) 0x0000003b518df113 in poll () from /lib64/libc.so.6
47 Thread 0x7fa0193b2700 (LWP 30598) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
46 Thread 0x7fa070276700 (LWP 30570) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
45 Thread 0x7fa070478700 (LWP 30568) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
44 Thread 0x7fa070579700 (LWP 30567) 0x0000003b51c0ba5e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
43 Thread 0x7fa070377700 (LWP 30569) 0x0000003b51c0ba5e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
42 Thread 0x7fa098b0b700 (LWP 30559) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
41 Thread 0x7fa07077b700 (LWP 30565) 0x0000003b51c0ba5e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
40 Thread 0x7fa098707700 (LWP 30563) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
39 Thread 0x7fa098606700 (LWP 30564) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
38 Thread 0x7fa099313700 (LWP 30551) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
37 Thread 0x7fa098f0f700 (LWP 30555) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
36 Thread 0x7fa098a0a700 (LWP 30560) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
35 Thread 0x7fa098c0c700 (LWP 30558) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
34 Thread 0x7fa098d0d700 (LWP 30557) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
33 Thread 0x7fa098e0e700 (LWP 30556) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
32 Thread 0x7fa099010700 (LWP 30554) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
31 Thread 0x7fa099111700 (LWP 30553) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
30 Thread 0x7fa099212700 (LWP 30552) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
29 Thread 0x7f9f916e9700 (LWP 61619) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
28 Thread 0x7fa099414700 (LWP 30550) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
27 Thread 0x7f9f928f7700 (LWP 61598) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
26 Thread 0x7fa099515700 (LWP 30549) 0x0000003b51c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
25 Thread 0x7fa09dd50700 (LWP 30500) 0x0000003b51c0f00d in nanosleep () from /lib64/libpthread.so.0
24 Thread 0x7fa58930d720 (LWP 30496) 0x0000003b51c0f00d in nanosleep () from /lib64/libpthread.so.0
23 Thread 0x7f9c5a4e4700 (LWP 61417) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
22 Thread 0x7f9c59fdf700 (LWP 60021) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
21 Thread 0x7f9c5a1e1700 (LWP 45735) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
20 Thread 0x7f9f918eb700 (LWP 60400) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
19 Thread 0x7f9f930fd700 (LWP 44379) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
18 Thread 0x7f9c5a7e7700 (LWP 9046) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
17 Thread 0x7f9f92bfa700 (LWP 44098) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
16 Thread 0x7f9f917ea700 (LWP 61689) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
15 Thread 0x7f9c59cdc700 (LWP 45342) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
14 Thread 0x7f9f90add700 (LWP 60313) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
13 Thread 0x7f9c5a0e0700 (LWP 45085) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
12 Thread 0x7f9c59bdb700 (LWP 57981) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
11 Thread 0x7f9f927f6700 (LWP 28259) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
10 Thread 0x7f9c5bafa700 (LWP 9026) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
9 Thread 0x7f9d586c6700 (LWP 9009) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
8 Thread 0x7f9d58aca700 (LWP 9005) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
7 Thread 0x7f9d588c8700 (LWP 9007) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
6 Thread 0x7f9d587c7700 (LWP 9008) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
5 Thread 0x7f9d58bcb700 (LWP 9004) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
4 Thread 0x7f9d589c9700 (LWP 9006) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
3 Thread 0x7f9d58ccc700 (LWP 9003) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
2 Thread 0x7f9d58fcf700 (LWP 9000) 0x0000003b51c0e82d in read () from /lib64/libpthread.so.0
* 1 Thread 0x7f9d590d0700 (LWP 8999) 0x000000000133a7b0 in ifun_like_high_bound ()
7 dmrdc core 分析core中sql
- 找到线程号8999对应的sql
- !#%&*^$@[8999]:select count(0) count from dep_l_276501 t where t.del_flag=0 and t.is_peat=1 and (t.xy10101001 like concat(‘%’,?,‘%’) or t.xy10101002=?) and t.sd_gslx like concat(?,‘%’)
[dmdba@dmha1 ~]$ cat core_rdc240226.txt
!#%&*^$@[8256]:select 1 from dual
!#%&*^$@[8771]:select 1 from dual
!#%&*^$@[8999]:select count(0) count from dep_l_276501 t where t.del_flag=0 and t.is_peat=1 and (t.xy10101001 like concat('%',?,'%') or t.xy10101002=?) and t.sd_gslx like concat(?,'%')
!#%&*^$@[9005]:select 1 from dual
!#%&*^$@[68447]:select * from v$purge_pseg_tab;
!#%&*^$@[8233]:select 1 from dual
!#%&*^$@[8772]:select 1 from dual
!#%&*^$@[9000]:select t2.*
from (select row_.*, rownum rownum_ from (
select id,city,main_name,main_code,type,record_num,sxlx_name from serious_promise_legal_data t where del_flag=0 and t.type = ? order by record_num desc ) row_ where rownum <= ?*?) t2 where rownum_ > (?-1)*?
!#%&*^$@[9006]:select name,code from base_legal_identity where 1=1 and (l_credit_code=? or gsdjh=? )
!#%&*^$@[8533]:select 1 from dual
!#%&*^$@[8798]:select 1 from dual
!#%&*^$@[9003]:select t.type,count(*) cnt from base_legal_identity t where t.is_peat=1 group by t.type
!#%&*^$@[9009]:select * from (select id,measure,to_char(pub_date,'yyyy-mm-dd') create_date ,file_name,file_path from iwp_reward_punish_list where del_flag='0' and list_type=2 order by pub_date desc ) where rownum<=10
!#%&*^$@[9026]:select 1 from dual
!#%&*^$@[28259]:SELECT
F.TABLESPACE_NAME ,
(T.TOTAL_SPACE - F.FREE_SPACE) / 1024 "USED (GB)",
F.FREE_SPACE / 1024 "FREE (GB)" ,
T.TOTAL_SPACE / 1024 "TOTAL(GB)" ,
(ROUND((F.FREE_SPACE / T.TOTAL_SPACE) * 100))
|| '% ' PER_FREE
FROM
(
SELECT
TABLESPACE_NAME,
ROUND(SUM(BLOCKS *
(
SELECT PARA_VALUE / 1024 FROM V$DM_INI WHERE PARA_NAME = 'GLOBAL_PAGE_SIZE'
)
/ 1024)) FREE_SPACE
FROM
DBA_FREE_SPACE
GROUP BY
TABLESPACE_NAME
)
F,
(
SELECT
TABLESPACE_NAME,
ROUND(SUM(BYTES / 1048576)) TOTAL_SPACE
FROM
DBA_DATA_FILES
GROUP BY
TABLESPACE_NAME
)
T
WHERE
F.TABLESPACE_NAME = T.TABLESPACE_NAME;
!#%&*^$@[50620]:SELECT t.id, t.xk_xkjg dep_name, t.xk_xkjgdm dep_tyshxym, null AS dep_id, a.name AS area_name, a.code AS area_code, t.xk_wsh wsh, t.xk_jdrq AS jdrq, t.xk_xkjg AS jdjg, t.xk_xkjgdm AS jdjgdm, t.create_date FROM (SELECT *, substring(xk_xkjgdm, 3, 6) || '000000' AS area_id FROM dep_p_180401 WHERE del_flag = '0' AND is_peat = 1 AND xk_jdrq >= ? AND create_date > ?) t INNER JOIN sys_area a ON a.id = t.area_id AND a.del_flag = '0'
!#%&*^$@[9004]:select t.type,count(*) cnt from base_legal_identity t where t.is_peat=1 group by t.type
!#%&*^$@[8560]:select 1 from dual
!#%&*^$@[8773]:select data_value as data_value,config_key as config_key from sys_config where 1=1 and del_flag = '0' and system_code = ?
!#%&*^$@[9001]:select t.type,count(*) cnt from base_legal_identity t where t.is_peat=1 group by t.type
!#%&*^$@[9007]:select name,code from base_legal_identity where 1=1 and (l_credit_code=? or gsdjh=? )
!#%&*^$@[9002]:select t.type,count(*) cnt from base_legal_identity t where t.is_peat=1 group by t.type
!#%&*^$@[9008]:select name,code from base_legal_identity where 1=1 and (l_credit_code=? or gsdjh=? )
8 结论
- where条件 LIKE 传参 ,若传进来的字符串是空 ,并且长度不是 0;若符合这个情况数据库会宕机,需要业务系统控制传参解决
扫一扫
1172
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
