Problem for setting kudu.master_addresses property when use Impala Shell to create the Kudu table

[#1]

I use the Impala Shell to create the Kudu table, but it need to insert TBLPROPERTIES ('kudu.master_addresses' = '...'); in the CREATE TABLE commands, and I tried to replace the kudu.master_addresses parameter values as follows:

• quickstart.cloudera:7051
• quickstart.cloudera:21000
• localhost:7051
• 10.0.2.15:7051

But I still get a RPC connection error message. How do I modify the parameter value or take other solutions?

(“Virtual machine working environment”, “Impala Shell commands and error messages” are shown as follows)

Virtual machine working environment:

Virtual Machine: Cloudera Quickstart Virtual Machine (Using Oracle VM Virtualbox, download URL: https://www.cloudera.com/downloads/quickstart_vms/5-13.html)

(1) Version: 5.13.0-0

(2) Number of processors: 2

(3) Controller: IDE Controller

(4) Memory space: 5120 MB

(5) Hard drive: 64.00 GB storage, solid state drive

(6) OS: Red Hat, 64-bit

(7) MySQL 5.1.73

(8) HBase 1.2.0-cdh5.13.0

(9) Hadoop 2.6.0-cdh5.13.0

(10) Impala 2.10.0-cdh5.13.0

Impala Shell commands and error messages:

Command #1

create table courses_kudu(
CID varchar,
title varchar,
credits int,
primary key(CID)
)
STORED AS KUDU
TBLPROPERTIES ('kudu.master_addresses'='quickstart.cloudera:7051');

ERROR: ImpalaRuntimeException: Error creating Kudu table 'impala::test_db.courses_kudu'

CAUSED BY: NonRecoverableException: can not complete before timeout: KuduRpc(method=ListTables, tablet=null, attempt=95, DeadlineTracker(timeout=180000, elapsed=178599), Traces: [0ms] querying master, [217ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [465ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [558ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [578ms] querying master, [578ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [580ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: [peer master-quickstart.cloudera:7051] unexpected exception from downstream on [id: 0xccd51009], [581ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-quickstart.cloudera:7051] unexpected exception from downstream on [id: 0xccd51009], [593ms] querying master, [594ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [596ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [598ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [616ms] querying master, [616ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [618ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [620ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [635ms] querying master, [635ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [638ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [640ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [693ms] querying master, [693ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [695ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: [peer master-quickstart.cloudera:7051] unexpected exception from downstream on [id: 0x0ff834be], [696ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-quickstart.cloudera:7051] unexpected exception from downstream on [id: 0x0ff834be], [753ms] querying master, [754ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [757ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [758ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [810ms] querying master, [810ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [812ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [813ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [853ms] querying master, [853ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [855ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [858ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [1271ms] querying master, [1271ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [1272ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [1274ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [1671ms] querying master, [1671ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [1672ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [1673ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [2670ms] querying master, [2671ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [2673ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: [peer master-quickstart.cloudera:7051] unexpected exception from downstream on [id: 0xada3b4be], [2674ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-quickstart.cloudera:7051] unexpected exception from downstream on [id: 0xada3b4be], [3752ms] querying master, [3752ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [3754ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [3755ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [6310ms] querying master, [6310ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [6313ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [6322ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [8391ms] querying master, [8391ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [8393ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [8395ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [9191ms] querying master, [9191ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [9193ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: [peer master-quickstart.cloudera:7051] unexpected exception from downstream on [id: 0x7047d3ec], [9194ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-quickstart.cloudera:7051] unexpected exception from downstream on [id: 0x7047d3ec], [12251ms] querying master, [12251ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [12253ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [12254ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [15031ms] querying master, [15031ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [15033ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [15036ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [17870ms] querying master, [17871ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [17872ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [17874ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [19252ms] querying master, [19252ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [19254ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [19256ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [20050ms] querying master, [20050ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [20052ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [20054ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [20432ms] querying master, [20432ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [20433ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [20434ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [23371ms] querying master, [23371ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [23372ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [23374ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [23810ms] querying master, [23811ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [23812ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: connection closed, [23813ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [24611ms] querying master, [24611ms] Sub rpc: ConnectToMaster sending RPC to server master-quickstart.cloudera:7051, [24613ms] Sub rpc: ConnectToMaster received from server master-quickstart.cloudera:7051 response Network error: [peer master-quickstart.cloudera:7051] unexpected exception from downstream on [id: 0xde44108b], [24615ms] delaying RPC due to Service unavailable: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-quickstart.cloudera:7051] unexpected exception from downstream on [id: 0xde44108b], [28071ms] trace too long, truncated)

CAUSED BY: NoLeaderFoundException: Master config (quickstart.cloudera:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed

CAUSED BY: RecoverableException: connection closed

Command #2

create table courses_kudu(
CID varchar,
title varchar,
credits int,
primary key(CID)
)
STORED AS KUDU
TBLPROPERTIES (‘kudu.master_addresses'='quickstart.cloudera:21000');

Almost same as Command #1

Command #3

create table courses_kudu(
CID varchar,
title varchar,
credits int,
primary key(CID)
)
STORED AS KUDU
TBLPROPERTIES ('kudu.master_addresses'='localhost:7051');

ERROR: ImpalaRuntimeException: Error creating Kudu table 'impala::test_db.courses_kudu'

CAUSED BY: NonRecoverableException: can not complete before timeout: KuduRpc(method=ListTables, tablet=null, attempt=99, DeadlineTracker(timeout=180000, elapsed=177778), Traces: [0ms] querying master, [864ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [2211ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [2568ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [2571ms] querying master, [2572ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [2575ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [2577ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [2591ms] querying master, [2591ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [2594ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [2596ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [2611ms] querying master, [2611ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [2614ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [2617ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [2631ms] querying master, [2631ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [2633ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [2635ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [2650ms] querying master, [2651ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [2692ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [2694ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [2752ms] querying master, [2752ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [2754ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [2755ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [2851ms] querying master, [2851ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [2852ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [2854ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [3051ms] querying master, [3051ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [3052ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [3054ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [3411ms] querying master, [3411ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [3414ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: [peer master-localhost:7051] unexpected exception from downstream on [id: 0xd8c820a8], [3418ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-localhost:7051] unexpected exception from downstream on [id: 0xd8c820a8], [3651ms] querying master, [3651ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [3653ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: [peer master-localhost:7051] unexpected exception from downstream on [id: 0xc732a825], [3654ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-localhost:7051] unexpected exception from downstream on [id: 0xc732a825], [3891ms] querying master, [3891ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [3893ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [3894ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [5872ms] querying master, [5872ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [5881ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [6035ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [8952ms] querying master, [8953ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [8954ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [8958ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [12894ms] querying master, [12894ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [12896ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [12909ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [14151ms] querying master, [14151ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [14153ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [14177ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [15330ms] querying master, [15331ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [15334ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [15418ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [16851ms] querying master, [16851ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [16853ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [16874ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [18211ms] querying master, [18212ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [18214ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [18217ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [19912ms] querying master, [19912ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [19915ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: [peer master-localhost:7051] unexpected exception from downstream on [id: 0xb7be219d], [19917ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-localhost:7051] unexpected exception from downstream on [id: 0xb7be219d], [22332ms] querying master, [22333ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [22334ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [22335ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [23973ms] querying master, [23974ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [23977ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [23978ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [25351ms] querying master, [25351ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [25353ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [25355ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [28953ms] querying master, [28953ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [28957ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [28958ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [31032ms] querying master, [31036ms] Sub rpc: ConnectToMaster sending RPC to server master-localhost:7051, [31038ms] Sub rpc: ConnectToMaster received from server master-localhost:7051 response Network error: connection closed, [31040ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [34411ms] trace too long, truncated)

CAUSED BY: NoLeaderFoundException: Master config (localhost:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed

CAUSED BY: RecoverableException: connection closed

Command #4

create table courses_kudu(
CID varchar,
title varchar,
credits int,
primary key(CID)
)
STORED AS KUDU
TBLPROPERTIES ('kudu.master_addresses'='10.0.2.15:7051');

ERROR: ImpalaRuntimeException: Error creating Kudu table 'impala::test_db.courses_kudu'

CAUSED BY: NonRecoverableException: too many attempts: KuduRpc(method=ListTables, tablet=null, attempt=101, DeadlineTracker(timeout=180000, elapsed=165027), Traces: [0ms] querying master, [3ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [9ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [50ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [67ms] querying master, [68ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [71ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [83ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [103ms] querying master, [104ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [105ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [107ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [123ms] querying master, [124ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [126ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [128ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [143ms] querying master, [143ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [145ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [146ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [184ms] querying master, [184ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [186ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [187ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [246ms] querying master, [247ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [247ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [248ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [303ms] querying master, [304ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [305ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [306ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [323ms] querying master, [323ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [325ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [327ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [463ms] querying master, [464ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [466ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [467ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [1427ms] querying master, [1427ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [1429ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [1430ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [1603ms] querying master, [1604ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [1605ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: [peer master-10.0.2.15:7051] unexpected exception from downstream on [id: 0x717505ec], [1607ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-10.0.2.15:7051] unexpected exception from downstream on [id: 0x717505ec], [1707ms] querying master, [1707ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [1708ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [1709ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [5404ms] querying master, [5405ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [5406ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [5407ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [6184ms] querying master, [6184ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [6185ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [6187ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [6324ms] querying master, [6324ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [6326ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [6328ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [7583ms] querying master, [7584ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [7586ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [7587ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [8865ms] querying master, [8865ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [8867ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [8868ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [9645ms] querying master, [9646ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [9647ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [9648ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [10805ms] querying master, [10806ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [10808ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [10809ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [12024ms] querying master, [12024ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [12026ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [12027ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [12567ms] querying master, [12568ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [12570ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [12576ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [15324ms] querying master, [15325ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [15327ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [15328ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [18205ms] querying master, [18205ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [18207ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [18208ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [20343ms] querying master, [20343ms] Sub rpc: ConnectToMaster sending RPC to server master-10.0.2.15:7051, [20345ms] Sub rpc: ConnectToMaster received from server master-10.0.2.15:7051 response Network error: connection closed, [20346ms] delaying RPC due to Service unavailable: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [22308ms] trace too long, truncated)

CAUSED BY: NoLeaderFoundException: Master config (10.0.2.15:7051) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed

CAUSED BY: RecoverableException: connection closed

[#2]

I also encountered the same problem and tried to search for Kudu's dependencies in Impala's Configuration in Cloudera Manager, but it still couldn't solve this problem. (As shown as following figures)

All services in Cloudera ManagerKudu setting in Impala

[#3 · Accepted solution]

Hi @kentlee406,

From the images it looks like that Kudu is not installed on the QuickStart VM:

• Kudu service can not be seen in the cluster services list
• Impala can not see any Kudu service on the config page

Could you try adding Kudu service to the cluster, please see the steps in our documentation here.