Member since
12-10-2018
23
Posts
0
Kudos Received
0
Solutions
02-19-2019
01:01 AM
Hi. I need to import data from non-trivial dbms: SAS (it isn't db at all)... So, i have jdbc-driver (class "com.sas.rio.MVADriver"), and i have socket (host and port). And i have no connection-manager at all. What should i do? How to write working import-string? 1. What about connection-manager 2. "driver" looks like jdbc:mysql://<ip>:<port>/ So "mysql" is strange part of it. How to replace it? 3. Where must i put drives (jar-files) to use it from sqoop?
... View more
Labels:
- Labels:
-
Apache Impala
-
Apache Oozie
-
Apache Sqoop
02-13-2019
09:45 PM
It's simple... There're no "hdfs group" - u mast assign user and group in host-os. And, if u have a cluster, u mast do it at "main node" (or at every node if "main" migrate to another server). But it doen't solve my core problem: "need to create new user and grant to it few rules (on select of couple schemas)." So, user in group, group have premissions, but there are no effect of it. What must i do in this case?
... View more
02-13-2019
06:57 AM
Hi, i need to create new user and grant to it few rules (on select of couple schemas). i create group, create user, assign user to group, and see it in hdfs - and there're no groups. 1. sudo adduser tezd_user 2. sudo groupadd tezd_group 3. sudo usermod -a -G tezd_group tezd_user 4. groups tezd_user >> tezd_user : tezd_user tezd_group 5. hdfs groups tezd_user >> tezd_user : So, user have no group - have to rules - have no access to any action in db. How to set group for user, and how to get rules to user (i think, it makes by addition group to user)?
... View more
Labels:
- Labels:
-
Apache Impala
-
Cloudera Hue
-
HDFS
-
Kerberos
02-12-2019
05:37 AM
"Do both of these assert the right values you've set? SHOW CURRENT ROLES; SHOW GRANT ROLE developer;" And if i set role to group tezd_group. Create new user tezd_user, assign tezd_user to tezd_group. And see "SHOW CURRENT ROLES;" -> 0 rows? So, it looks like user have no groups, or something like this... Where's the problem?
... View more
01-16-2019
11:16 PM
Metainfo "partitions" mast have information about rules for partition (what column, size of part), not "partition instances". The same about index - need info about tuple of columns included into index.
... View more
01-16-2019
08:48 AM
Ok, thanks. But we just kill our kudu-server. So we can use kudu only from Impala.
... View more
01-11-2019
04:45 AM
Hi, i need to collect information like "create table" statment: table and schema names, columns and its types, comments and so on. So, i'm able to collect table schema and table names and its location ("TBLS"), columns ("COLUMNS_V2") and table prooperties ("TABLE_PARAMS"). But i can't get any info about PK and partitions. Tables "PARTITIONS", "PARTITION_KEYS", "IDXS", "INDEX_PARAMS" are empty. So, i don't know where can i find information about. Where's it? Of course, i create table with partitions and primary keys. Oh, and i should be get type of table too: parquete, textfile or kudu-table. Havn't this info too.
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Impala
-
Apache Kudu
01-11-2019
03:59 AM
Hi. Where's KUDU stores own tables? I create testing kudu-table CREATE TABLE impala_kudu.krg_test_table (
id int not nULL,
col1 int NULL,
col2 STRING NULL,
col3 float COMMENT 'only for test',
PRIMARY KEY (id)
)
PARTITION BY HASH (id) PARTITIONS 10
COMMENT 'new testing kudu table'
STORED AS KUDU
TBLPROPERTIES ('test_arg'='test_value1','test_arg2'='test_value','comment'='arg comment','comment1'='arg comment','kudu.master_addresses'='hozd8:7051', 'kudu.num_tablet_replicas' = '1'); Then insert into it some data: insert into impala_kudu.krg_test_table
values(1,14,"qql",3.7);
insert into impala_kudu.krg_test_table
values(2,59,"adasdasd",6); Now i see in "hive metastore" table location: it shows me next hdfs://hozd8:8020/user/hive/warehouse/impala_kudu.db/krg_test_table But such file-path is empty! Where's data? Where kudu stores it? PS: i need to admin partitions - add it, drop it and so on... But i don't know where it stores, so i can't do anything.
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Impala
-
Apache Kudu