Member since
04-22-2016
931
Posts
46
Kudos Received
26
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1517 | 10-11-2018 01:38 AM | |
1883 | 09-26-2018 02:24 AM | |
1842 | 06-29-2018 02:35 PM | |
2447 | 06-29-2018 02:34 PM | |
5410 | 06-20-2018 04:30 PM |
12-16-2016
10:47 PM
that sounds very odd , so if the table has 1 billon rows and someone asks me to tell which columns it has in a particular column family I have to dump the whole billon rows ? there has to be some other way
... View more
12-16-2016
10:15 PM
the describe command is only giving me the column family and not the columns , how can I see which columns belong to a column family without having to dump the whole table ?
... View more
Labels:
12-16-2016
10:01 PM
the command below creates one column family successfully , how can I add another column family to this command ? sqoop import --connect "jdbc:oracle:thin:@(description=(address=(protocol=tcp)(host=patronQA)(port=1526))(connect_data=(service_name=patron)))" --username PATRON --password xxxx --table PATRON.AUDIT_TOUR_SMALL --hbase-table AUDIT_TOUR --column-family TOUR --hbase-row-key "TOUR_ID" --hbase-create-table --columns "TOUR_ID,HOST_TOUR_ID,PLAZA_ID,REV_DAY_ID,LANE_ID,HOST_EMP_ID" -m 1
... View more
Labels:
12-16-2016
09:59 PM
1 Kudo
this did the trick .. [root@hadoop1 ~]# klist -kte /etc/security/keytabs/hbase.headless.keytab
Keytab name: FILE:/etc/security/keytabs/hbase.headless.keytab
KVNO Timestamp Principal
---- ----------------- --------------------------------------------------------
1 11/30/16 14:40:25 hbase-fdot_hadoop@TOLLS.DOT.STATE.FL.US (arcfour-hmac)
1 11/30/16 14:40:25 hbase-fdot_hadoop@TOLLS.DOT.STATE.FL.US (des3-cbc-sha1)
1 11/30/16 14:40:25 hbase-fdot_hadoop@TOLLS.DOT.STATE.FL.US (aes256-cts-hmac-sha1-96)
1 11/30/16 14:40:25 hbase-fdot_hadoop@TOLLS.DOT.STATE.FL.US (des-cbc-md5)
1 11/30/16 14:40:25 hbase-fdot_hadoop@TOLLS.DOT.STATE.FL.US (aes128-cts-hmac-sha1-96)
kinit -kt /etc/security/keytabs/hbase.headless.keytab hbase-fdot_hadoop
hbase(main):002:0> grant 'sami', 'RWXCA'
0 row(s) in 0.4040 seconds
hbase(main):003:0> exit
[root@hadoop1 ~]#
... View more
12-16-2016
06:44 PM
I tried to add privileges from HBASE its not letting me .
hbase(main):003:0> [hdfs@hadoop1 ~]$ kinit hive
Password for hive@abc.com:
[hdfs@hadoop1 ~]$
[hdfs@hadoop1 ~]$
[hdfs@hadoop1 ~]$ hbase shell
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 1.1.2.2.5.0.0-1245, r53538b8ab6749cbb6fdc0fe448b89aa82495fb3f, Fri Aug 26 01:32:27 UTC 2016
hbase(main):001:0> whoami
hive@abc.com (auth:KERBEROS)
groups: hadoop
hbase(main):002:0> grant 'sami', 'RWXCA'
ERROR: org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=hive@abc.com, scope=GLOBAL, action=ADMIN)
at org.apache.hadoop.hbase.security.access.AccessController.requirePermission(AccessController.java:438)
at org.apache.hadoop.hbase.security.access.AccessController.grant(AccessController.java:2216)
at org.apache.hadoop.hbase.protobuf.generated.AccessControlProtos$AccessControlService$1.grant(AccessControlProtos.java:9933)
at org.apache.hadoop.hbase.protobuf.generated.AccessControlProtos$AccessControlService.callMethod(AccessControlProtos.java:10097)
at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7716)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1895)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1877)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:32299)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2127)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:107)
at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
at java.lang.Thread.run(Thread.java:745)
Here is some help for this command:
Grant users specific rights.
Syntax : grant <user> <permissions> [<@namespace> [<table> [<column family> [<column qualifier>]]]
permissions is either zero or more letters from the set "RWXCA".
READ('R'), WRITE('W'), EXEC('X'), CREATE('C'), ADMIN('A')
Note: Groups and users are granted access in the same way, but groups are prefixed with an '@'
character. In the same way, tables and namespaces are specified, but namespaces are
prefixed with an '@' character.
For example:
... View more
12-16-2016
06:03 PM
can you please give me an example on how ? also whats the role of HBASE ranger plugin if without it being enabled we still need to grant privileges?
... View more
12-16-2016
04:22 PM
but ranger plugin for HBASE is not enabled , why Ranger permissions to be set then ? and the HBASE security tab in Ranger is disabled for this reason . its not letting me set any privileges .
... View more
12-16-2016
03:37 PM
since I have installed Ranger I cant create a table in HBASE using the following command, see the error below also. even though HBASE ranger plugin is not enabled . I have the Kerberos ticket 16/12/16 10:29:56 INFO mapreduce.HBaseImportJob: Creating missing HBase table AUDIT_TOUR
16/12/16 10:29:56 ERROR tool.ImportTool: Encountered IOException running import job: org.apache.hadoop.hbase.security.AccessDeniedException: org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions (user=sami@abc.com, scope=default, params=[namespace=default,table=default:AUDIT_TOUR,family=TOUR],action=CREATE)
at org.apache.hadoop.hbase.security.access.AccessController.requireNamespacePermission(AccessController.java:624)
at org.apache.hadoop.hbase.security.access.AccessController.preCreateTable(AccessController.java:993)
at org.apache.hadoop.hbase.master.MasterCoprocessorHost$11.call(MasterCoprocessorHost.java:222)
command issued sqoop import --connect "jdbc:oracle:thin:@(description=(address=(protocol=tcp)(host=patronQA)(port=1526))(connect_data=(service_name=patron)))" --username PATRON --password XXXX --table PATRON.AUDIT_TOUR_SMALL --hbase-table AUDIT_TOUR --column-family TOUR --hbase-row-key "TOUR_ID" --hbase-create-table --columns "PLAZA_ID,REV_DAY_ID,LANE_ID,HOST_EMP_ID" -m 1
... View more
Labels:
12-08-2016
02:56 AM
yes that did the trick , but its a different command than I was using ,so how does this command works? so far I am using "kinit <username>" to get tickets and when I do this it asks for a password but your command did not ask for a password , why ?
... View more
12-07-2016
10:30 PM
all the activities that I used to perform as hdfs should now be performed as which user since hdfs user is not in KDC by default ? or do I have to add the hdfs user to KDC and then add it to the HIVE/HDFS plugins? I tried using the dfsadmin command but its failing . [root@hadoop1 ~]# sudo -u hdfs hdfs balancer -threshold 1
16/12/07 17:30:01 INFO balancer.Balancer: Using a threshold of 1.0
16/12/07 17:30:01 INFO balancer.Balancer: namenodes = [hdfs://hadoop1.tolls.dot.state.fl.us:8020]
16/12/07 17:30:01 INFO balancer.Balancer: parameters = Balancer.BalancerParameters [BalancingPolicy.Node, threshold = 1.0, max idle iteration = 5, #excluded nodes = 0, #included nodes = 0, #source nodes = 0, #blockpools = 0, run during upgrade = false]
16/12/07 17:30:01 INFO balancer.Balancer: included nodes = []
16/12/07 17:30:01 INFO balancer.Balancer: excluded nodes = []
16/12/07 17:30:01 INFO balancer.Balancer: source nodes = []
Time Stamp Iteration# Bytes Already Moved Bytes Left To Move Bytes Being Moved
16/12/07 17:30:01 WARN ipc.Client: Exception encountered while connecting to the server :
javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
... View more
Labels: