Member since
04-22-2016
931
Posts
46
Kudos Received
26
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1474 | 10-11-2018 01:38 AM | |
1846 | 09-26-2018 02:24 AM | |
1803 | 06-29-2018 02:35 PM | |
2377 | 06-29-2018 02:34 PM | |
5314 | 06-20-2018 04:30 PM |
05-04-2016
09:28 PM
I created the directory and granted permissions but now it just hangs . all services are up except knox.
[hdfs@ip-172-31-11-180 ~]$ beeline
WARNING: Use "yarn jar" to launch YARN applications.
Beeline version 1.2.1.2.3.4.0-3485 by Apache Hive
beeline> !connect jdbc:hive2://SecondaryMaster:10000
Connecting to jdbc:hive2://SecondaryMaster:10000
Enter username for jdbc:hive2://SecondaryMaster:10000: hadoop
Enter password for jdbc:hive2://SecondaryMaster:10000: ******
Connected to: Apache Hive (version 1.2.1.2.3.4.0-3485)
Driver: Hive JDBC (version 1.2.1.2.3.4.0-3485)
Transaction isolation: TRANSACTION_REPEATABLE_READ
0: jdbc:hive2://SecondaryMaster:10000> INSERT INTO customers (id, firstname, lastname) VALUES (1, 'John', 'Smith');
INFO : Tez session hasn't been created yet. Opening session
INFO : Tez session hasn't been created yet. Opening session
INFO : Tez session hasn't been created yet. Opening session
... View more
05-04-2016
08:59 PM
[hdfs@ip-172-31-11-180 ~]$ hdfs dfs -chown -R hadoop /user/hadoop
chown: `/user/hadoop': No such file or directory
[hdfs@ip-172-31-11-180 ~]$
... View more
05-04-2016
08:49 PM
hi Manjee how can I change the permission of a directory that does not exist?
... View more
05-04-2016
08:15 PM
also shall I put the change that I made in core-site.xml file back ?
... View more
05-04-2016
08:07 PM
I saw this on web and after the following change the error has also changed . "For me it was solved by changing the address that the service was listening on in /etc/hadoop/conf/core-sitse.xml. Mine was previously listening on "localhost:8020." (127.0.0.1) <configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://0.0.0.0:8020</value>
</property> && then bounce the service with hadoop " NOW THE ERROR I GET IS : 0: jdbc:hive2://SecondaryMaster:10000> INSERT INTO customers (id, firstname, lastname) VALUES (1, 'John', 'Smith');
INFO : Tez session hasn't been created yet. Opening session
ERROR : Failed to execute tez graph.
org.apache.hadoop.security.AccessControlException: Permission denied: user=INSERT INTO customers (id, firstname, lastnaALUES (1, 'John', 'Smith');, access=WRITE, inode="/user/INSERT INTO customers (id, firstname, lastname) VALUES (1, 'JohSmith');":hdfs:hdfs:drwxr-xr-x
... View more
05-04-2016
08:01 PM
but why its accessing /user/hadoop ? I don't even have this directory [hdfs@ip-172-31-11-180 ~]$ hdfs dfs -ls /user
Found 11 items
-rw-r--r-- 3 hdfs hdfs 124 2016-04-28 17:42 /user/a.log
drwx------ - accumulo hdfs 0 2016-04-28 14:57 /user/accumulo
drwxrwx--- - ambari-qa hdfs 0 2016-05-04 11:53 /user/ambari-qa
-rw-r--r-- 3 hdfs hdfs 124 2016-04-28 17:43 /user/b.log
drwxr-xr-x - hcat hdfs 0 2016-04-28 14:57 /user/hcat
drwxr-xr-x - hdfs hdfs 0 2016-05-04 12:02 /user/hdfs
drwx------ - hive hdfs 0 2016-05-04 15:39 /user/hive
drwxrwxr-x - oozie hdfs 0 2016-04-28 14:57 /user/oozie
drwxrwxr-x - spark hdfs 0 2016-04-28 14:55 /user/spark
[hdfs@ip-172-31-11-180 ~]$
... View more
05-04-2016
07:07 PM
I am connected to HIVE using hadoop user which I created as Admin but I am still getting errors while trying to insert . 0: jdbc:hive2://SecondaryMaster:10000> INSERT INTO customers (id, firstname, lastname) VALUES (1, 'John', 'Smith');
INFO : Tez session hasn't been created yet. Opening session
ERROR : Failed to execute tez graph.
org.apache.hadoop.security.AccessControlException: Permission denied: user=hadoop, access=WRITE, inode="/user/hadoop":hdfs:hdfs:drwxr-xr-x
... View more
Labels:
- Labels:
-
Apache Hive
05-02-2016
05:54 PM
ah dumb me . I had choosen secondaryMaster node to run yarn , but I was giving yarn node list command on the Master. from SecondaryMaster node the command is working fine [yarn@ip-172-31-11-180 ~]$ yarn node -list
16/05/02 13:55:02 INFO impl.TimelineClientImpl: Timeline service address: http://ip-172-31-11-180.ec2.internal:8188/ws/v1/timeline/
16/05/02 13:55:02 INFO client.RMProxy: Connecting to ResourceManager at ip-172-31-11-180.ec2.internal/172.31.11.180:8050
Total Nodes:3
Node-Id Node-State Node-Http-Address Number-of-Running-Containers
ip-172-31-11-179.ec2.internal:45454 RUNNING ip-172-31-11-179.ec2.internal:8042 0
ip-172-31-11-181.ec2.internal:45454 RUNNING ip-172-31-11-181.ec2.internal:8042 0
ip-172-31-11-182.ec2.internal:45454 RUNNING ip-172-31-11-182.ec2.internal:8042 0
... View more
05-02-2016
05:35 PM
from the web dash board it works though so resourcemanager and nodemanagers must be up . wondering why its not working from command prompt , how can I debug ? yarnnodelist.jpg
... View more
05-02-2016
05:23 PM
hi Ravi the command you gave earlier fixed the issue hdfs dfs -setrep -w 3 / thanks a lot
... View more
- « Previous
- Next »