Member since
09-15-2015
294
Posts
764
Kudos Received
81
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1597 | 07-27-2017 04:12 PM | |
4344 | 06-29-2017 10:50 PM | |
2027 | 06-21-2017 06:29 PM | |
2278 | 06-20-2017 06:22 PM | |
2068 | 06-16-2017 06:46 PM |
03-14-2017
10:21 PM
1 Kudo
Please try as below post suggests: https://community.hortonworks.com/questions/9142/getting-virtualbox-error-while-importing-virtual-a.html
... View more
03-14-2017
08:50 PM
13 Kudos
Proxy user - Superusers Acting On Behalf Of Other Users
A superuser with username ‘super’ wants to submit job and access hdfs on behalf of a user joe. The superuser has kerberos credentials but user joe doesn’t have any. The tasks are required to run as user joe and any file accesses on namenode are required to be done as user joe. It is required that user joe can connect to the namenode or job tracker on a connection authenticated with super’s kerberos credentials. In other words super is impersonating the user joe. Some products such as Apache Oozie need this. Configurations You can configure proxy user using properties hadoop.proxyuser.$superuser.hosts along with either or both of hadoop.proxyuser.$superuser.groups and hadoop.proxyuser.$superuser.users. By specifying as below in core-site.xml, the superuser named super can connect only from host1 and host2 to impersonate a user belonging to group1 and group2. <property>
<name>hadoop.proxyuser.super.hosts</name>
<value>host1,host2</value>
</property>
<property>
<name>hadoop.proxyuser.super.groups</name>
<value>group1,group2</value>
</property> If these configurations are not present, impersonation will not be allowed and connection will fail. If more lax security is preferred, the wildcard value * may be used to allow impersonation from any host or of any user. For example, by specifying as below in core-site.xml, user named oozie accessing from any host can impersonate any user belonging to any group. <property>
<name>hadoop.proxyuser.oozie.hosts</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.oozie.groups</name>
<value>*</value>
</property> More details in below Apache Documentation: https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-common/Superusers.html
... View more
03-14-2017
10:00 AM
2 Kudos
@Viswa
To check Namenode Safe mode status, Login to Namenode host and issue the below command, [user@NNhost1 ~]$ hdfs dfsadmin -safemode get
Safe mode is OFF in NNhost1/10.X.X.X:8020
Safe mode is OFF in NNhost2/10.X.X.X:8020
If Safe mode is turned ON, please issue the below command to leave from safemode.
[user@NNhost1 ~]$ hdfs dfsadmin -safemode leave
... View more
03-13-2017
04:23 PM
1 Kudo
@Suzanne Dimant Hortonworks Sandbox for HDP 2.5 comes with Ambari version 2.4.0.0.
... View more
03-07-2017
10:14 PM
1 Kudo
I was able to edit my article now. Seems like there was an issue yesterday (not sure what was it though) as @Artem Ervits and @Jay SenSharma mentioned.
... View more
06-06-2018
11:57 AM
Dominika: I need to add: S3 is not a real filesystem. You cannot safely use AWS S3 it as a replacement for HDFS without a metadata consistency layer, and even then the eventual consistency of S3 updates and deletes cause problems. you can safely use it as a source of data. To use as a direct destination of work takes care: consult the documentation specific to the version of Hadoop you are using before trying to make S3 the default filesystem. Special case: third party object stores with full consistency. The fact that directory renames are not atomic may still cause problems with commit algorithms and the like, but the risk of corrupt data in the absence of failures is gone.
... View more
03-03-2017
11:00 AM
Set your hadoop path in .bashrc.
... View more
03-01-2017
05:06 AM
1 Kudo
hive> USE DB1; Now, commands such as SHOW TABLES, will list the tables in this database DB1
... View more
11-23-2017
11:05 AM
I get this error while trying to start zookeeper: /usr/hdfp/2.6.3-235/zookeeper/bin/zkServer.sh start /zkServer.sh: Permission denied
... View more
02-24-2017
12:05 AM
1 Kudo
Great to hear you resolved the issue
... View more
- « Previous
- Next »