Re: Hive ARRAY column INSERT INTO SELECT FROM exce...

rpathak · ‎07-21-2016

show create table t11; What you get in output?

rpathak · ‎07-21-2016

@payal patel What you see when you run show create table <tablename>; ?

rpathak · ‎07-20-2016

This was confirmed as bug and fixed in Ambari 2.4 https://issues.apache.org/jira/browse/AMBARI-17339

rpathak · ‎07-20-2016

It is throwing error for user mgrabowski Have you allowed this user to submit jobs to yarn or is this user part of allowed groups?

rpathak · ‎07-19-2016

Falcon server is throwing NoSuchMethodError for activemq on start: Tried removing all data from /hadoop/falcon/embeddedmq/data and /hadoop/falcon/store but error persists: error log says Exception in thread "main" java.lang.NoSuchMethodError: org.apache.activemq.transport.TransportFactory.bind OS Ubuntu 14.04

rpathak · ‎07-14-2016

@Roberto Sancho Check this https://community.hortonworks.com/questions/40121/about-hue-access-hdfs-ha.html

rpathak · ‎07-13-2016

@Divakar Annapureddy I doubt log4j will work with hdfs. Try setting the file location on native linux path, something like /var/log/spark/spark.log

rpathak · ‎07-12-2016

@sidharth mishra I find http://stackoverflow.com/questions/6153560/hbase-client-connectionloss-for-hbase-error will be helpful in your case.

rpathak · ‎07-12-2016

@Niraj Parmar Yes you can. More details will help you in getting more accurate answers.

rpathak · ‎07-06-2016

@ScipioTheYounger should I just pick one for source cluster such as in the following: https://community.hortonworks.com/questions/9416/falcon-with-ha-resource-manager.html <interface type="execute" endpoint="RM1:8050" version="2.2.0" /> Yes that is correct. How do we define "hive.metastore.kerberos.principal" Refer https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.2/bk_installing_manually_book/content/configuring_for_secure_clusters_falcon.html

rpathak · ‎07-05-2016

@Anshul Sisodia As Kuldeep pointed out when you have your RM in HA mode, yarn.resourcemanager.address value is not used to bind the port. Instead it uses port specified in yarn.resourcemanager.address.{rm1,rm2} for respective RMs. By default the value is 8032. Also Ambari do not set this by default.

rpathak · ‎07-01-2016

Root node is nothing but znodes/v1/

rpathak · ‎07-01-2016

@Roberto Sancho If you have already started zookeeper rest service then by default port will be 9998 on host running rest service. Refer this https://github.com/apache/zookeeper/tree/trunk/src/contrib/rest for installing and starting rest.

rpathak · ‎07-01-2016

@Shihab Can you try deleting the topic test1. Replace localhost with zookeeper host in below command. bin/kafka-topics.sh --zookeeper localhost:2181 --delete --topic test1

rpathak · ‎06-30-2016

@Saurabh KumarCan you verify that you see same as in below screenshots? Step 2 Step 3 Step 4

rpathak · ‎06-29-2016

Check this https://docs.hortonworks.com/HDPDocuments/Ambari-2.2.2.0/bk_ambari_views_guide/content/_setup_WebHCat_proxy_user_pig_view.html

rpathak · ‎06-29-2016

When you boot sandbox it says Press any key to enter menu. Press any key and then start from step 2

rpathak · ‎06-29-2016

@mayki wogno You need to place <ACL owner="falcon"group="hadoop" permission="0755"/> before <schema location="hcat" provider="hcat"/> Ordering is important. Also remove <table uri="catalog:falcon_landing_db:summary_table#ds=${YEAR}-${MONTH}"/> from source cluster. It is not required.

rpathak · ‎06-29-2016

1. Go to grub menu 2. Select line starting with kernel and press e 3. In next screen add s at end of line and press enter. 4. In next screen press b which will log you in as root without password. 5. Change password using passwd.

rpathak · ‎06-28-2016

In this case below command should work for you. scp /cygdrive/c/Users/rnkumashi/Downloads/sample.txt root@192.168.228.128:/root

rpathak · ‎06-28-2016

Hi @Ravikumar Kumashi Can you check how is your vm network is configured? Ensure that vm network is set to NAT and port forwarding is configured. If your network is configured to host only then you need to give ip instead of localhost and remove -P 2222 from command. Can you paste the output of ifconfig from vm?

rpathak · ‎06-28-2016

@Ravikumar Kumashi Try this command instead. scp -P 2222 C:/Users/rnkumashi/Downloads/sample.txt root@localhost:/root However you need something like cygwin to make scp work from windows machine. You have to run the command from windows, not sandbox. This is a good document to get you started http://hortonworks.com/hadoop-tutorial/learning-the-ropes-of-the-hortonworks-sandbox/

rpathak · ‎06-20-2016

@Colton Rodgers Can you provide your hadoop.proxyusers.* properties settings?

rpathak · ‎06-17-2016

@Anshul Sisodia Ideally you should not worry about connecting to active RM. The failover provider class takes care of that. https://hadoop.apache.org/docs/r2.7.2/hadoop-yarn/hadoop-yarn-site/ResourceManagerHA.html#RM_Failover

rpathak · ‎06-17-2016

@Manikandan Durairaj If you have not enabled RM HA then 8050 is correct value. Please share log of failed job when you use 8050 port.

rpathak · ‎06-17-2016

In order to distcp between two HDFS HA cluster (for example A and B), using nameservice id or to setup falcon clusters having namenode ha, these settings are needed. Assuming nameservice for cluster A and B is HAA and HAB respectively. One need to set following properties in hdfs-site.xml Add value of the nameservices of both clusters in dfs.nameservices. This needs to be done in both the clusters. dfs.nameservices=HAA,HAB Add property dfs.internal.nameservices In cluster A: dfs.internal.nameservices = HAA In cluster B: dfs.internal.nameservices = HAB Add dfs.ha.namenodes.<nameservice>. dfs.ha.namenodes.HAB=nn1,nn2 dfs.ha.namenodes.HAA=nn1,nn2 Add property dfs.namenode.rpc-address.<nameservice>.<nn>. dfs.namenode.rpc-address.HAB.nn1 = <NN1_fqdn>:8020 dfs.namenode.rpc-address.HAB.nn2 = <NN2_fqdn>:8020 dfs.namenode.rpc-address.HAA.nn1 = <NN1_fqdn>:8020 dfs.namenode.rpc-address.HAA.nn2 = <NN2_fqdn>:8020 Add property dfs.client.failover.proxy.provider.<nameservice> In cluster A dfs.client.failover.proxy.provider.HAB = org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider In cluster B dfs.client.failover.proxy.provider.HAA = org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider Restart HDFS service. Once complete you will be able to run the distcp command using the nameservice similar to: hadoop distcp hdfs://HAA/tmp/file1 hdfs://HAB/tmp/

rpathak · ‎06-15-2016

What error you get?

rpathak · ‎06-15-2016

@Mukesh Burman I guess you can accept my answer. 🙂

rpathak · ‎06-15-2016

@Mukesh Burman See if this is what you are looking for. https://cwiki.apache.org/confluence/display/AMBARI/Installing+ambari-agent+on+target+hosts

rpathak · ‎06-14-2016

@kavitha velaga Have you set hadoop.proxyuser.ambari-server.hosts and hadoop.proxyuser.ambari-server.groups to * in core-site? Also please share your tez view configuration.

Online	Offline
Last Visited	‎04-26-2022 03:56 PM

Date Registered	‎05-09-2016 06:03 AM
Last Visited	‎04-26-2022 03:56 PM
Total Messages Posted	291
Total Kudos Received	53

Re: Hive ARRAY column INSERT INTO SELECT FROM exce...

Re: Hive Functions slow too much my query

Re: Set maximum containers on a Hive query

Re: How to prevent access to hive database via hiv...

Re: Unable to import hive with atlas

Re: How to validate which compression technique ha...

Re: How to validate which compression technique ha...

Re: NameNode Last Checkpoint alert for Namenode HA...

Re: Capacity scheduler - error while executing job

Unable to start falcon server

Re: huwe HA namenode doest work

Re: Spark logs location

Re: Why Storm cluster keeps on giving KeeperExcept...

Re: Can we add extra service on hdp-atlas-ranger s...

Re: Falcon support on Hadoop HA services

Re: What is the default Yarn resource manager port...

Re: zookeeper web url

Re: zookeeper web url

Re: Kafka producer error no partition metadata for...

Re: How to reset root password for sandbox hdp 2.4

Re: [FALCON] : hive replication failed

Re: How to reset root password for sandbox hdp 2.4

Re: [FALCON] : hive replication failed

Re: How to reset root password for sandbox hdp 2.4

Re: Trying to copy file from my windows machine to...

Re: Trying to copy file from my windows machine to...

Re: Trying to copy file from my windows machine to...

Re: Pig View Will Not Run, but Grunt CLI Will

Re: What is the default Yarn resource manager port...

Re: jobtracker port

Making your cluster aware of multiple Namenode HA

Re: jobtracker port

Re: Automated way of adding a host to an ambari ma...

Re: Automated way of adding a host to an ambari ma...

Re: Tez View issue on a Kerberized Cluster