https://hadoop.apache.org/docs/r2.4.1/hadoop-yarn/hadoop-yarn-site/FairScheduler.html ... View more

Have you configured queue placement policies for Fair Scheduler?   Thanks, Megh ... View more

@somesh , I think you should set the referral property to "follow" ... View more

Can you please clarify whether you want to connect the back end database of the web portal? Or you want to consume a Web API ?   If the answer to the first question is yes then Sqoop is the tool you're looking for. In the other case, you can consume the data in real-time with Nifi and Kafka.   Thanks, Megh ... View more

I also had the exact same error.   I'm sure it is indicating that something is wrong with the Fair Scheduler config. If this setup is currently under test, can you check whether you're able to get it working with Capacity Scheduler?   This will help us isolate that the issue is indeed related to YARN scheduler.   Thanks, Megh ... View more

Hi @hui666 ,   It would be helpful if you could give more details for your question e.g. 1) connection details (omiting sensitive details like credentials and IPs/Hostnames) 2) Whether you're using SSL/Kerberos/both? 3) Is there any authorization mechanism configured with Ranger/HDFS ACLs   Right now the question seems very unclear.   Thanks, Megh ... View more

Hi,   Can you share the impalad.FATAL error log from one of your impala Daemons?   Thanks, Megh ... View more

Hi @dmharshit ,   Can you share the log snippets from Hive Metastore, Hiveserver2 and YARN ResourceManager from the timeframe of execution of this query?   Thanks, Megh ... View more

Hi,   I had got this same error when I changed my YARN scheduler from Capacity Scheduler to Fair Scheduler. I reverted to capacity scheduler and it went away.   Is it the case with you as well?   Thanks, Megh ... View more

I think the repo itself is broken.   navigating to http://repos.bigtop.apache.org/releases/1.5.0/centos/7/$basearch, takes to this: <Error> <Code>NoSuchKey</Code> <Message>The specified key does not exist.</Message> <Key>releases/1.5.0/centos/7/$basearch</Key> <RequestId>K3BYRJWH03RKGFVK</RequestId> <HostId>l+++bHT4W/dNczJrC5KWH7vPQ4dydVA6kLD69001OO8XQKpj6ziHZxLIsVCEIBsoZZT7o+1ILEQ=</HostId> </Error>   Can you point to the documentation you're referring for this installation?   Thanks, Megh ... View more