Member since
04-20-2017
6
Posts
0
Kudos Received
0
Solutions
06-22-2017
08:50 AM
Thanks Jay for your prompt response. Yes the host name set up is as per the links you mentioned. hostname -f returns the FQDN in all the hosts. I am using fully qualified domain name. so my entries in /etc/hosts are like 10.xx.xx.xx ILDSM.xyz.abc.in ILDSM 192.xxx.xx.xx ILDSM1.xyz.abc.in ILDSM1 Can we use only hostname? without FQDN? I have one question when we register the hosts in abmari, do we need to give the hostname that is associated with the public IP or the internal IP? I have used internal ip.
https://ildsm.:8440 is not reachable -- how to fix this? Is this because the IP is internal and not accessible? or https is causing the issue.? My ambari server runs with the IP and failing to load if I provide the hostname http://10.xxx.x.xx:8080 - loads http://ildsm:8080 or http://ildsm:8080 -- fails. Please guide me to resolve these.
... View more
06-22-2017
06:50 AM
Hi, I am setting up a cluster with 4 slaves and a master. The master has public IP and internal IP. The Ambari server is accessible through public IP. Our etc/hosts has both entries for public and internal IP. 10.xx.xx.xx ILDSM.<domain> ILDSM
192.xxx.xx.xx ILDSM1.<domain> ILDSM1 I am using internal IP to register hosts in ambari. But it fails. My passwordless ssh is set. SeLinux is disabled(permissive), GSSAPIAuthentication=NO. Full log and configuration files are attached. Connecting to https://ildsm.<domainname>:8440/ca
', None)
('WARNING 2017-06-22 11:26:51,227 NetUtil.py:116 - Server at https://ildsm.<domainname>:8440 is not reachable, sleeping for 10 seconds...
INFO 2017-06-22 11:27:01,227 NetUtil.py:62 - Connecting to https://ildsm.<domainname>:8440/ca
WARNING 2017-06-22 11:27:01,228 NetUtil.py:93 - Failed to connect to https://ildsm.<domainname>:8440/ca due to [Errno 111] Connection refused
WARNING 2017-06-22 11:27:01,228 NetUtil.py:116 - Server at https://ildsm.<domainname>:8440 is not reachable, sleeping for 10 seconds...
INFO 2017-06-22 11:27:11,229 NetUtil.py:62 - Connecting to https://ildsm.<domainname>:8440/ca
Why does it try to connect via https? [https://ildsm.<domainname>:8440] I am able to telnet to port 8440. I am not able to hit this url https://ildsm.<domainname>:8440 since this is an internal IP but the Ambari serevr GUI lods via the http://PublicIP:8080. I am not sure where I am going wrong. Please help. ambari-agent-host-exception.txtambari-server-host-exception.txtambari-agent.txt
... View more
Labels:
05-18-2017
05:53 AM
I will verify these parameters and run my tests. Thanks Jon.
... View more
05-17-2017
11:31 AM
@Jon Roberts Thanks, Jon for your valuable inputs. I too was skeptical about the results, so wanted some feedback. As you mentioned " If you are only concerned with single user query performance, there are some configuration changes you can make to get HAWQ to perform better." Could you please help me to tune hawq for single user? How do you run concurrency tests for hawq? I was not able to find any query set or stream_map.txt for hawq under TPC-DS/07_multi_userfolder. Could you please guide me on how to perform this test? Again, Thanks a ton! I will rerun the tests, considering the above inputs with max number of queries possible.
... View more
04-20-2017
07:27 AM
hawq-vs-spark-verify.pdf
... View more
04-20-2017
07:25 AM
Hello everyone, We ran a subset of 19 TPC-DS queries for HAWQ & SparkSQL on Hadoop. Ref: https://github.com/databricks/spark-sql-perf https://github.com/pivotalguru/TPC-DS I would like to request the community to help me validate the numbers. I am attaching the results and the system set-up. Please share your comments. Thanks, Tania
... View more
Labels:
- Labels:
-
Apache Spark