Member since
07-23-2018
11
Posts
1
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2342 | 08-21-2018 04:36 PM |
08-28-2018
03:07 PM
Hello! How to monitoring (debugging) hive and tez queries with Ambari 2.7 (HDP-3.0)? If not exists the Hive/Tez views what we should using for this tasks?
I want view a query status, resources used, query plan ...
... View more
Labels:
08-21-2018
04:36 PM
1 Kudo
HI! I solved my issue... I had strange FQDN's of my servers (ended of dot), I could connected through ssh but I had issue in Ambari.
I changed FQDN's and resolve my issue. Thanks all for your time.
... View more
08-20-2018
08:58 AM
Hi Vinicius Higa Murakami ! # python2 -c "import urllib2,json; print(json.loads(urllib2.urlopen('https://www.howsmyssl.com/a/check').read())['tls_version'])"
> TLS 1.2
# openssl ciphers -v | awk '{print $2}' | sort | uniq
> SSLv3
> TLSv1.2 Is there way enable "debug mode" for the ambari-agent and see how it do connect to the server?
... View more
08-17-2018
11:33 AM
@Vinicius Higa Murakami PROTOCOL_SSLv23
PROTOCOL_TLSv1
PROTOCOL_TLSv1_1
PROTOCOL_TLSv1_2
... View more
08-16-2018
11:40 AM
Hello! My ambari-server and it's agent locate on the same server. Both configured as non-root user start. Ambari-agent was installed manualy. > javac -version
javac 1.8.0_181 > java -version
java version "1.8.0_181"
Java(TM) SE Runtime Environment (build 1.8.0_181-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.181-b13, mixed mode) > echo $JAVA_HOME
/usr/jdk64/jdk1.8.0_181 > echo $PATH
/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/usr/jdk64/jdk1.8.0_181/bin > ambari.properties
java.home=/usr/jdk64/jdk1.8.0_181
jdk.name=jdk-8u181-linux-x64.tar.gz
jdk1.8.dest-file=jdk-8u181-linux-x64.tar.gz
jdk1.8.home=/usr/jdk64/jdk1.8.0_181
stack.java.home=/usr/jdk64/jdk1.8.0_181
stack.jdk.name=jdk-8u181-linux-x64.tar.gz > grep 'jdk.tls.disabledAlgorithms' $JAVA_HOME/jre/lib/security/java.security
# jdk.tls.disabledAlgorithms=MD5, SSLv3, DSA, RSA keySize < 2048
jdk.tls.disabledAlgorithms=SSLv3, RC4, MD5withRSA, DH keySize < 1024, \ I checked the ambari-server log but I not found error messages (only info without intresting things). Also, I set into /etc/python/cert-verification.cfg: [https]
verify=disable Unfortunatly, I still see error on ambari-agent log: [SSL: TLSV1_ALERT_INTERNAL_ERROR] tlsv1 alert internal error (_ssl.c:590) SSLError: Failed to connect. Please check openssl library versions.
... View more
08-15-2018
05:56 PM
Hello! I installed the Ambari server and it's agents (HDP-3.0.0) on the my servers (Ubuntu 18.04, Python 2.7.12) I see error in the ambari agent log file: [SSL: TLSV1_ALERT_INTERNAL_ERROR] tlsv1 alert internal error (_ssl.c:590) SSLError: Failed to connect. Please check openssl library versions. I set force_https_protocol=PROTOCOL_TLSv1_2 into ambari-agent.ini file, but it not resolved this issue... My openSSL: OpenSSL 1.0.2g 1 Mar 2016 Can anybody help me?
... View more
Labels:
08-05-2018
08:27 PM
Hello! I can't found any information about storage handler for Postgres... Can anybody show example, how to I create hive table through jdbc from postgres?
... View more
Labels:
- Labels:
-
Apache Hive
07-23-2018
09:37 AM
Hello! Can anyone help me? I upload the CSV files into HDFS and then throw them in the Hive as: create temporary external table test ( dt TIMESTAMP, uid INT ) row format delimited fields terminated by '|' stored as textfile location '/my_files/test'; insert into table my_table partition(name, md) select dt, uid, name, md from test; if the files are small then everything is fine, but if the size is large the process falls on the insert with an error: Error during job, getting debugging information ... Examining task ID: task_1522750657070_0091_m_000001 (and more) from job job_1522750657070_0091 Examining task ID: task_1522750657070_0091_r_000001 (and more) from job job_1522750657070_0091 Task with the most failures (4): ----- Task ID: task_1522750657070_0091_m_000002 URL: http://hadoop-namenode.mech.com:8088/taskdetails.jsp?jobid=job_1522750657070_0091&tipid=task_1522750657070_0091_m_000002 ----- Diagnostic Messages for this Task: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask in the YARN logs I see the following: WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child: java.net.ConnectException: Call From hadoop-datanode02.prod.analytics.wz-ams.lo.mobbtech.com/127.0.1.1 to hadoop- datanode02.prod.analytics.wz-ams.lo.mobbtech.com:22232 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused all other messages INFO only is this the cause of the insert error? what else can I look to solve the problem? I met the mention that the error code 2 is a memory problem ... Is it so?
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache YARN