Member since
03-23-2015
1288
Posts
114
Kudos Received
98
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2522 | 06-11-2020 02:45 PM | |
4051 | 05-01-2020 12:23 AM | |
2131 | 04-21-2020 03:38 PM | |
2095 | 04-14-2020 12:26 AM | |
1719 | 02-27-2020 05:51 PM |
07-04-2019
09:55 PM
1 Kudo
Hi @Sidhartha, The error means that the destination table base.customers already has the partition source_name=ORACLE, as the error indicated: Partition already exists [customers(source_name=ORACLE)] Can you run : SHOW PARTITIONS base.customers; to confirm? If yes, try to drop it and then run EXCHANGE PARTITION again. Cheers Eric
... View more
06-28-2019
02:47 AM
I did a quick research on why rhel7/centos7 still contains such an old mysql java connector/driver version (see "Redhat response"), and checked for working alternative RPMs (as installing via an rpm has many advantages vs a manual tarball install) There are many working RPMs (I tested all of below, with CDH 6.2.0 and openjdk-8): - With Java >=v8, I recommend following: Ref: https://centos.pkgs.org/7/mysql-connectors-i386/mysql-connector-java-8.0.16-1.el7.noarch.rpm.html RPM: yum install http://repo.mysql.com/yum/mysql-connectors-community/el/7/i386//mysql-connector-java-8.0.16-1.el7.noarch.rpm - With Java v7 you can try the latest 5.1.x from Fedora: Ref: https://fedora.pkgs.org/29/fedora-x86_64/mysql-connector-java-5.1.38-7.fc29.noarch.rpm.html RPM: http://download-ib01.fedoraproject.org/pub/fedora/linux/releases/29/Everything/x86_64/os/Packages/m/mysql-connector-java-5.1.38-7.fc29.noarch.rpm - Find RPMs for other distros: https://pkgs.org/download/mysql-connector-java - Official Redhat response: Alternatively, for Java-8, Redhat proposes to use the MariaDB client: https://bugzilla.redhat.com/show_bug.cgi?id=1684349#c7 > this is the best we could do for the customers who need a recent version of the JDBC driver for MySQL/MariaDB. More infos: https://developers.redhat.com/blog/2019/06/25/mariadb-10-3-now-available-on-red-hat-enterprise-linux-7/ For centos7: https://centos.pkgs.org/7/centos-sclo-rh-testing-x86_64/rh-mariadb103-mariadb-java-client-2.4.1-1.el7.noarch.rpm.html I tested the 1-line yum install, but CDH would require more changes, due to the driver installed in /opt: yum install https://buildlogs.centos.org/centos/7/sclo/x86_64/rh/rh-mariadb103/rh-mariadb103-mariadb-java-client-2.4.1-1.el7.noarch.rpm https://buildlogs.centos.org/centos/7/sclo/x86_64/rh/rh-mariadb103/rh-mariadb103-runtime-3.3-3.el7.x86_64.rpm
... View more
06-26-2019
08:26 AM
Hello, Finally I was able to add values into partition table after much reading into the concepts and trial & error. However the load file is still not working and also I came to know while doing that when we specify partition value into query it actually is treated as column. insert into tbl_raw_v12 partition(source_ip="192.168.1.10",destination_ip="172.16.8.177",year,event_date) select * from tbl_123; I managed to add 50k values, tbl_raw_v12 contained 29 columns and tbl_123 contains 27 columns and remaining two column values are added through insert query at runtime. I will try with more values tomorrow to check performance. Thanks
... View more
06-20-2019
12:11 AM
@EricL I will replicate the issue and will share suggested screenshots with you, meanwhile can you give me some idea about how we can get individual query written in panel from HUE metadata tables. I looked into HUE metadata table desktop_document2 and seen that it stores complete JSON object regarding information of user's HUE query panel. Snippets property of stored JSON object has another property statement_raw which contains all query statements written within HUE panel. Somehow i want to extract individual query statement from HUE panel.
... View more
06-19-2019
04:42 PM
1 Kudo
Hi Mogiking, On the version I was testing (CDH 6.2) the duration looks correct, but the queries do not show up until they are completely closed. I was able to force this from the Impala Daemon Web UI, or by waiting, or by closing hue. -Andrew
... View more
06-19-2019
04:05 PM
Where do you put the jar file? Is it under /usr/share/java?
... View more
06-13-2019
11:49 AM
1 Kudo
So IDLE_SESSION_TIMEOUT doesn't actually do anything if you set it in impala-shell. There's a technical distinction here - "set" in impala-shell is implemented in the shell itself, then send along with the queries. Whereas if you run "set" as a statement through, say, the JDBC driver, then "set" is run as a server-side command that modifies the session state. I tried to reproduce the issue on my local Impala environment, but couldn't. I was watching the /sessions page in the debug page and I could see the "last accessed" time get continually incremented while the query was in the queue. I think any timeout issue probably got indirectly fixed by https://issues.apache.org/jira/browse/IMPALA-5216 in CDH6.1/Impala 3.1, since the query state would be polled directly by impala-shell while the query is in the queue, rather than having impala-shell blocked waiting for a response. Thanks for submitting the support request, that should help get to the bottom of this.
... View more
06-13-2019
09:47 AM
Hi Eric, The user= and password= parameters worked once I put the connection string in single quotes ' '. This is an example of what worked. [user@serverHostName ~]$ beeline -u 'jdbc:hive2://serverFQDN:10000/demo;ssl=true;sslTrustStore=/opt/jdk/hive.truststore.jks;trustStorePassword=trustPassword;user=testUser;password=testUserPassword' Double qoutes should work too. Thanks for the help!
... View more
06-12-2019
11:31 PM
@Yeseswini Hive's VIEW is ready only, please see below doc: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-Create/Drop/AlterView >> Views are read-only and may not be used as the target of LOAD/INSERT/ALTER. Insert or update is not supported. Thanks Eric
... View more
06-12-2019
11:25 PM
Hi @csegokul It sounds weird Hue behaves this way, I have never heard such thing that you need to logout and log back into Hue to get Hive results, something is not correct. Did Hue report any issues/errors in the interface? Cheers Eric
... View more