Member since
01-08-2018
133
Posts
31
Kudos Received
21
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
17367 | 07-18-2018 01:29 AM | |
3122 | 06-26-2018 06:21 AM | |
5285 | 06-26-2018 04:33 AM | |
2716 | 06-21-2018 07:48 AM | |
2255 | 05-04-2018 04:04 AM |
03-12-2018
09:29 AM
1 Kudo
CDH is a collection of components. When you upgrade CDH, you actually upgrade all of them: https://www.cloudera.com/developers/inside-cdh.html
... View more
03-12-2018
02:25 AM
Hi Lars, I totally agree with you on that. I was not clear, so let me rephrase it. Without the fix, the below command runs successfully: $ impala-shell -i localhost:21000 -q "select 'Ѳ'" While, the below command, fails: $ impala-shell -i localhost:21000 -q "select 'Ѳ'" -o tmp Starting Impala Shell without Kerberos authentication Connected to localhost:21000 Server version: impalad version 2.10.0-cdh5.13.2 RELEASE (build dc867db57915f55b697ef8cd9e00404a9385231a) Query: select 'Ѳ' Query submitted at: 2018-03-12 10:20:07 (Coordinator: http://localhost:25000) Query progress can be monitored at: http://localhost:25000/query_plan?query_id=7c476a1defbdad29:de8ff88700000000 Unknown Exception : 'ascii' codec can't encode character u'\u0473' in position 11: ordinal not in range(128) Could not execute command: select 'Ѳ' But when I use the first command with redirect, fails also, which is not expected: $ impala-shell -i localhost:21000 -q "select 'Ѳ'" > tmp
Starting Impala Shell without Kerberos authentication
Connected to localhost:21000
Server version: impalad version 2.10.0-cdh5.13.2 RELEASE (build dc867db57915f55b697ef8cd9e00404a9385231a)
Query: select 'Ѳ'
Query submitted at: 2018-03-12 10:22:12 (Coordinator: http://localhost:25000)
Query progress can be monitored at: http://localhost:25000/query_plan?query_id=f74a6fde13e4760a:a323131d00000000
Unknown Exception : 'ascii' codec can't encode character u'\u0473' in position 11: ordinal not in range(128)
Could not execute command: select 'Ѳ' But, as I mentioned before, this is @epowell's post. I just expressed my concern.
... View more
03-09-2018
07:14 AM
Hi Lars, this is exactly the issue, at least for CDH5.13.2. I have applied the patch to /opt/cloudera/parcels/CDH/lib/impala-shell/lib/shell_output.py map(self.prettytable.add_row, rows)
- return self.prettytable.get_string()
+ return self.prettytable.get_string().encode('utf-8')
except Exception, e: and now the command runs as appropriate. Something not clear to me, I understand this patch to affect command when output file is specified with "-o file", but I do not understand it when output is redirected with "> file". It fails even you want to parse output , e.g. "| grep ...." Why is impala-shell affected when output is other than stdout? To be honest, normally there is almost no reason to parse the results (or store) without "-B" for me. On the other hand, this is @epowell issue. In my opinion, you should definitely add this patch, as everything should work with utf-8 encoding.
... View more
03-09-2018
06:26 AM
2 Kudos
What is the meaning of having kafka-sentry, when you don't have kerberos enabled? For the moment, Kerberos is the only authentication engine supported by Kafka. When you don't have Kerberos enabled, all connection are treated the same. As you can see from the log, it thinks that the username is ANONYMOUS, that's why it tries to find the group that this user belongs to. Since, the local system is not aware of any user (either local or synced to an LDAP/AD) with the name "ANONYMOUS", there is no group retrieved, so it cannot be matched to any kafka-sentry rule. It is normal that it will fail. Of course, you can create a user account "ANONYMOUS", assign it to a group and define a kafka-sentry rule with this group. But what is the meaning to that? All connections will have the same permissions.
... View more
03-08-2018
12:52 AM
1 Kudo
This is obviously an issue with the Kerberos. Checksum error isually when keytab is not created correctly. Have you manually created and distributed keytabs? If yes, then check the integrity of keytab by trying to authenticate using it (kinit). If you rely on Cloudera Manager (which is preferable) to do this job, then you should check the zookeeper node. E.g.: * /etc/krb5.conf is correct * you can authenticate to Kerberos from this node * Java Cryptography Extension (JCE) is installed and zookeeper is launched with the correct java.
... View more
03-08-2018
12:26 AM
Just quickly tested your query. The same error appears on impalad version 2.10.0-cdh5.13.1 RELEASE (build 1e4b23c4eb52dac95c5be6316f49685c41783c51) The same error appears if you use: $ impala-shell .... -o tmp which is the same as redirecting output to the file. You can always use -B, or if you want headers as well, you can use: $ impala-shell ..... --print_header -B -o tmp you can also specify the delimiter with "--output_delimiter"
... View more
03-07-2018
02:41 AM
CDH4 is 4 years old (last updated was on 2014 I think). So even if Impala supports it, HDFS and Hive are too old and you may encounter various issues. If you have such option, then upgrade to CDH5.14.
... View more
03-06-2018
02:56 AM
This is supposed to be fixed since impala 1.4 https://issues.apache.org/jira/browse/IMPALA-489 You can check also https://issues.cloudera.org/browse/IMPALA-607 it may help you deal with it. Are you really using cdh4?
... View more
03-06-2018
12:18 AM
1 Kudo
Sorry, I didn't notice before. Impyla uses the port 21050 to connect to Impala. This port is also used for JDBC connection. Probably in your HAProxy, you have configured port 21051 in front. "impala-shell", on the other hand, uses the default port "21000" to connect to impala. So you have to configure an additional block in your HAProxy configuration, to forward that port as well. You can refer to https://www.cloudera.com/documentation/enterprise/latest/topics/cm_ig_ports_impala.html .
... View more
03-03-2018
12:37 AM
Just to add on that. I don't believe Cloudera will add this patch. The most probable is to wait for Hive to support Kudu, eg. the https://issues.apache.org/jira/browse/HIVE-12971 was a try, but seems abandoned for long period.
... View more