Member since
04-03-2019
92
Posts
6
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3443 | 01-21-2022 04:31 PM | |
5882 | 02-25-2020 10:02 AM | |
3553 | 02-19-2020 01:29 PM | |
2568 | 09-17-2019 06:33 AM | |
5603 | 08-26-2019 01:35 PM |
04-12-2022
03:46 PM
Here is the code. create external table testtable1
(code string, codesystem string)
ROW FORMAT SERDE 'org.apache.hadoop.hive.contrib.serde2.RegexSerDe'
WITH SERDEPROPERTIES (
"input.regex" = "(.{27)(.{50})"
)
LOCATION '/data/raw/testtable1'; The error message is: ParseException: Syntax error in line 3:undefined: ROW FORMAT SERDE 'org.apache.hadoop.hiv... ^ Encountered: IDENTIFIER Expected: DELIMITED CAUSED BY: Exception: Syntax error It looks like Impala table only accepts "Row Format Delimited". Then how can I create an hive table with fixed width layout? Should I just do it outside Impala, bu through Hive, and then do other data operation on this table via Impala? Thanks.
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Impala
01-31-2022
07:23 PM
1 Kudo
@jeremymolina That is an excellent explanation. It makes total sense. Thank you very much. Regards,
... View more
01-24-2022
04:00 PM
I saw this kind of notation/style using double curly braces everywhere in HDP(Ambari) or CDP (CMS) UI. Below is a configuration value under zeppelin.shiro.knox.main.block for Zeppelin configuration. (This is a random sample I picked and this question is not about Zeppelin.) ++ krbRealm.signatureSecretFile={{CONF_DIR}}/http_secret ++ I understand that I can simply overwrite {{CONF_DIR}} with the actual path. However, I wonder whether {{CONF_DIR}} an ansible variable? If yes, how do I define the variable CONF_DIR in CDP Cloudera Manager? https://docs.ansible.com/ansible/latest/user_guide/playbooks_variables.html#defining-simple-variables Regards,
... View more
Labels:
- Labels:
-
Cloudera Manager
01-21-2022
04:43 PM
@Scharan By the way, under Zeppelin Shiro Urls Block, the original value is ++ /api/interpreter/** = authc, roles[{{zeppelin_admin_group}}] ++ Could you tell me what this notation {{zeppelin_admin_group}} for? I saw this kind of notation - double curly braces - frequently. Is it a token to be replaced? If yes, what kind of replacement it is waiting for? Thanks.
... View more
01-21-2022
04:31 PM
@Scharan I figured out. CDP Cloudera Manager UI did expose shiro.ini like Ambari, but did it via a different layout, which I should have realized earlier. Under "zeppelin.shiro.user.block", I added admin=admin, admin , and it worked. Thanks.
... View more
01-21-2022
03:01 PM
On the Zeppellin node, under the directory /etc/zeppelin/conf, I found the following files. ++ configuration.xsl interpreter-list log4j.properties log4j_yarn_cluster.properties shiro.ini.template zeppelin-env.cmd.template zeppelin-env.sh.template zeppelin-site.xml.template ++ Should I create a shiro.ini file here?
... View more
01-21-2022
02:32 PM
@Scharan Thanks for the reply. I followed your recommendation and got the same permission error. I felt the disconnect is that, I added a user called admin successfully. The configuration /api/interpreter/** = authc, roles[admin] is for a role called admin. The link between a user and a role seems to be inside shiro.ini, which I have no idea how I can access. I used Zeppelin in HDP and the HDP Zeppelin exposes its shiro.ini via Zeppelin configuration inside Ambari. Now in CDP I cannot find a similar configuration inside Cloudera Manager.
... View more
01-20-2022
07:02 PM
I am using CDP 7.1.7 and the cluster has not enabled Kerbores yet. Ranger is not enabled either. I followed the step in this post https://community.cloudera.com/t5/Support-Questions/CDP-7-1-3-Zepplin-not-able-to-login-with-default-username/td-p/303717 to be able to log in as admin. But this "admin" account has no permission to access the configuration or interpreter page. According to CDP documentation, https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/configuring-zeppelin/topics/enabling_access_control_for_interpreter__configuration__and_credential_settings.html, to configure shiro.ini for Zeppelin security, I have to go through Zeppelin web UI. What should I do? Regards,
... View more
Labels:
- Labels:
-
Apache Zeppelin
11-18-2021
01:30 PM
rbiswas1, I tried your code but pssh returned a timeout error. It was waiting for the password but I never got the prompt to enter the password. Could you elaborate more about your method? Thanks.
... View more
09-15-2021
10:32 PM
@RangaReddy The link is exactly what I need. Thanks for your help.
... View more