Member since
04-03-2019
89
Posts
5
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3158 | 01-21-2022 04:31 PM | |
5644 | 02-25-2020 10:02 AM | |
3310 | 02-19-2020 01:29 PM | |
2470 | 09-17-2019 06:33 AM | |
5403 | 08-26-2019 01:35 PM |
07-31-2019
04:17 PM
@Geoffrey Shelton Okot That is exactly what I missed. Thank you very much for the prompt and right-to-the-point response.
... View more
07-30-2019
09:40 PM
I am following the instruction at links below to add users to Hive admin role. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.2/bk_dataintegration/content/hive-013-feature-sql-standard-based-grant-revoke.html and https://community.hortonworks.com/articles/4568/sql-based-authorization-in-hive.html However, I could not find this configuration "hive.users.in.admin.role" via Ambari UI (Hive - Configs - Advanced). I downloaded the hive_site.xml (via Ambria's Download Client Configs button) and found no such configuration in the xml file either. What did I miss? Below is my current Hive security settings. Authorization: SQL-Standard Based (SQLStdAuth) Authentication: None Run as end user instead of Hive user: False
... View more
Labels:
- Labels:
-
Apache Hive
06-14-2019
10:04 PM
@Geoffrey Shelton Okot My intention is to use "su hive", not "su - hive". Below is the resource showing the difference. https://www.tecmint.com/difference-between-su-and-su-commands-in-linux/ Thanks.
... View more
06-14-2019
09:57 PM
@Gulshad Ansari Thanks. You are right. The execute permission is required for entering the directory.
... View more
06-12-2019
09:56 PM
My issue is actually caused by the fact that Port 10000 is not working. After installing the Hive client no another data node, where port 10000 is working, I am able to follow the steps above and create the DSN successfully.
... View more
06-03-2019
04:14 AM
@Shu Your code put me on the right track. Thanks again. However, I got some strange returned records. Here are my guesses of the possible causes. 1. The CR and LF as the row delimiter and they are not the default row delimiter of the regex SerDe. How can I specify the row delimiter? 2. There are two strange characters in the first column of the first row. It might be related to the row delimiter too. Below is the create-table script. Create External Table slog(LogTime string, LogSource string, LogMessage string) ROW FORMAT SERDE 'org.apache.hadoop.hive.contrib.serde2.RegexSerDe' WITH SERDEPROPERTIES ("input.regex" = "(.{46})(.{24})(.*)") LOCATION '/path/to/slog/'; I attached a screenshot of the log file (in notepad ++) and the hive query result.
... View more
06-02-2019
03:22 AM
@Shu Thanks for your help. I am currently on the road and will test your solution once I am back in office.
... View more
05-31-2019
02:39 PM
Basically, I am trying to analyze SQL server log files using Hive. The layout is the log file is char(23) - for timestamp char(1) - space char(12) - source the rest of the row, and the length varies. The row delimiter is CR+LF. Below are some entries in the log. 2019-05-28 07:29:55.03 Server UTC adjustment: -7:00
2019-05-28 07:29:55.03 Server (c) Microsoft Corporation.
2019-05-28 07:29:55.03 Server All rights reserved.
2019-05-28 07:29:55.03 Server Server process ID is 3368. There are several posts here regarding fixed-width column layout. But in my case, the last column is identified not by the width but by the row delimiter.
... View more
Labels:
- Labels:
-
Apache Hive
05-28-2019
05:13 PM
@Vinay Your are right. The issue is resolved. Thank you!
... View more
05-28-2019
03:28 AM
Content of stock2.json file {"myid":"0001","mytype":"donut"} stock2.json file is in the path of '/warehouse/tablespace/external/hive/haijintest.db/stock2'; Below is the table creation script. CREATE EXTERNAL TABLE stock4_json (myjson struct<myid:string, mytype:string>)ROW FORMAT SERDE 'org.apache.hive.hcatalog.data.JsonSerDe' LOCATION '/warehouse/tablespace/external/hive/haijintest.db/stock2'; Below is the query that returned null value. 0: jdbc:hive2://> select myjson.myid from stock4_json;
19/05/27 20:20:18 [103d2343-eb59-4072-8a07-5469b2112093 main]: WARN optimizer.SimpleFetchOptimizer: Table haijintest@stock4_json is external table, falling back to filesystem scan.
OK
+-------+
| myid |
+-------+
| NULL |
+-------+
1 row selected (0.232 seconds)
0: jdbc:hive2://> select * from stock4_json;
OK
+---------------------+
| stock4_json.myjson |
+---------------------+
| NULL |
+---------------------+
1 row selected (0.242 seconds) Any suggestions?
... View more
Labels:
- Labels:
-
Apache Hive
- « Previous
- Next »