Member since
09-25-2015
356
Posts
382
Kudos Received
62
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2454 | 11-03-2017 09:16 PM | |
1925 | 10-17-2017 09:48 PM | |
3862 | 09-18-2017 08:33 PM | |
4535 | 08-04-2017 04:14 PM | |
3472 | 05-19-2017 06:53 AM |
11-17-2015
09:28 PM
2 Kudos
Have you tried using the --query option directly and specifying the Sybase query to fetch data? --query "select * from trim_bw..account where \$CONDITIONS"
... View more
11-16-2015
03:07 PM
Suspect that the HDFS has some issues, can you look for exceptions in the DN and NN logs. Also scan for DFSClient exceptions in the the container logs.
... View more
11-14-2015
11:27 PM
2 Kudos
Can you check the installation of Tez? Detailed manual instructions are available here. Typically you see this when tez.lib.uris is not configured correctly.
... View more
11-12-2015
04:56 PM
1 Kudo
Unfortunately there is no clear standard that has been followed on naming client side vs server side properties. hive.metastore.* as the name suggests would be Hive metastore server side properties, similarly hive.server2.* would be HiveServer2 server side properties. However whitelisted properties listed as part of SQL Standard Authorization can be used as cue, these are client side properties that the end user is allowed to set when running under the SQL Standard authorization configuration.
... View more
11-09-2015
04:32 PM
1 Kudo
Hive has two services - Hive Metastore and HiveServer2. Multiple Hive Metastore processes can be started and specified in the hive.metastore.uris. I believe the clients pick up the first active one from the list. Multiple HiveServer2 instances can be restarted and they register with the Zookeeper. The client will randomly pick one and connect to it. In either case once a client session has been initiated, killing/shutting down will invalidate the client session needing the client to reconnect. For HiveServer2 however you can gracefully shut an instance using the deregister command. When a HiveServer2 instance is de-registered, it is removed from the list of servers available for new client connections. (Client sessions on the server are not affected). When the last client session on a server is closed, the server is closed.
... View more
11-06-2015
04:27 PM
2 Kudos
A few things to note:
If the data was inserted into the table using Hive streaming there will be lot of small files, these get compacted into large files only on compaction. If you haven't enabled compactor in the metastore then they will not be compacted, in that case you will need to issue a compaction explicitly. Recommendation for customers on HDP 2.2 is to not deploy Transactions in production, there are issues with bucketing going awry, meaning you could end up with potential data corruption. There will be fixes for these in the upcoming HDP 2.3 releases so stay tuned. Bottomline, we should refrain from deploying Transactions in HDP 2.2 releases.
... View more
11-05-2015
04:49 PM
2 Kudos
We should be using mysql-connector-java-5.1.29.jar or above. There is an internal JIRA BUG-38264 tracking this, please reopen that.
... View more
11-04-2015
06:55 PM
1 Kudo
No, WebHCat does not provide any options to get the query output as part of the response object. Either you use the WebHDFS api to inspect the contents of the output directory or if your concern is the transport mode, you could JDBC connection to the HiveServer2 configured in HTTP mode.
... View more
11-03-2015
01:31 AM
1 Kudo
No there is no global way to set casting in Hive. What do you want to achieve by trimming decimal, do you want to use trim to remove trailing zeros? Looks like even Hive 0.11 trim was for removing the leading and trailing space characters. Its just that now they do explicit type check for string/var/varchar before trimming spaces which seem like the right behavior.
... View more
11-02-2015
09:13 PM
2 Kudos
Remember when you connect to HiveServer2 over JDBC you are running commands at the HiveServer2, so your client environment properties are not available. You can however pass additional properties at the time of initiating beeline session: $ beeline -hiveconf hs2.connect.user=deepesh
beeline> !connect jdbc:hive2://localhost:10000 hrt pwd
scan complete in 2ms
Connecting to jdbc:hive2://localhost:10000
Transaction isolation: TRANSACTION_REPEATABLE_READ
0: jdbc:hive2://localhost:10000> set hs2.connect.user;
+---------------------------+--+
| set |
+---------------------------+--+
| hs2.connect.user=deepesh |
+---------------------------+--+
1 row selected (0.112 seconds)
... View more