Member since
07-15-2016
43
Posts
3
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
4432 | 09-21-2017 05:43 PM | |
3650 | 04-12-2017 03:30 PM |
10-16-2017
06:20 PM
I create a table and tried to insert the data but got the below exception due to case sensitivity. INSERT INTO TABLE X(A,B,C) select A,B,C FROM Y; FAILED: SemanticException 1:27 '[A, B, C]' in insert schema specification are not found among regular columns of default.X nor dynamic partition columns.. Error encountered near token 'C' Whereas the below successful: INSERT INTO TABLE X(a,b,c) select A,B,C FROM Y; After some investigation, I found Hive metastore store table info in lowercase and is case-sensitive. Is there any way I can make sure JDBC drive can handle this scenario? We are using a tool to push data from RDBMS system to Hive and it is generating CREATE & INSERT statements in uppercase. I am working with the tool SME's as well if they can enfore a lowercase schema during code generation.
... View more
Labels:
- Labels:
-
Apache Hive
10-16-2017
06:11 PM
Thank you @subash sharma . I will check that as well..
... View more
10-05-2017
02:23 PM
Update: In my recent changes, you will find the "get_user_query(job_tracker_url)" commented out. Instead, I am fetching the Tracking URL for the job which is taking more time. But, the code is still there. Feel free to play with it.
... View more
10-05-2017
02:19 PM
Hi, Subash, The code will handle passing the job tracker URL. ( it is the job tracker URL ). In resource-manager -> Click on job -> Click on Application Master(Tracking Url). However, after some testing, I found the above code is working MR code only as Tez and Spark jobs redirects to another URL. I need to research a bit to make it work for all kind of apps. I hope this helps! -- Shashant
... View more
09-25-2017
06:31 PM
@Saurabh: Why you want to create 1000+ policies? Can you try grouping the requirements and reduce the policies? Eg: achieve them via making user groups or DB level policies with different user permission set. Ranger API is def a solution for this but I would suggest to revisit the requirement and rule out as many duplicates as you can. Just a suggestion, not saying your requirement is invalid!!!
... View more
09-25-2017
06:21 PM
Check out HW Data Flow(Nifi). I believe it has some processors which can convert JSON object to flow-file and flow-file to SQL(I guess you want to insert into Hive). Processor: ConvertJSONToSQL Description: https://nifi.apache.org/docs.html
... View more
09-21-2017
05:43 PM
Update: I built a custom solution for this by using YARN RM API and by parsing job_tracker & hdfs config properties. Here is the solution for ref: RM-Parser Feel free to fork it or provide any suggestions.
... View more
09-13-2017
01:49 PM
@Thomas Larsson I agree if I set yarn queue-mappings-override property to true. Then I cannot override queue if I want to for some job. Any solution for that?
... View more
09-08-2017
01:19 AM
Hi All, I am exploring YARN REST api's and looking to get hive query from the configuration. I know how to get the query from the UI but can anyone suggest how to get the query from yarn REST api. I am using http://<rm-host>:8088/ws/v1/cluster/apps?states=running&user=hive Thank you.
... View more
Labels:
- Labels:
-
Apache YARN
-
Cloudera Manager
09-05-2017
05:44 PM
NM, I resolved this by downgrading python version from 2.7.5-58 to 2.7.5-48. Earlier we were running 2.7.5-48, OS patching upgraded python version to 2.7.5-58 which started throwing SSL exception. Hope this helps someone in future.
... View more