Member since
11-24-2015
223
Posts
10
Kudos Received
0
Solutions
10-17-2022
04:03 AM
Hello @vtpcnk Good Day! Circling back to see if my post helped you with this task. If yes, Please mark the answer as "Accept as Solution". So this will be highlighted as solution to this ask for other users in our community. V
... View more
05-26-2022
05:09 AM
@KPG1
As this is an older post we recommend starting a new thread. This will provide the opportunity to provide details specific to your environment that could aid others in providing a more accurate answer to your question.
... View more
04-15-2021
06:13 PM
1 Kudo
Hello Your question maybe related to this one: https://community.cloudera.com/t5/Support-Questions/Issue-of-copying-data-from-kudu-to-hdfs-using-spark-sql/td-p/282814
... View more
04-16-2020
08:48 AM
You are correct; stoping a service is not the same as a service crashing. Alerts generally do not cover intentional administrator activity like starting and stopping of services. However, you do still have access to this information; starting and stopping of services are covered under Events, of the Audit type: https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cm_dg_events.html#cmug_topic_10 The AUDIT_EVENT type covers actions performed. This is also where you will track configuration changes. Turning to the question of API use, here is the Cloudera Manager documentation's section on the API: https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cloudera_manager.html#concept_nsg_jq3_mz Here is the Tutorial linked from that doc, which has a ton of examples, including starting and stopping of services: https://archive.cloudera.com/cm6/6.3.0/generic/jar/cm_api/apidocs/tutorial.html While the Alerts don't tell you when services are started and stopped, you can query Events through the API. We have a Knowledge Base Article on the subject: https://my.cloudera.com/knowledge/Accessing-Critical-Events-Using-the-Cloudera-Manager-API-?id=72521
... View more
03-11-2019
02:02 PM
@Kuldeep Kulkarni, there are many lines with "input data" in the page you referred - not sure which ones to ignore. Should I ignore the sections for datasets/input events/output events - that will leave only the workflow section. Is that right? Can't I use the coordinator from your shell action example? But in that I don't see : "<app-path>${workflowAppUri}</app-path>" Appreciate the clarification.
... View more
12-01-2018
03:01 PM
@n c To define a variable in hive we need to use hivevar and hiveconf is used to set hive configurations Please follow the below steps: hive> set hivevar:id=1; //define id variable with 1 value hive> create view testview as select * from test1 where id = ${hivevar:id}; //create view hive> select * from testview; //select from view for more details regards to hivevar vs hiveconf refer to this link.
... View more
11-16-2018
06:18 PM
ok, this can be done simply as : partitioned by (yr string, mth string). tks.
... View more
11-06-2018
03:58 AM
1 Kudo
@n c Make sure you are having same number of columns and datatypes of both sides of union are same. Union: Eliminates duplicates from the result. Ex: hive> select "1" id,"2" age from (select 1)t
union
select "1" id,"2" age from(select 1) t;
+---------+----------+--+
| _u2.id | _u2.age |
+---------+----------+--+
| 1 | 2 |
+---------+----------+--+ as i'm having 1,2 as result but in the result we are having only one row as hive eliminated duplicates. UnionAll: Shows all duplicates also. hive> select "1" id,"2" age from (select 1)t
union all
select "1" id,"2" age from(select 1) t;
+---------+----------+--+
| _u1.id | _u1.age |
+---------+----------+--+
| 1 | 2 |
| 1 | 2 |
+---------+----------+--+ In both cases we need to have same number of columns/datatypes while performing union or union all operations. If you don't have same number of columns/datatypes from different tables then use null value to match number of columns on both sides. Ex: hive> select "1" id,"2" age from (select 1)t
union
select "1",null from(select 1) t;
+---------+----------+--+
| _u2.id | _u2.age |
+---------+----------+--+
| 1 | NULL |
| 1 | 2 |
+---------+----------+--+ in the above example i have used null for age column and result we going to have 2 columns. Refer to this link for more details regards to union and union all operators.
... View more