Member since
04-25-2020
43
Posts
5
Kudos Received
4
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1472 | 11-19-2023 11:07 AM | |
| 1706 | 09-30-2023 09:10 AM | |
| 1873 | 03-20-2022 03:00 AM | |
| 2044 | 03-20-2022 02:47 AM |
09-04-2022
04:17 AM
Hi Experts, We are planning to implement BDR in our project. As a back up and recovery solution I have proposed the BDR cloudera cluster where in the HDFS and Hive data will be backed up, But I want to know if there is an alternative way by backing up the data in the cold storage, Not sure if this approach can be the best as per cost perspective since we want the options available to reduce cost. If any one share a use case and best solution for this. Thanks.
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Hive
-
Cloudera
03-21-2022
03:46 AM
Hi @Katja CAST is supported in impala and hive, you said the query works where have you tested it. Can you try running on beeline and see if it works.
... View more
03-20-2022
03:00 AM
Yes before I tried runing sqoop import manually, I restarted the oozie sqoop service multiple times until I can see the oozie workflow was initialized in the logs. The workflows started working as expected and the job completed.
... View more
03-20-2022
02:47 AM
We are able to bring the impala daemon up by disabling Enable Lineage Collection and Enable Impala Lineage Generation in Impala Configuration and after this the impala queries started resuming fine and the data loads as expected but when I try to enable it back to the previous state it is again going down not sure why it is happening. if any one has any suggestions please tell.
... View more
03-18-2022
11:26 PM
Hi Experts, One of the Impala daemon suddenly went down and we are unable to bring it up. Some queries were executed on the impala daemon. I have captured the logs when it got shutdown. Could not open log file: /var/log/impalad/lineage/impala_lineage_log_1.0-1647629222243 @ 0x95b479 impala::Status::Status() @ 0xd00b95 impala::SimpleLogger::FlushInternal() @ 0xd01fcf impala::SimpleLogger::Init() @ 0xbb9c2a impala::ImpalaServer::InitLineageLogging() @ 0xbcb25e impala::ImpalaServer::ImpalaServer() @ 0xbb676d ImpaladMain() @ 0x8e2593 main @ 0x7f5cf7658495 __libc_start_main @ 0x9299e1 (unknown) ERROR cc:312 Aborting Impala Server startup due to failure initializing lineage logging. Impalad exiting. Can some one please tell what steps should be taken, Just to note Enable Audit Collection and Enable Impala Audit Event Generation is enabled/checked.
... View more
Labels:
- Labels:
-
Apache Impala
01-21-2022
09:09 AM
Hi Experts, One of our oozie workflow got failed while sqoop import job. Please find below logs: org.apache.velocity.exception.VelocityException: Error initializing log: Failed to initialize an instance of org.apache.velocity.runtime.log.Log4JLogChute with the current runtime configuration. in other logs as : org.springframework.web.client.HttpServerErrorException: 500 null Please tell what could be the possible cause of this failure, we retried this job but getting the same error.
... View more
Labels:
- Labels:
-
Apache Sqoop
08-09-2021
10:48 AM
2 Kudos
Hi @ryu , I have recently copied the hive tables from our Production cluster to non production cluster using distcp the location of hive warehouse directory from Prod to non prod, After running distcp we created the table schema on non prod as same as Prod using 'create table'. If table consist partition then please apply 'alter table' to add partition. We are also using hive replication to copy the tables from our Prod to DR cluster. If this has helped you then please mark the answer as solution.
... View more
11-07-2020
12:41 AM
Hi Ateka, Can you share what error you are getting. while submitting the command to better understand the issue.
... View more
11-01-2020
02:54 AM
Hi, I am trying to see a summary of a query's progress that updates in real-time, Hence I ran 'set LIVE_PROGRESS=1;'. But I am getting the message stating as below: ERROR: User hadmin@HADOOP-GROUP.LOCAL is not authorized to access the runtime profile or execution summary. However, the user hadmin is the authorized user to view that particular database and table. Please suggest what could be the reason and how to fix this, Since I have taken the Kerberos ticket as well.
... View more
Labels:
- Labels:
-
Apache Impala
10-24-2020
11:40 PM
Hi Tushar Thanks a lot for your quick reply. The resolution you provided has worked. I am accepting it as a solution. Thanks once again.
... View more