Member since
01-16-2018
607
Posts
48
Kudos Received
106
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
434 | 05-06-2024 06:09 AM | |
606 | 05-06-2024 06:00 AM | |
649 | 05-06-2024 05:51 AM | |
666 | 05-01-2024 07:38 AM | |
730 | 05-01-2024 06:42 AM |
12-20-2022
07:54 AM
Hello @SagarCapG Thanks for using Cloudera Community. While I haven't tested the above Use-Case in Phoenix v5.0.0, I tested in Phoenix v5.1.0 (Used in CDP v7.1.7) & the same shows the Primary Key correctly [1]. As such, I believe the above ask is fixed in CDP v7.1.8 atleast. I reviewed Upstream JIRA & it appears the same is actually fixed in Phoenix v5.1.x as per comments in https://issues.apache.org/jira/browse/PHOENIX-6651. As such, Kindly plan for CDP v7.1.8 Upgrade for obtaining the concerned functionality of identifying PK via "!primarykeys". Regards, Smarak [1] 0: jdbc:phoenix:> CREATE TABLE Employee (EmpId Integer Not Null Primary Key, Ename Varchar(50));
0: jdbc:phoenix:> !primarykeys Employee;
+-----------+-------------+------------+-------------+---------+---------+-------------+-----------+-----------+-------------+---------+---------------+
| TABLE_CAT | TABLE_SCHEM | TABLE_NAME | COLUMN_NAME | KEY_SEQ | PK_NAME | ASC_OR_DESC | DATA_TYPE | TYPE_NAME | COLUMN_SIZE | TYPE_ID | VIEW_CONSTANT |
+-----------+-------------+------------+-------------+---------+---------+-------------+-----------+-----------+-------------+---------+---------------+
| | | EMPLOYEE | EMPID | 1 | | A | 4 | INTEGER | null | 4 | |
+-----------+-------------+------------+-------------+---------+---------+-------------+-----------+-----------+-------------+---------+---------------+
... View more
12-19-2022
12:34 AM
Hello @anks1 Thanks for using Cloudera Community. Kindly confirm the following details: CML Deployment (CDP Public Cloud Or Private Cloud) CML Version Used (Via CML Workspace Details In CML Page) Any timeframe of how many days before an App transition to Failed State from Running State Regards, Smarak
... View more
12-19-2022
12:32 AM
Hello @sekhar1 We wish to follow-up on the Post & confirm if your Team have resolved the issue. In Summary, such Exception are received if Traffic from your Machine isn't allowed to or from the Security Group linked with the VPC wherein the CML Workspace instances are deployed. Check if the Kubernetes Pods associated with the CML Workspace Kubernetes Cluster are Up/Running. If Yes, Such Exception should be reviewed from a Network Standpoint only. You may reach out to your Customer's AWS/Platform Team to review the Traffic between your Machine & the VPC within which the CML Workspace is deployed. Regards, Smarak
... View more
12-19-2022
12:15 AM
Hi @pacman A Merge happens for each Read Operation i.e. BlockCache & MemStore. As such, Incorrect Values aren't observed. Having said that, If you observe any such scenario of Read/Write Inconsistency, Kindly share a Use-Case & any replication attempt to allow us to review accordingly. Regards, Smarak
... View more
12-13-2022
07:39 AM
1 Kudo
Hello @pacman HFile is only updated after flush of Memstore. In the scenario shared, Read Merge would share the Updated values without updating the Hfile. We can perform the same by following for verification: 1. Create a Table with 1 CF. Insert 1 Row & flush Table to ensure 1 Hfile is created. 2. Read the Table, which would read from Hfile & place in BlockCache. The BlockCache Size is visible via HBase UI at the CF family level within the Table's Level Statistics, 3. Read the Table again, which would read from BlockCache. Verify via Hit Ratio from the BlockCache Stats in HBase UI. 4. Update the Row by using the same RowKey, yet using a different Value for the Column Qualifier within the Column Family. 5. Read the Table again. You should get the Updated Value from Step 4. 6. To make things interesting, Remove the concerned Table's 1 Region hosting RegionServer WAL file & Kill the RegionServer PID. This ensure the MemStore isn't flushed owing to Ungraceful exit & WAL can't be replayed. 7. Start the RegionServer, which shall create the WAL file. Read the Table again. The same would show Value from Step 1. This would help confirm the HFile isn't Updated when HBase Read Merge the Values from BlockCache & MemStore while reading the Table as per Step 5. Regards, Smarak
... View more
12-13-2022
12:48 AM
Hello @ashokaakula As per [1], the Master Password isn't recoverable in the event of the same being lost. As such, We shall request your Team to engage Cloudera Support, if your Team have lost the same without further delay. Regards, Smarak [1] https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/navigator_encrypt_register.html#concept_opn_tnn_mr__section_g5n_tnn_mr
... View more
12-09-2022
07:31 AM
Hello @pacman Thanks for using Cloudera Community. HBase handles such scenario by Read Merge. A Read "Merges" Key Values from the Block Cache, MemStore, and HFiles in the following steps: First, the Scanner looks for the Row Cells in theBlock Cache (Read Cache). Next, the Scanner looks in the MemStore (Write Cache). If the Scanner does not find all of the Row Cells in the MemStore and Block Cache, then Hfiles are referred. Hope the above answers your query. If Yes, Kindly mark the Post as Resolved. Regards, Smarak
... View more
12-09-2022
07:14 AM
Hello @quangbilly79 Thanks for using Cloudera Community. The Link [1] applies to CDE Service, which is available on Private Cloud & Public Cloud. In CDP Public Cloud, Your Team need to connect to the CDP Management Console & access the CDE Service as documented in [1]. In CDP Private Cloud, You need to install Data Service [2] to access CDE Service, upon which your Team can Schedule Job. The Cloudera Manager of CDP Private Cloud is used to install Data Service [2] & CDE is available after successful installation on Data Service. Without Data Service, Oozie can be used by your Team as shared above by Steven. Kindly review & let us know if you have any queries. Regards, Smarak [1] Scheduling jobs in Cloudera Data Engineering [2] CDP Private Cloud Data Services: Documentation | CDP Private Cloud (cloudera.com)
... View more
12-02-2022
01:26 AM
Hello @GregDol Thanks for using Cloudera Community. This is an Old Post, yet I am sharing a review for other Community Users, in case they encounter the concerned issue. Reviewing the Post indicates the Issue is likely caused by missing "rt.jar" in the JDK used by the Solr Service. In other words, the concerned Class "java.time.zone.ZoneRulesProvider" is present in "/usr/java/jdk1.8.0_232-cloudera/jre/lib/rt.jar" for CDP Cluster (Path & Version may be different for Customer). The concerned JDK is used by the various Services running including Solr. In your scenario, the concerned Class appears to be missing. Assuming your team wish to confirm whether a JAR consists of the Class, you may use Command [ /usr/java/jdk1.8.0_232-cloudera/bin/jar -tvf /usr/java/jdk1.8.0_232-cloudera/jre/lib/rt.jar] to list the Classes, which should include "java.time.zone.ZoneRulesProvider" as well. If your Team is using any different JDK, Review the same & ensure the "rt.jar" is present for Class "java.time.zone.ZoneRulesProvider" to be loaded successfully. Regards, Smarak
... View more
12-02-2022
01:12 AM
Hello @sekhar1 Thanks for using Cloudera Community. Generally such Exception are received if Traffic from your Machine isn't allowed to or from the Security Group linked with the VPC wherein the CML Workspace instances are deployed. Check if the Kubernetes Pods associated with the CML Workspace Kubernetes Cluster are Up/Running. If Yes, Such Exception should be reviewed from a Network Standpoint only. You may reach out to your Customer's AWS/Platform Team to review the Traffic between your Machine & the VPC within which the CML Workspace is deployed. Regards, Smarak
... View more