Member since
10-18-2018
130
Posts
33
Kudos Received
18
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
357 | 08-08-2024 03:03 AM | |
107 | 08-07-2024 12:57 PM | |
375 | 03-22-2024 08:04 AM | |
1015 | 03-20-2024 01:05 PM | |
749 | 03-15-2024 03:36 AM |
03-22-2024
08:04 AM
1 Kudo
Updating the appropriate Docs Link: For CDP Installation: https://docs.cloudera.com/cdp-private-cloud-upgrade/latest/release-guide/topics/cdpdc-os-requirements.html For CDSW Installation: https://docs.cloudera.com/cdsw/1.10.5/installation/topics/cdsw-application-block-device-or-mount-point.html HTH.
... View more
03-20-2024
02:20 PM
2 Kudos
@mike_bronson7 Hello! Thanks for bringing this to our community. Users are complain about slowness from spark applications that run on data-nodes machines from my understanding the exceptions as Slow `BlockReceiver write packet to mirror` indicate maybe on delay in writing the block to OS cache or disk So I am trying to collect the reasons for this warning / exceptions , and here there are 1. delay in writing the block to OS cache or disk 2. cluster is as or near its resources limit ( memory , CPU or disk ) 3. network issues between machines From network side I not see special issues that relevant to machines itself No, This indicates that there was a delay in writing the block across the network The WARNs may indicate that you may be facing network/hardware-level. The time taken is not excessively high, and Its likely to be a tuning issue, and as to explain this WARN, Slow BlockReceiver write packet to mirror This measures the duration taken to write to the next DataNode over a regular TCP socket, and the time taken to flush the socket. An increase in this typically indicates higher network latency, as Java-wise this is a pure SocketOutputStream.write() + SocketOutputStream.flush() cost. Also, Did you happen to monitor the DNs Network when the Spark applications are running in parallel. Hopefully the above should help you tune the network configurations better. V
... View more
03-20-2024
01:13 PM
1 Kudo
@Krecik Hello. Can you be more specific? Do you have shareable weblinks/sources? Or Are you referring to Cloudera Educational Services Store? https://education.cloudera.com/store V
... View more
03-20-2024
01:05 PM
1 Kudo
@EFasdfSDfaSDFG Took sometime to do a feasibility study and found a couple of things from our Internal resources. 1. FYI: The native Ozone REST API is completely superseded by the S3 REST API. Therefore, there is no native REST API to manage Ozone. 2. Since I am unsure of your Use-case, I would suggest you test this either by Java API or HttpFS Gateway Interface.[0a] [0a]https://ozone.apache.org/docs/1.4.0/interface.html HTH. If you find this answering your question, Please mark this as Accept as Solution. Also, You may thank me by clicking the thumbs-up! Cheers!
... View more
03-15-2024
03:36 AM
1 Kudo
@Choolake Thank you for bringing this to our Community. The shared ALTER command should work as expected. Ref: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-AlterTable/Partition/Column:~:text=the%20named%20table.-,Alter%20Table,-Rename%20Table > Please let me know the correct way to rename the table without any issue. What is your concern here? Can you also try renaming a test table in a test database and see how it goes? HTH.
... View more
03-13-2024
12:05 AM
1 Kudo
@EFasdfSDfaSDFG This still seems broader scope of requirement. Can you please help elaborate to specific situation on what we are trying to solve? My understanding is that since you have restriction on installing awscli on RHEL, you are seeking alternative solutions to access/manage Ozone. Is my understanding correct? Additionally, Did you get a chance to review the available client interfaces for managing Ozone? https://ozone.apache.org/docs/1.4.0/interface.html Let me know your thoughts! V
... View more
03-12-2024
11:16 PM
2 Kudos
@bowen I am obliged to you for bringing this in our community. I am writing this as soon as I could. Did you get help on this? If not, Please follow my update: ----------------------------------------- Since this request is made on the legacy Cloudera Lineup - CDH6.x, Before we go about the architectural advisory I regret to inform you that CDH6.x is announced to be EoS(End-Of-Support) in March 2022. As a part of this, All associated organizations using Cloudera legacy products such as CDH had received the following announcement directly. You can find our official Customer Advisory[0a] of the announcement that Cloudera Enterprise 6 reached EoS in March 2022: [0a] Cloudera Customer Advisory-475, 499, 511: End of Support for Cloudera Products (CDH/CM 6.x & HDP 3.x) [0b] Cloudera Support lifecycle policy ----------------------------------------- Additionally, To answer you on the Architectural aspects, Yes, CDP deployment on K8s is possible. however, You will want to make use of our CDP line-up(that can be deployed on the Openshift Kubernetes on-prem[0c], Or you may follow[0d] for other available Public Cloud platforms). [0c] CDP Private Cloud Base for on-premises, is able to be deployed on OpenShift platform. https://docs.cloudera.com/cdp-private-cloud-data-services/1.5.3/overview/topics/cdppvc-ds-deployment-architecture.html [0d] Whereas in CDP Public Cloud, We can make use of AWS, Azure, or GCP that is fully-Kubernetes-deployed on the respective cloud-native platforms. It is also worth mentioning that CDP features achieving Hybrid-Cloud/Multi-Cloud architecture. https://docs.cloudera.com/cdp/latest/overview/topics/cdp-overview.html Since you are interested in knowing architectural aspects and this forum is mostly related to technical questions on using Cloudera Lineup, I highly recommend you discussing potential partnership with our Sales Executives. https://www.cloudera.com/contact-sales.html If you still need help, Please feel free to update this thread, so I can have our team approach you on your behalf. I hope this helps. If this answers your question, You may mark this answer as Accept as Solution. You can also say thanks by clicking on the thumbs up button.
... View more
03-12-2024
03:18 AM
1 Kudo
@anh2707 Did you get help on this? If yes, You may mark my update "Accept as Solution", You may as well say thanks by clicking on the thumbs-up. V
... View more
03-12-2024
02:51 AM
@SyedWasi Did you get help on this? Let me know if you'd like to discuss further with our concerned resources.
... View more
03-11-2024
05:56 AM
1 Kudo
@johnnyyqzheng Apologies for the delayed update. Writing this update as soon as I could. From your previous post, I see that you are still observing the presence of the log4j files after upgrading to CDP 717 SP1. May I know if you got a chance to review the KB article regarding this? If not, Please read this and let me know if you have followup questions. https://my.cloudera.com/knowledge/Clarification-of-Log4J-1x-Remediation-on-CDP-717-SP1-and-CM771?id=373883 V
... View more