Member since
07-29-2019
640
Posts
114
Kudos Received
48
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 11081 | 12-01-2022 05:40 PM | |
| 2762 | 11-24-2022 08:44 AM | |
| 4018 | 11-12-2022 12:38 PM | |
| 1456 | 10-10-2022 06:58 AM | |
| 2098 | 09-11-2022 05:43 PM |
07-19-2021
05:46 AM
@chams221
Have you resolved your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.
... View more
07-15-2021
07:15 AM
Hi @miguelbda21 When I click the first hyperlink you provided, I get an HTTP 404 error. I do not see the text you quoted: Downloading a Cloudera QuickStart VM Cloudera QuickStart VMs are available as Zip archives in VMware, KVM, and VirtualBox formats. Cloudera recommends that you use 7-Zip to extract these files, when possible. (7-Zip performs well with large files.) To download the latest VM in the required format, see Cloudera QuickStart VM Download. …anywhere on that page, or indeed on any Cloudera downloads page. Yes, Cloudera is no longer making the Cloudera Quickstart VM for VirtualBox (or any other virtualization platform, for that matter) available for download because it was old and outdated as it was based on CDH 5.13, which went out of support in the Fall of last year. The new, updated distribution from Cloudera for on-premises use is Private Cloud Base Edition of Cloudera Data Platform. There is extensive and thorough documentation on installing the CDP Private Cloud Base Edition of Cloudera Data Platform (the "free trial" for which is available at the second hyperlink you provided) on a non-production environment for demonstration and proof-of-concept use cases. That version does not come "pre-packaged" for deployment on a VM platform such as VirtualBox, however. One alternative you might consider if you're already familiar with Vagrant, is @carrossoni's community article outlining how to create a Centos7 CDP-DC Trial VM for sandbox/learning purposes, which is intended for use on VirtualBox.
... View more
07-13-2021
06:11 AM
@JatinMalik You can find an answer to your question here: Re: How to download Ambari-repo
... View more
07-13-2021
02:15 AM
Same problem: 21/07/13 15:56:34 ERROR ExecutionImpl: Couldn't create proxy provider class org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider
java.io.IOException: Couldn't create proxy provider class org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider
at org.apache.hadoop.hdfs.NameNodeProxies.createFailoverProxyProvider(NameNodeProxies.java:530)
at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:172)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:662)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:606)
at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:148)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2596)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296)
at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:97)
at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:80)
at org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.java:205)
at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:313)
at org.apache.spark.rdd.HadoopRDD.getPartitions(HadoopRDD.scala:202)
at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:252)
at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:250)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.rdd.RDD.partitions(RDD.scala:250)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:637)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.hadoop.hdfs.NameNodeProxies.createFailoverProxyProvider(NameNodeProxies.java:513)
... 84 more
Caused by: java.lang.RuntimeException: Could not find any configured addresses for URI hdfs://nameservice1/user/hive/warehouse/test.db/test/year_month=20187
at org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider.<init>(ConfiguredFailoverProxyProvider.java:93)
... 89 more
... View more
07-08-2021
04:27 PM
1 Kudo
@rok Perhaps. I think the place to begin would be to look at this: STACKTRACE=[java.io.IOException: Server returned HTTP response code: 403 for URL: http://cloudera_manager_ip:7180/cmf/j_spring_security_check …and figure out why the access request to that URL is being denied with an HTTP 403 Forbidden client error. Is that URL accessing a host on your network, or the host running Cloudera Manager?
... View more
07-06-2021
11:54 PM
Hi. @roshanbi, Has any of the replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. If you are still experiencing the issue, kindly provide more information that can help the experts help you.
... View more
07-05-2021
04:54 PM
@Rbcc What you should do next is post the specific version of the sandbox you are running in this thread so that members of the community who are inclined to do so can address your question. You should also post the specific virtualization platform you're using, as your question mentioned both virtual box and docker; I have to assume you are only actually using one or the other. If you don't know how to obtain the sandbox version, see this tutorial: Learning the Ropes of the HDP Sandbox …and scroll down to the subsection Sandbox Version and follow the instructions there.
... View more
07-04-2021
11:03 PM
@ask_bill_brooks Thanks for the addendum and official context. Happy hadooping
... View more
07-04-2021
07:11 PM
Hi @roshanbi I think there are really two questions here: For each row of my data set, can I mask the last 5 digits of each data element present in the pri_identity column using Ranger? Is this possible to achieve while using Kudu? I'll restrict myself to addressing the first question. Your second question is a good one, though, because most of the documentation I've read about this simply doesn't mention Kudu, so I'll leave that part of your question to another community member who has more experience with Apache Kudu as a storage option. You didn't provide the version of either Impala, Ranger or Kudu you're using or on what distribution, but I will attempt to point you in the right direction nonetheless. You can see a quick demonstration of why and how to use a mask in Ranger on CDP in the first two minutes of this video: How to use Column Masking and Row Filtering in CDP You can see a slightly longer length demonstration of how to do something similar on HDP 3.1.x in this video: How to mask Hive columns using Atlas tags and Ranger Neither quite shows how to establish the custom masking expression, though, which is what I think you'll need to satisfy your requirements. To suppress the display of the last 5 digits in the pri_identity column, you are likely to need a custom masking expression for use in Ranger. Ranger includes several "out of the box" masking types, but a cursory look at the documentation indicates that the masking policy you've described and desire is not one of them. If that's true, you can always write a custom masking expression using the UDF syntax, which you can read about at the Apache.org site here: Hive Operators and User-Defined Functions (UDFs) Hope this helps
... View more
06-25-2021
12:53 PM
3 Kudos
What the Trial Version of CDP Private Cloud Base Edition includes is an installer package. You can view the documentation on how to complete the installation here: INSTALLING CDP PRIVATE CLOUD BASE Other members of this community have previously reported success using this approach. Alternatively, if you're already familiar with Virtualbox and Vagrant, you might consider closely reading @carrossoni 's community article outlining how to create a Centos7 CDP-DC Trial VM for sandbox/learning purposes (CDP Private Cloud was formerly known as CDP Data Center). Other than that, I have not personally seen any publicly available VM images that can be deployed using Virtualization tools, but that certainly doesn't mean they don't exist. Cloudera's distributions have a vast ecosystem built up around them and it's close to impossible to keep up with everything anyone is producing. But participating in and contributing to this community helps a lot. 😀
... View more