2213
Posts
231
Kudos Received
82
Solutions
About
My expertise is not in hadoop but rather online communities, support and social media. Interests include: photography, travel, movies and watching sports.
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 782 | 05-07-2025 11:41 AM | |
| 1643 | 02-27-2025 12:49 PM | |
| 3460 | 06-29-2023 05:42 AM | |
| 3012 | 05-22-2023 07:03 AM | |
| 2119 | 05-22-2023 05:42 AM |
07-30-2018
06:25 AM
@Shashank and @shamik,
As each person's setup is typically different I was suggesting you start a new thread or conversation. In this new thread you can explain your unique situation in terms of overall system specifications (RAM, number of processors, etc.) as well as how much of those resources have been allocated to the Quickstart VM.
As @jmartin1938 has pointed out the Quickstart VM in inherently slow due to being a single node cluster. The issue can be made worse if the VM is not allcated the appropriate resources or used for large scale projects.
To start a new thread go to the appropriate board and use the "new message" button.
This will open a page for you to post the wording and title for the new thread.
... View more
07-20-2018
01:41 AM
Thank you so much! it really works! java -Djavax.security.auth.useSubjectCredsOnly=false -jar <my jar name>
... View more
07-18-2018
08:29 AM
Not anle read or write from to/from HDFS in CM - getting error: block size is 0 and no data is present .. When checking the CM UI all HDFS nodes are hving green status and no issue .
... View more
07-16-2018
01:00 PM
Hi, Can anyone guide me to make ftp between CDSW and Unix server, to upload & download the file, using R.
... View more
07-11-2018
12:37 PM
Thank you for asking @ABP. Cloudera doesn't have such a book. If you are wondering what to study for the CCA Administrator Exam (CCA131), you can find out on the certification page which lists:
Number of questions
Time limit
Score required to pass
Pricing
How the test is evaluated and scored
Audience and Prerequisites
Exam delivery and cluster information
Of course the part you would be interested in is listed as well in the Required Skills section. This section lists all the skills you will need to be able to perform as part of the test.
... View more
07-05-2018
06:12 AM
Hi @tuk,
Sorry about the delay on this. I contacted the certification team and found out that Cloudera Certified Specialist in Apache HBase (CCSHB) certification was retired. I am now inquiring about getting the document you linked to updated to reflect the change. Sorry for the confusion.
... View more
06-19-2018
02:02 PM
I received a similar error, but for the LzopCodec (not LzoCodec) not being found. In this case, I actually wanted to use the LzoCodec as my default compression codec (for legacy reasons...). In order to get Hive working with Lzo on CDH 5.14.x, I did the following: 1)
# Add GPLEXTRAS parcel to CM and distribute to all nodes:
https://www.cloudera.com/documentation/enterprise/5-14-x/topics/cm_ig_install_gpl_extras.html
2)
# Configure HDFS to use it:
http://www.roggr.com/2014/06/enabling-lzo-compression-for-hive-to.html
ClouderaManager -> Hive -> Configuration -> Service-wide -> Advanced -> Hive Auxiliary JARs Directory : /opt/cloudera/parcels/GPLEXTRAS/lib/hadoop/lib
# Verify it works by invoking 'show tables' in hive with debug-logging enabled. There should not be any errors. The error condition if not working complains about LzopCode (not LzoCodec) not found.
hive --hiveconf hive.root.logger=DEBUG,console
3)
# Configure HDFS
ClouderaManager -> HDFS -> Configuration -> Service-wide -> Compression Codes (io.compression.codecs):
+ com.hadoop.compression.lzo.LzoCodec
+ com.hadoop.compression.lzo.LzopCodec
4)
# Configure YARN/MR2
# http://blog.cloudera.com/blog/2013/07/one-engineers-experience-with-parcel/
ClouderaManager -> YARN/MR2 -> Configuration -> SearchFor: compress ->
mapreduce.output.fileoutputformat.compress: checked
mapreduce.output.fileoutputformat.compress.codec: com.hadoop.compression.lzo.LzoCodec
mapreduce.map.output.compress: checked
mapreduce.map.output.compress.codec: com.hadoop.compression.lzo.LzoCodec
... View more
06-19-2018
07:23 AM
Following up on this. The 404 error has been corrected. 🙂
I'm sorry it took so long.
... View more
06-05-2018
05:37 AM
Of course I wondered what @KamaJinny was saying so I figured others may as well. Here is the translation via google translate:
... View more