About Seaport

smdas · ‎11-04-2020

Thank You @Seaport for sharing the Solution for wider audience. In short, you followed the Link [1] to resolve the Protocol Header Issue as utilised by the User in Link [2]. - Smarak [1] https://github.com/python-happybase/happybase/issues/161 [2] https://community.cloudera.com/t5/Support-Questions/Sharing-how-to-solve-HUE-and-HBase-connect-problem-on-CDH-6/td-p/82030

Seaport · ‎07-30-2020

The unpack command will not work without that extra dash. https://stackoverflow.com/questions/34573279/how-to-unzip-gz-files-in-a-new-directory-in-hadoop/43704452 I had another try with a file name as the destination. hdfs dfs -cat /user/testuser/stage1.tar.gz | gzip -d | hdfs dfs -put - /user/testuser/test3/stage1 the file stage1 appeared in the test3 directory. There is something interesting. The stage1.tar.gz contains three empty txt files. "hdfs dfs -cat /user/testuser/test3/-" ouptut nothing and the file size is 0.1k "hdfs dfs -cat /user/testuser/test3/stage1" output some texts including original file names inside. Also the file size is 10k.

Seaport · ‎02-25-2020

I got the following responses from Cloudera Certification. Regarding Question #1, the FAQ page has the most the up-to-date information. So right now I'd better hold off purchasing the exam until the DE575 is relaunched. Regarding Question #2, the course is the "Spark and Hadoop Developer" training course is the one I should take for preparing DE575. Regarding Question #3, the environment for the exam is fixed and only available on CDH. Candidates do not have the option to take the exam in an HDP environment. The skills tested are applicable to HDP development as well, it is in the developer track, so it should have nothing to do with the environment that it is running in. It is primarily interested in transforming data that sits on the cluster.

Seaport · ‎02-19-2020

Finally, I figured out what is going on. The root cause is that, I only set up testuser on edge nodes, not the name node. I looked into this page, https://hadoop.apache.org/docs/r3.1.1/hadoop-project-dist/hadoop-common/GroupsMapping.html, which shows that "For HDFS, the mapping of users to groups is performed on the NameNode. Thus, the host system configuration of the NameNode determines the group mappings for the users." After I created the user on the NameNode and ran the command hdfs dfsadmin -refreshUserToGroupsMappings the copy is successful and there is no permission-denied error.

Seaport · ‎01-15-2020

@Shelton @EricL Thank you both. the correct ACL spec is group::r-x Now the following command works. sudo -u zeppelin hadoop fs -ls /warehouse/tablespace/managed/hive/test1 From what I just ran into, I feel that, by design, Hive takes extra effort to prevent users from accessing managed table files directly. I will follow that design and access Hive managed table only through Hive.

Seaport · ‎11-20-2019

@ManuelCalvo Thanks. Your solution works. My environment does not have Kerberos and Ranger enabled. So, I skipped step 2 For step 4, hbase.coprocessor.master.classes = org.apache.atlas.hbase.hook.HBaseAtlasCoprocessor Also, as I found out, Atlas currently only stores HBase metadata and does not store HBase lineage data as it does for Hive.

AKR · ‎11-12-2019

Hi, From the attached screenshot there are totally 14 applications are there and 14 has been submitted and also we are not able to see any memory and vcore allocated. could you please check whether all the configurations and memory has been allocated properly? Thanks AKR

Seaport · ‎11-06-2019

@sundar_gampa Try a different browser or a bigger monitor. Apparently, the page design makes the page adaptive to the viewing device.

cjervis · ‎09-17-2019

I am happy to see you sorted this out. The community has a responsive design so it adjusts based on the size of the window it is in. At a certain point the menu items collapse into a pull down on the upper left side of the page like you would see on a mobile device. Click on the three bars and the pull down appears, select community and then "ask a question is at the bottom of the list.

falbani · ‎09-11-2019

@Seaport Integration with Ranger is for Atlas Security and in case you want to use tag based policies which is one of the most common use cases for Ranger + Atlas. But is not a requirement, see following link: https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.0/configuring-atlas/content/additional_requirements_for_atlas_with_ranger_and_kerberos.html This is also mentioned in our documentation see more in section: Additional Requirements for Atlas with Kerberos without Ranger Finally, to install Atlas you are only required to have installed Infra Solr, Kafka and Hbase. Regards, Felix

Online	Offline
Last Visited	‎12-19-2024 08:12 PM

Member Since	‎04-03-2019 03:26 PM
Last Visited	‎12-19-2024 08:12 PM
Posts	92
Kudos received	6

Cloudera Community

Re: Zeppelin admin account does not have any permi...

Re: Preparation for CCP Data Engineer Exam (DE575)

Re: Owner Group Write Permision to an HDFS path

Re: "Ask a Question" button disappeared

Re: Yarn error - Skipping AM assignment as cluster...

Re: happybase not working

Re: Copy Files from Linux to HDFS - individually v...

Re: Preparation for CCP Data Engineer Exam (DE575)

Re: Owner Group Write Permision to an HDFS path

Re: HDFS folder permission denied, but the user is...

Re: HDP HBASE Classpath

Re: ACCEPTED: waiting for AM container to be alloc...

Re: List of questions I posted

Re: "Ask a Question" button disappeared

Re: Dependency of HDP Atlas on Ranger