About ravi1

ravi1 · ‎04-25-2016

Thanks @bhagan. If you can move this to answer, I will accept it as an answer. I am planning to add few of my learnings on this into an article here soon.

ravi1 · ‎04-25-2016

http://localhost:9995 on your host machine. There is port forwarding configured and zeppelin on sandbox is configured to run on port 9995

ravi1 · ‎04-25-2016

Is this an existing table that is based on avro? From the logs that looks like the case. If you want to import as parquet, try creating a new hive-table with the above command.

ravi1 · ‎04-25-2016

You can have a different character and 'lines terminated by'. You can put a special character for that instead of \n which is the default.

ravi1 · ‎04-25-2016

HDP service ports are here. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_HDP_Reference_Guide/content/reference_chap2.html Ambari ports are here. https://docs.hortonworks.com/HDPDocuments/Ambari-2.2.0.0/bk_ambari_reference_guide/content/_default_network_port_numbers_-_ambari.html

ravi1 · ‎04-21-2016

Can you post the nodemanagers logs for node1 and node2 as well?

ravi1 · ‎04-21-2016

Can you send what is the error that you getting with this delete? Unless quotas are set, you should not see any issues with 'Trash' going in.

ravi1 · ‎04-21-2016

Error says namenode is not formatted. Is this a new install? hadoop namenode -format (as hdfs/hadoop user) This will format your namenode and you can start back, but if you have any data already in, you will lose it. So be careful when you run this one.

ravi1 · ‎04-21-2016

From past experiences, use this one to be a high number, like atleast a week. While some accidental deletes are identified immediately, there are some cases when we only know about accidental data delete when we are debugging another issue downstream. If your cluster has good free space right now, leave it at a one week or two so you will have enough time to revert back deletes.

ravi1 · ‎04-21-2016

Good summary. My original comment was not against computations on both clusters locally, but against exporting data locally to csv and doing a diff. That is something that I try to avoid unless that data is very small.

Online	Offline
Last Visited	‎12-18-2021 05:54 PM

Member Since	‎01-09-2019 05:01 PM
Last Visited	‎12-18-2021 05:54 PM
Posts	401
Kudos received	163

Cloudera Community

Re: 2 hosts not running master services

Re: ambari restart and service restart updating kr...

Re: How to automate sqoop incremental import using...

Re: Path to core-site.xml in sandbox?

Re: Curious to know why majority of the people are...

Re: Can sqoop be used to directly import data into...

Re: I have installed Sandbox for Virtual Box. Wher...

Re: Import data directly in as-parquetfile format

Re: Storing Multiline character fields in hive tab...

Re: Ports to be enabled in AWS Security Policy

Re: Node manager restart fails during upgrade / do...

Re: is there any size limit on the file that has b...

Re: Namenode is failiting to start on HADP with wi...

Re: hdfs trash compaction

Re: How to compare two hive tables that are in dif...