@Cloudera learning   - Did you had a chance to raise the datanode bandwidh , Datanode heapsize , increase the replication work multiplier before kicking of the decommision . this will certainly increase the performance.  Also if your decommision is runining for ever  i would suggest you to commission it back and perform decommision it again.  - ... View more

Hello folks, I am facing knowledge gap while trying to work with Cloudera CHD with AWS services . The issues enlisted down, I am pretty sure these have been faced and resolved, given the popularity of cloud hosted ms-sql servers. Would be grateful to recieve help I was able to solve the "class not found"issue by downloading another jar file from this website : http://www.java2s.com/Code/Jar/s/Downloadsqljdbc420jar.htm  and added to the sqoop2 library. This is done with the Generic-jdbc- connector. However, I am not able to establish the connection , and I suspect the problem is with the JDBC connection string. I am supposed to connect  from the sqoop's Cloudera Quickstart VM to MS-SQL server that is running on the AWS RDS instance. So the syntax  of the Connection string I have given is as follows:   jdbc:sqlserver://<RDS end point DNS>:<Port Name>/<DataBase name>  I have configured the security group of my RDS instance to allow outbound connections, so this could rule out the firewall issues(I suppose) I have an understanding void with the  RDS end point DNS value being resolved into an IP address  The IP address the DNS lookup provides isn't static and tend to chane for failover reasons, could this be the issue to establish a connection? Thank you for your time. ... View more

thanks lot off for your valuable cooperation ... View more

Hi, referring to the last step, do you encounter the Permission denied error when doing scp?  sudo scp user@cluster:/etc/hadoop/conf/* /etc/hadoop/conf    I managed to copy all the files inside /conf except for container-executor.cfg which shows the message in terminal below: scp: /etc/hadoop/conf/container-executor.cfg: Permission denied ... View more

Gzip decompression will definitely use more CPU than snappy decompression, so I'd usually expect Gzip to give you worse performance, unless your query is limited by disk I/O (in which case smaller is better) or if your query isn't limited by scan performance. ... View more

Hello everybody I have the same problem is what you have solved your problem Any sugestion plz  can you share your solution plz @MSharma   ... View more

Hi All,     Thank you for your resolution. I was able to resolve the issue. The issue was with /etc/hosts file and the firewall service was also running, so stopped that as well. ... View more

Hi @SandyCT, well, this system is broken a bit more than I expected, since owner of groups is also damaged. What did you run exactly? If I had to guess, some recursive chmod on /, or /etc? Before you try this last option, try switching to console (ctrl+alt+F1 on a normal pc, not sure about the vm), and logging in as root, with password "cloudera". If this does not work, for whichever reason, here's a way to reboot Centos 6 in "safe mode". I suggest you make a backup of the whole vm file/directory first. https://lintut.com/reset-forgotten-root-password-in-centos/ If this does not work (I cannot test now, since I don't have my vm around), replace " 1 " in the tutorial with "rw init=/bin/bash" In either case, this will grant you root, but fixing your vm might take a while. For example, your sudo command should be "---s--x--x", or something to that regard, /etc/sudoers "-r--r-----", and "/etc/group" -rw-r--r--. Have fun & good luck! 🙂 ... View more