Member since
05-16-2016
783
Posts
111
Kudos Received
39
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
877 | 06-12-2019 09:27 AM | |
1711 | 05-27-2019 08:29 AM | |
3224 | 05-27-2018 08:49 AM | |
2894 | 05-05-2018 10:47 PM | |
1934 | 05-05-2018 07:32 AM |
06-08-2018
10:12 AM
Could you the share the HUE / mapreduce log trace ? also do you have Namenode HA configured ?
... View more
06-06-2018
10:36 PM
are you still facing the issue ? could you let me know
... View more
06-04-2018
05:45 AM
Could you let me know why was the restart required . Did you make any changes ?
... View more
05-27-2018
08:49 AM
The client does not know which is active / standy namenode it will only usess dfs.nameservices . DFS Client will determine which NameNode is the current Active, by using the either of the java classess which ever is implemented ConfiguredFailoverProxyProvider and the RequestHedgingProxyProvider, then subsequently it will invoke the ids and followed by the host identification by using the properties in hdfs-site.xml ( please refer the below link for the properties . https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithQJM.html
... View more
05-26-2018
08:08 PM
1 Kudo
@BJ 1:-- Is it ok to persue CCA131 for unix administration - Yes , a little bit of Core Java Concepts could help you land smoothly because the hadoop logs are generated in java and python. 2:--I don't have any coding skills, does this matter in learning - When you want be Hadoop Administrator you dont need to be hard corder however a little bash scripting could help you with some tasks . Also something like chef ,puppet or Ansible . 3:-- how to prepare for exams, You can spin up quickly a Single Node cluster using QuickStartVm almost 80% of it you use it for preparation for your exam . Some books to read before exam- Hadoop Operations and Hadoop Definitive guide. Hope this is suffice
... View more
05-26-2018
08:00 PM
The pre-requistes of configuring HA is zookeeper and FailoverController . then you should provide the type of fencing for proof of concept you can use shell dfs.ha.fencing.methods znode in ZooKeeper will be used by failover controllers to keep track of the active and standby nodes, and start the failover controllers if necessary . However you can also perform manual failover for any maintance activity .
... View more
05-25-2018
11:31 PM
I am not sure which version of CDH version you runining but based on the documenation looks like you can use the yarn logs command in the mentioned version of CDH https://archive.cloudera.com/cdh5/cdh/5/hadoop/hadoop-yarn/hadoop-yarn-site/YarnCommands.html Try enabling this property in the server side configuration in cloudera manager. Client do not have access to this property in case if you had enabled in the client side .
... View more
05-25-2018
11:23 PM
1 Kudo
Would you consider converting them to HAR file . Below is the reference for further reading https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Archiving
... View more
05-23-2018
02:30 AM
Could you share the logs ? fire the below command . cdsw logs
... View more
05-10-2018
06:13 AM
Hi Please do refer the below link and let me know if that is suffice . https://github.com/cloudera/cm_ext/wiki/Building-a-parcel
... View more
05-10-2018
06:04 AM
You Welcome . Are you runining Aspire on the rest of the nodes . Whats that A stands for ? I see HS2 hbase LB RM JHS , HBASE and management services Correct me if i am wrong .
... View more
05-09-2018
08:04 AM
Try to do a ping to the host were Service monitor is deployed see if you have any packet loss , if so check with Network team. We had similar issue it was due to some network nic card problem.
... View more
05-09-2018
08:01 AM
You have way too many roles on the first host . I am not sure if that is the host that is exhausting from the cpu if so then try re-deploying some of the roles to other host .
... View more
05-09-2018
07:55 AM
Could you please mark it as answered so the community will be benifited ?
... View more
05-09-2018
07:50 AM
Sorry for asking too many questions i am trying to understand the situtation . idealy speaking -1 should be suffice because it uses 40 % of the resource . What does your kudu table look like hash and range partitioning ?
ENCODING Attribute ? BLOCK_SIZE ?
... View more
05-07-2018
07:18 AM
whats the value on -block_manager_max_open_files the default is -1
... View more
05-07-2018
06:24 AM
could you let us know how many tablet servers are being used currently and also the Kudu version
... View more
05-05-2018
10:47 PM
I would put it as Cloudera and free , unlimited license as license type for cloudera express edition. Based on the cloudera Kb.
... View more
05-05-2018
07:32 AM
2 Kudos
Not all the connectors are supported and mostly its a two step process to transfer data from RDBMS to hive / hbase .In my poc testing performance compared to sqoop2 is not up to the level of sqoop 1 .So i would prefer sqoop 1 more over sqoop 2 is deprecated .
... View more
05-05-2018
12:30 AM
is that single node or multi node cluster that you had installed ? sudo tarball_root/etc/init.d/cloudera-scm-server start
sudo tarball_root/etc/init.d/cloudera-scm-agent start After getting into the Cloudera manager Web Ui You can start the roles on the HDFS instance like namenode datanode if you deploying the cluster for POC or pratice . Path A installation is quick and easy . https://www.cloudera.com/documentation/enterprise/5-8-x/topics/cm_ig_install_path_a.html
... View more
05-05-2018
12:27 AM
I believe the below link will give you an idea of what you can get out from express and enterprise edition . Apart from the below link i think you wont be able to perform rollback of the configuration changes , cloudera navigator , disk management ,rolling upgrade etc . Let me know if this suffice . http://www.cloudera.com/documentation/manager/5-1-x/Cloudera-Manager-Installation-Guide/cm5ig_feature_differences.html
... View more
05-03-2018
10:18 PM
based on the Cloudera KM below is the latest / recommended version that was tested 1.8u144
... View more
05-02-2018
09:48 PM
05-02-2018
09:45 PM
Go to System->preference->sound below you see an Output Volume - if you have a check in the mute , uncheck it . it will be good. Let me know if that helps.
... View more
05-02-2018
09:41 PM
Looks like your namenode is in safe mode that means read only operation is supported based on the logs been provided i could see the below Name node is in safe mode.
... View more
05-02-2018
09:44 AM
if you just want to load the image in the hive table not process fruther use binary data type , but to view or process you need to have like some java code to convert that into binary data before you load in to hive table. Something like Create table imageTable(id int , picture binary);
Load statement - point to the image location ..
could be either managed or external table
... View more
05-02-2018
09:28 AM
are you using beeline client tool ? did you try increasing heap on the below property HADOOP_CLIENT_OPTS just curious to know below following what file format are you using ? is there any compression ? is table stats being collected ? is table being partitioned or buckted ?
... View more