Member since
09-24-2015
527
Posts
136
Kudos Received
19
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2130 | 06-30-2017 03:15 PM | |
3053 | 10-14-2016 10:08 AM | |
8318 | 09-07-2016 06:04 AM | |
10063 | 08-26-2016 11:27 AM | |
1450 | 08-23-2016 02:09 PM |
04-27-2016
06:49 PM
Hi: for ETL which is the best tecnologie NOT Streaming to make a script, actually iam using Pig but i dont know if for batching is ok. please any suggestion?? IN the future ill do it with spark. Thanks
... View more
Labels:
- Labels:
-
Apache Hadoop
04-27-2016
06:22 AM
Hi: Actually my unique master has 12 cores and 47 gb ram y new machine will have 256 ram and 12 and 20 cors, it will be ok??
... View more
04-26-2016
01:58 PM
Hi: Yes ill make Namenode HA (High Availability), but the active namenode will have more hardware that the stanby namenode, will be a problem??? thanks
... View more
04-26-2016
01:40 PM
Hi. My primary namenode has the double hardware of the secondary namenode, is a good architecture??? Thanks
... View more
04-13-2016
09:29 PM
Finally i start with this: hadoop jar h2odriver_hdp2.1.jar water.hadoop.h2odriver -libjars ../h2o.jar -mapperXmx 1g -nodes 1 -output hdfsOutputDirName
... View more
04-12-2016
10:10 AM
Hi: After delete everything into the /usr/hdp directory is working de command now: [root@lnxbig05 hdp]# hdp-select versions
2.4.0.0-169
[root@lnxbig05 hdp]# ls -lrt
total 24
drwx------ 2 root root 16384 Apr 1 12:39 lost+found
drwxr-xr-x 33 root root 4096 Apr 7 09:43 2.4.0.0-169
drwxr-xr-x. 2 root root 4096 Apr 12 11:46 current
Many thanks.
... View more
04-12-2016
09:41 AM
1 Kudo
Hi: When i type this i saw this error, and its the script that ambari is executing to install any client o package, what is happening?? [root@lnxbig05 yum.repos.d]# hdp-select set all on 2.4.0.0-169
ERROR: set command takes 2 parameters, instead of 3
usage: hdp-select [-h] [<command>] [<package>] [<version>]
Set the selected version of HDP.
positional arguments:
<command> One of set, status, versions, or packages
<package> the package name to set
<version> the HDP version to set
optional arguments:
-h, --help show this help message and exit
-r, --rpm-mode if true checks if there is symlink exists and creates the symlink if it doesn't
Commands:
set : set the package to a specified version
status : show the version of the package
versions : show the currently installed versions
packages : show the individual package names
... View more
04-12-2016
09:08 AM
Hi: still the same error 2016-04-12 10:47:22,828 - Checking if need to create versioned conf dir /etc/hadoop/2.4.0.0-169/0
2016-04-12 10:47:22,828 - call['conf-select create-conf-dir --package hadoop --stack-version 2.4.0.0-169 --conf-version 0'] {'logoutput': False, 'sudo': True, 'quiet': False, 'stderr': -1}
2016-04-12 10:47:22,940 - call returned (1, '/etc/hadoop/2.4.0.0-169/0 exist already', '')
2016-04-12 10:47:22,940 - checked_call['conf-select set-conf-dir --package hadoop --stack-version 2.4.0.0-169 --conf-version 0'] {'logoutput': False, 'sudo': True, 'quiet': False}
2016-04-12 10:47:23,232 - checked_call returned (0, '/usr/hdp/2.4.0.0-169/hadoop/conf -> /etc/hadoop/2.4.0.0-169/0')
2016-04-12 10:47:23,233 - Ensuring that hadoop has the correct symlink structure
2016-04-12 10:47:23,233 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2016-04-12 10:47:23,234 - Executing hdp-select set all on 2.4.0.0-169
2016-04-12 10:47:23,234 - Execute['ambari-sudo.sh /usr/bin/hdp-select set all `ambari-python-wrap /usr/bin/hdp-select versions | grep ^2.4.0.0-169 | tail -1`'] {'only_if': 'ls -d /usr/hdp/2.4.0.0-169*'} How to know if the symlink is ok???
... View more
04-12-2016
07:42 AM
Hi: I need to know if i can delete from database the extra row, also the skip_sc_failures column with value =1 is error or ok??
ambari=> select * from upgrade;
upgrade_id | cluster_id | request_id | from_version | to_version | direction | downgrade_allowed | skip_failures | skip_sc_failures | upgrade_pac
kage | upgrade_type
------------+------------+------------+--------------+--------------+-----------+-------------------+---------------+------------------+---------------
---------+--------------
1 | 2 | 820 | 2.3.2.0-2950 | 2.4.0.0-169 | UPGRADE | 1 | 1 | 0 | nonrolling-upg
rade-2.4 | NON_ROLLING
2 | 2 | 821 | 2.3.2.0-2950 | 2.3.2.0-2950 | DOWNGRADE | 1 | 0 | 0 | nonrolling-upg
rade-2.4 | NON_ROLLING
3 | 2 | 894 | 2.3.2.0-2950 | 2.4.0.0-169 | UPGRADE | 1 | 1 | 1 | nonrolling-upg
rade-2.4 | NON_ROLLING
... View more
04-12-2016
05:59 AM
1 Kudo
Hi: Many thanks all of you, here is the information: [root@lnxbig05 bigotes]# rpm -qa|grep hdp-select
hdp-select-2.4.0.0-169.el6.noarch
[root@lnxbig05 bigotes]# hdp-select
accumulo-client - None
accumulo-gc - None
accumulo-master - None
accumulo-monitor - None
accumulo-tablet - None
accumulo-tracer - None
atlas-server - 2.4.0.0-169
falcon-client - 2.4.0.0-169
falcon-server - 2.4.0.0-169
flume-server - 2.4.0.0-169
hadoop-client - 2.4.0.0-169
hadoop-hdfs-datanode - 2.4.0.0-169
hadoop-hdfs-journalnode - 2.4.0.0-169
hadoop-hdfs-namenode - 2.4.0.0-169
hadoop-hdfs-nfs3 - 2.4.0.0-169
hadoop-hdfs-portmap - 2.4.0.0-169
hadoop-hdfs-secondarynamenode - 2.4.0.0-169
hadoop-httpfs - 2.4.0.0-169
hadoop-mapreduce-historyserver - 2.4.0.0-169
hadoop-yarn-nodemanager - 2.4.0.0-169
hadoop-yarn-resourcemanager - 2.4.0.0-169
hadoop-yarn-timelineserver - 2.4.0.0-169
hbase-client - 2.4.0.0-169
hbase-master - 2.4.0.0-169
hbase-regionserver - 2.4.0.0-169
hive-metastore - 2.4.0.0-169
hive-server2 - 2.4.0.0-169
hive-webhcat - 2.4.0.0-169
kafka-broker - 2.4.0.0-169
knox-server - None
mahout-client - None
oozie-client - 2.4.0.0-169
oozie-server - 2.4.0.0-169
phoenix-client - 2.4.0.0-169
phoenix-server - 2.4.0.0-169
ranger-admin - None
ranger-kms - None
ranger-usersync - None
slider-client - 2.4.0.0-169
spark-client - 2.4.0.0-169
spark-historyserver - 2.4.0.0-169
spark-thriftserver - 2.4.0.0-169
sqoop-client - 2.4.0.0-169
sqoop-server - 2.4.0.0-169
storm-client - 2.4.0.0-169
storm-nimbus - 2.4.0.0-169
storm-slider-client - 2.4.0.0-169
storm-supervisor - 2.4.0.0-169
zeppelin-server - None
zookeeper-client - 2.4.0.0-169
zookeeper-server - 2.4.0.0-169
... View more