About sanjeevanmahaja

sanjeevanmahaja · ‎03-25-2017

@Jay SenSharma Yes it is pointing to the correct version 2.4.3.13-1. Nothing is there in Ambari logs as well

sanjeevanmahaja · ‎03-25-2017

@Jay SenSharma Yes it is pointing to the correct version 2.4.3.13-1. Nothing is there in Ambari logs as well

sanjeevanmahaja · ‎03-25-2017

I was expecting 2.4.3.13-1 . The output is below : hdp-select accumulo-client - None accumulo-gc - None accumulo-master - None accumulo-monitor - None accumulo-tablet - None accumulo-tracer - None atlas-server - 2.4.3.13-1 falcon-client - 2.4.3.13-1 falcon-server - 2.4.3.13-1 flume-server - None hadoop-client - 2.4.3.13-1 hadoop-hdfs-datanode - 2.4.3.13-1 hadoop-hdfs-journalnode - 2.4.3.13-1 hadoop-hdfs-namenode - 2.4.3.13-1 hadoop-hdfs-nfs3 - 2.4.3.13-1 hadoop-hdfs-portmap - 2.4.3.13-1 hadoop-hdfs-secondarynamenode - 2.4.3.13-1 hadoop-httpfs - 2.4.3.13-1 hadoop-mapreduce-historyserver - 2.4.3.13-1 hadoop-yarn-nodemanager - 2.4.3.13-1 hadoop-yarn-resourcemanager - 2.4.3.13-1 hadoop-yarn-timelineserver - 2.4.3.13-1 hbase-client - 2.4.3.13-1 hbase-master - 2.4.3.13-1 hbase-regionserver - 2.4.3.13-1 hive-metastore - 2.4.3.13-1 hive-server2 - 2.4.3.13-1 hive-webhcat - 2.4.3.13-1 kafka-broker - None knox-server - 2.4.3.13-1 livy-server - None mahout-client - None oozie-client - 2.4.3.13-1 oozie-server - 2.4.3.13-1 phoenix-client - 2.4.3.13-1 phoenix-server - 2.4.3.13-1 ranger-admin - 2.4.3.13-1 ranger-kms - 2.4.3.13-1 ranger-usersync - 2.4.3.13-1 slider-client - 2.4.3.13-1 spark-client - 2.4.3.13-1 spark-historyserver - 2.4.3.13-1 spark-thriftserver - 2.4.3.13-1 sqoop-client - 2.4.3.13-1 sqoop-server - 2.4.3.13-1 storm-client - 2.4.3.13-1 storm-nimbus - 2.4.3.13-1 storm-slider-client - 2.4.3.13-1 storm-supervisor - 2.4.3.13-1 zeppelin-server - None zookeeper-client - 2.4.3.13-1 zookeeper-server - 2.4.3.13-1 rpm -qa | grep sqoop sqoop_2_4_2_0_258-1.4.6.2.4.2.0-258.el6.noarch sqoop_2_4_3_13_1-1.4.6.2.4.3.13-1.el6.noarch sqoop_2_4_3_0_227-metastore-1.4.6.2.4.3.0-227.el6.noarch sqoop_2_2_4_10_1-1.4.5.2.2.4.10-1.el6.noarch sqoop_2_2_4_10_1-metastore-1.4.5.2.2.4.10-1.el6.noarch sqoop_2_4_3_13_1-metastore-1.4.6.2.4.3.13-1.el6.noarch sqoop_2_4_2_0_258-metastore-1.4.6.2.4.2.0-258.el6.noarch sqoop_2_4_3_0_227-1.4.6.2.4.3.0-227.el6.noarch

sanjeevanmahaja · ‎03-25-2017

@JaySenSharma : Actually if I run yum list sqoop command. It does not show me the package in the version which I have installed. yum list sqoop Loaded plugins: changelog, downloadonly, kabi Loading support for Red Hat kernel ABI Available Packages sqoop.noarch 1.4.6.2.5.3.0-37.el6 HDP-2.4.3.0 HDP-2.4.3.0 is the older version, I have upgraded it to a new version of HDP 2.4.3.X.X which is a patched version

sanjeevanmahaja · ‎03-25-2017

I have done HDP Rolling Upgrade. The services are all running fine. However, all the clients which are there they are in red(triangle state) , even when I refresh the configs the operation successfully completes but the client does not start. Do you know what could be the potential root cause or what needs to be done.

sanjeevanmahaja · ‎10-07-2016

I am working on a aws dataset(email dataset -enron) . I just wanted to do a word count on all of the emails and find out the average. The files are zipped (Please see the screen shot attachment which shows how the actual data set looks like). Please if some one could help me by looking at the scrscreen-shot-2016-10-07-at-090457.pngeen shot that how I can do the word count processing using spark (scala preferably). I would really appreciate . Note: The actual datasize is 210 GB. I am planning to run an EMR cluster then perform the processing.

sanjeevanmahaja · ‎09-06-2016

@bpreachuk and @Constantin Stanca Thanks a lot for resolving this.

sanjeevanmahaja · ‎09-06-2016

@ Constantin Stanca : Thanks a lot for the help but Its is still giving semantic exception Invalid table alias or column reference 's': possible column names are emp_no, salary, from_date, to_date

sanjeevanmahaja · ‎09-02-2016

@Daniel Kozlowski Still not

sanjeevanmahaja · ‎09-02-2016

@Daniel Kozlowski Please see attached screen grab screen-shot-2016-09-02-at-225412.png

sanjeevanmahaja · ‎09-02-2016

@Daniel Kozlowski : It's still gives an exception "Expression not in Group By key emp_no"

sanjeevanmahaja · ‎09-02-2016

> Not sure can use select min(from_date) clause create table employees2_final stored as ORC tblproperties (‘orc.compress’=‘SNAPPY’) AS SELECT e.emp_no, e.birth_date,e.first_name, e.last_name, e.gender, select min(s.from_date) from new2_salaries s GROUP BY s.emp_no WHERE s.emp_no = e.emp_no as hire_date_new from employees e.

sanjeevanmahaja · ‎04-27-2016

It worked Thanks

sanjeevanmahaja · ‎04-27-2016

@Alessio Ubaldi : Thanks the query has started but its still failing. I guess I am still missing something. screen-shot-2016-04-27-at-092033.png

sanjeevanmahaja · ‎04-27-2016

Please find the attached for the error screen grabscreen-shot-2016-04-27-at-082448.png Sqoop Query : sqoop import --driver com.mysql.jdbc.Driver --connect jdbc:mysql://sandbox.hortonworks.com/test --username root -P --m 1 --query "select empid, ename from emp WHERE '$CONDITIONS' AND eid > '200' " --target-dir /user/maria_dev

sanjeevanmahaja · ‎04-22-2016

I am trying this create table emp1 LIKE emp CLUSTERED BY () INTO 4 BUCKETS STORED AS ORC; Its giving a parse exception : rg.apache.ambari.view.hive.client.HiveInvalidQueryException:Errorwhile compiling statement: FAILED:ParseException line 4:42 missing EOF at 'CLUSTERED' near 'emp'[ERROR_STATUS] org.apache.ambari.view.hive.client.HiveInvalidQueryException:Errorwhile compiling statement: FAILED:ParseException line 4:42 missing EOF at 'CLUSTERED' near 'emp'[ERROR_STATUS] at org.apache.ambari.view.hive.client.Utils.verifySuccess(Utils.java:46)

sanjeevanmahaja · ‎02-23-2016

@Neeraj Sabharwal : Thanks for your reply but I have earlier used ambari-server sync-ldap --all . It has synced all the users which are in the Active Directory. How I can revert the changes and sync only certain groups. I have got the command for syncing certain groups with Ambari but the question is how I can remove all the users (which are already synced)

sanjeevanmahaja · ‎02-23-2016

I have synced all the Ambari AD. Can anyone let me know how to async the existing users.

sanjeevanmahaja · ‎02-16-2016

@Neeraj Sabharwal : Kool it worked beautifully. Thanks a lot

sanjeevanmahaja · ‎02-16-2016

@Neeraj Sabharwal Thanks Budd 🙂 will try that

sanjeevanmahaja · ‎02-16-2016

I am planning to download Ambari Blueprint from the cluster. I have heard there is a way . Can anyone help me on this.

sanjeevanmahaja · ‎02-12-2016

Sorry there is typo in the question its without using Load Balancer

sanjeevanmahaja · ‎02-12-2016

Can anyone share any documentation on configuring HA for Oozie and Hive without Load Balancer.

sanjeevanmahaja · ‎02-11-2016

@Neeraj Sabharwal Thanks 🙂

sanjeevanmahaja · ‎02-11-2016

Where I can find the severity of the log message for every component. I am looking in log4j.properties for respective component but not able to find it for all the logs.

sanjeevanmahaja · ‎02-09-2016

@Artem Ervits : Thanks a lot for the reply. So for Kafka in the above document we need to comment (hash) below mentioned properties Comment out the appender’s date pattern: #log4j.appender.kafkaAppender.DatePattern='.'yyyy-MM-dd-HH #log4j.appender.kafkaAppender=org.apache.log4j.DailyRollingFileAppender

sanjeevanmahaja · ‎02-09-2016

How to switch off the log rotation in hadoop. The log rotation is currently done by the log4j. I am trying to collect individual log file details and also SEV levels

sanjeevanmahaja · ‎02-03-2016

Also have used this hadoop.http.staticuser.user=hdfs. Still not working

sanjeevanmahaja · ‎02-03-2016

@Artem Ervits The cluster is kerberized. I tried that but it didn't worked

sanjeevanmahaja · ‎02-03-2016

I am trying to view Namenode Logs in Ambari - I am login as admin but its giving dr.who (which I guess is permission issues)

Online	Offline
Last Visited	‎04-03-2017 03:22 PM

Date Registered	‎01-27-2016 02:50 PM
Last Visited	‎04-03-2017 03:22 PM
Total Messages Posted	48
Total Kudos Received	9

Re: In Ambari All the services are running but for...

Re: In Ambari All the services are running but for...

Re: In Ambari All the services are running but for...

Re: In Ambari All the services are running but for...

In Ambari All the services are running but for cli...

How to process a word count on zipped files in spa...

Re: Hive Query not working

Re: Hive Query not working

Re: Hive Query not working

Re: Hive Query not working

Re: Hive Query not working

Hive Query not working

Re: Sqoop import failing importing a simple table ...

Re: Sqoop import failing importing a simple table ...

Sqoop import failing importing a simple table from...

Error while creating a table with 'LIKE' clause

Re: How to "async LDAP" users from ambari

How to "async LDAP" users from ambari

Re: Is there any way to download Ambari Blueprint ...

Re: Is there any way to download Ambari Blueprint ...

Is there any way to download Ambari Blueprint from...

Re: How to configure Oozie and Hive High Availabil...

How to configure Oozie and Hive High Availability ...

Re: Where I can find the severity of the log messa...

Where I can find the severity of the log message f...

Re: How to switch off the log rotation in hadoop

How to switch off the log rotation in hadoop

Re: Not able to view Namenode UI logs from Ambari

Re: Not able to view Namenode UI logs from Ambari

Not able to view Namenode UI logs from Ambari