About nsabharwal

tusharkathpal · ‎10-06-2020

@praveen_bora Java UDF's in Impala work differently than Hive. Since Hive is Java based, it will load all the jars in the Aux directory to the classpath, so any dependency jars are also picked up. Impala backends are C++ based, and it only picks up the specific jar configured when the UDF is defined, so you will need to bundle all dependency jars inside the UDF jar as well so the UDF is self contained in a single jar. There are certain restrictions of using UDFs for Hive in Impala. These restrictions are listed under "Using Hive UDFs with Impala" section in the link . https://www.cloudera.com/documentation/enterprise/5-8-x/topics/impala_udf.html

Krishnadevan · ‎08-13-2020

@torafca5 Could you please try downloading the jar from the below link, http://www.congiu.net/hive-json-serde/1.3.8/hdp23/json-serde-1.3.8-jar-with-dependencies.jar Once the jar is downloaded, move the jar to the location /usr/hdp/3.0.1.0-187/hive/lib. Please place the jar on all the nodes hosting Hive services. Also, please make sure you are not using LLAP(HiveserverInteractive) to connect to the hive. add jar command does not work with LLAP. implementing the above recommendation should help overcome this issue.

VikneshSK · ‎08-11-2020

I did this in root user, found the file and changed it there. But, how to change it for each node?

Muffex · ‎07-13-2020

Hello, I have the same issue. I want to permanently store a custom mapping. How could you resolve your issue? regards

asish · ‎06-30-2020

I see that you use Active DIrecyory Did you use the below property? +++ < property > < name > hive.server2.authentication.ldap.Domain </ name > < value > AD_Domain </ value > </ property > +++

Peter118 · ‎06-11-2020

Our installation had the password hash in another table. update ambari.user_authentication set authentication_key='538916f8943ec225d97a9a86a2c6ec0818c1cd400e09e03b660fdaaec4af29ddbb6f2b1033b81b00' where user_id='1' Note: user_id=1 was the admin in my case.

VidyaSargur · ‎06-08-2020

@gfeng As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also provide the opportunity to provide details specific to your environment that could aid others in providing a more accurate answer to your question.

Onedile · ‎05-13-2020

Yes this is possible. You need to kinit with the username that has been granted access to the SQL server DB and tables. integrated security passes your credentials to the SQL server using kerberos "jdbc:sqlserver://sername.domain.co.za:1433;integratedSecurity=true;databaseName=SCHEMA;authenticationScheme=JavaKerberos;" This worked for me.

Rhinorhino · ‎05-09-2020

Hi bigdatasuperno, I need a beeline shell script which should connect hive url and print the no. of tables in the db and print the record count of each table in the output file. Your help will greatly appreciated. I belongs to different technology. Regards, Vin

Kunwar · ‎05-06-2020

This could be permission issue. you can see the hive server2 log for the error. Log will be in /var/log/hive on the node to which you connect the hive

rahulsharma · ‎05-03-2020

20-05-04 04:25:52 DEBUG ClientCnxn:818 - Reading reply sessionid:0x171dc5f77f00040, packet:: clientPath:null serverPath:null finished:false header:: 23,3 replyHeader:: 23,1099,0 request:: '/hbase-unsecure,F response:: s{116,116,1477381693974,1477381693974,0,24,0,0,0,18,966} 2020-05-04 04:25:52 DEBUG ClientCnxn:717 - Got ping response for sessionid: 0x171dc5f77f00040 after 4ms 2020-05-04 04:25:52 DEBUG ClientCnxn:818 - Reading reply sessionid:0x171dc5f77f00040, packet:: clientPath:null serverPath:null finished:false header:: 24,4 replyHeader:: 24,1099,0 request:: '/hbase-unsecure/master,F response:: #ffffffff000146d61737465723a3136303030ffffffe330ffffff86ffffffafffffffd2352bffffffc850425546a23a1773616e64626f782e686f72746f6e776f726b732e636f6d10ffffff807d18ffffff95ffffffcaffffffbdffffffe3ffffff9d2e10018ffffff8a7d,s{938,938,1588541230259,1588541230259,0,0,0,104106568998453260,71,0,938} 2020-05-04 04:25:52 DEBUG RpcClientImpl:351 - Use SIMPLE authentication for service MasterService, sasl=false 2020-05-04 04:25:52 DEBUG RpcClientImpl:716 - Connecting to sandbox.hortonworks.com/127.0.0.1:16000 2020-05-04 04:25:54 INFO RpcRetryingCaller:132 - Call exception, tries=10, retries=35, started=64734 ms ago, cancelled=false, msg=

oudaysaada · ‎03-31-2020

you should install ambari-server and ambari-agent on the first node wich you want to install hdfs service for example . the other nodes install ambari-agent only . dont forget to change (ambari-agent.ini ) hostname and the hosts file with (ip and hostname of all machines.

pmadiot · ‎03-23-2020

hello, This wokarround didn't work for me. Configured the LDAP setup so that the BaseDN matches only 1 entry. calling " ambari-server sync-ldap --existing" didn't remove all existing LDAP Users and groups rather it deleted 2 only. may be i missed something, but after running the setup do we need to restart ambari-server? What should be the expected behaviour when runing the "ambari-server sync-ldap --all" and the BaseDN pointing to a single AD entry? The doc states the following for option '--exisiting' : "Users will be removed from Ambari if they no longer exist in LDAP, and group membership in Ambari will be updated to match LDAP". Since AD users still exist that would have no effect to remove the users even if baseDN points to single entry. What we are looking for (HDP2.6.5) is to remove all LDAP synced users other than these specified in --users users.txt and --groups group.txt. It looks like there is no such tool and we have to resort to manually use ambari APIs somehow. One thing i'm not sure is how are the lowercased alias being handled, since during the first sync we had the default value 'true' to force lower case, and now changed it to 'false' looking forward your insights

cjervis · ‎03-06-2020

@Ham As this is an older post you would have a better chance of receiving a resolution by starting a new thread. This will also provide the opportunity to provide details specific to your environment that could aid others in providing a more accurate answer to your question.

HKG · ‎02-10-2020

Awesome.It worked for me.

ask_bill_brooks · ‎02-04-2020

@asmarz, One of our members posted a reply on how to add users in the thread you posted a similar question to later the same day. As this is an older thread which was previously marked 'Solved', you would have a better chance of receiving a resolution by starting a new thread. This will also provide the opportunity for you to provide details specific to your environment about what you did in an attempt to add the relevant user accounts that could aid others in providing a more relevant, accurate answer to your question.

TimothySpann · ‎01-23-2020

Okay so I wrote an example nifi process to do it https://www.datainmotion.dev/2020/01/flank-stack-nifi-processor-for-kafka.html

lwang · ‎12-19-2019

@Augustine , Thanks for the feedback. I have corrected the answer and thank you for reporting this. Cheers, Li

HadoopHelp · ‎12-17-2019

Hi All . here is more Details about above :- https://community.cloudera.com/t5/Support-Questions/HDInsight-Vs-HDP-Service-on-Azure-Vs-HDP-on-Azure-IaaS/m-p/166424 Thanks HadoopHelp

NH · ‎11-28-2019

Hi, the link seems broken. Can you share with us the working one? Thanks.

ask_bill_brooks · ‎10-30-2019

Moved:

Moved this question from the original thread from Feb 2016.

komathigv · ‎11-09-2018

@Venu Shanmukappa how did u add the proxy.. can u pls explain

michaeljohn1986 · ‎12-12-2016

Hello, Kindly remove pam_profiles in below given lines and restart the drill. It will work. drill.exec { security.user.auth { enabled: true, packages += "org.apache.drill.exec.rpc.user.security", impl: "pam", pam_profiles: [ "sudo", "login" ] } } Thanks Michael N.

nsabharwal · ‎11-01-2016

Demo Extract data from images and store in HDFS. Documents with size less than 10mb stores into HBase. Document > 10mb lands into HDFS with metadata into HBase Part 1 - https://www.linkedin.com/pulse/cds-content-data-store-nosql-part-1-co-dev-neeraj-sabharwal

nsabharwal · ‎07-16-2016

OpenHAB - Build your smart home in no time! Welcome to http://www.openhab.org/ A vendor and technology agnostic open source automation software for your home. OpenHAB is a mature, open source home automation platform that runs on a variety of hardware and is protocol agnostic, meaning it can connect to nearly any home automation hardware on the market today. If you’ve been frustrated with the number of manufacturer specific apps you need to run just to control your lights, then I’ve got great news for you: OpenHAB is the solution you’ve been looking for – it’s the most flexible smart home hub you’ll ever find. Source Demo: Go to http://www.openhab.org/getting-started/downloads.html Download Runtime core and Demo files Extract Runtime core files in a directory called openHAB and extract Demo files under OpenHAB. See the following: Now, download smartphone app called openHAB in your smartphone. I am using iOS and once you launch the app then disable DEMO tab and enter the https://192.x.x.x IP:8443 in your local domain as shown below. You will be controlling the Room settings from your phone while openHAB is running in your machine or raspberry pi. For now, just for fun, I am running this in my mac and playing on my iOS. Docs and Examples If you want to test it like a "pro" then follow this example

Dominika · ‎11-30-2016

To get started with the HDCloud for AWS general availability version, visit http://docs.hortonworks.com/HDPDocuments/HDCloudAWS/HDCloudAWS-1.8.0/bk_hdcloud-aws/content/index.html

gauravb117 · ‎12-06-2017

@nallen Hey, even I am not able to setup Metron on a single node VM, it is giving me heartbeat lost error and when I check ambari-agent logs it gives me SSL certificate verify failed Need Help!!

nsabharwal · ‎07-07-2016

@Neha Sinha I executed this pip install --upgrade setuptools --user python to fix the above error TASK [ambari_config : check if ambari-server is up on node1:8080] ************** fatal: [node1]: FAILED! => {"changed": false, "elapsed": 300, "failed": true, "msg": "Timeout when waiting for node1:8080"} PLAY RECAP ********************************************************************* node1 : ok=11changed=5 unreachable=0 failed=1 Ansible failed to complete successfully. Any error output should be visible above. Please fix these errors and try again.

nsabharwal · ‎07-05-2016

Chronos is a replacement for cron. A fault tolerant job scheduler for Mesos which handles dependencies and ISO8601 based schedules Marathon is a framework for Mesos that is designed to launch long-running applications, and, in Mesosphere, serves as a replacement for a traditional system In Mesosphere, Chronos compliments Marathon as it provides another way to run applications, according to a schedule or other conditions, such as the completion of another job. It is also capable of scheduling jobs on multiple Mesos slave nodes, and provides statistics about job failures and successes. Source Install https://mesos.github.io/chronos/docs/ and gist Demo Part 1 - https://www.linkedin.com/pulse/data-center-operating-system-dcos-part-1-neeraj-sabharwal Part 2 - https://www.linkedin.com/pulse/apache-marathon-part-2-neeraj-sabharwal

nsabharwal · ‎07-05-2016

You need Mesos to run this - Post 1 What is Apache Marathon? Marathon is a production-grade container orchestration platform for Mesosphere'sDatacenter Operating System (DCOS) and Apache Mesos. I am launching multiple applications using Marathon and Mesos is providing the framework to launch those applications. Demo More reading https://mesosphere.github.io/marathon/ Gist & Application example

Online	Offline
Last Visited	‎07-18-2019 05:10 PM

Date Registered	‎09-18-2015 05:49 PM
Last Visited	‎07-18-2019 05:10 PM
Total Messages Posted	3,274
Total Kudos Received	1143

Re: Is Ranger KMS Encryption FIPS 140-2 compliant ...

Re: How to add another HiveServer for current meta...

Re: FQDNs - are they necessary?

Re: java.io.FileNotFoundException: (Is a director...

Re: Need Design/Architecture Suggestion on HDP & H...

Re: can we use the hive udf in impala query

Re: Hive and XML Parsing

Re: How to get rid of stale alerts in Ambari

Re: Permanently add data type mappings to Hive.

Re: LDAP: error code 49 when setting LDAP auth for...

Re: How to reset Ambari Admin password?

Re: default username/password for Ambari?

Re: Sqoop to SQL Server with Integrated Security

Re: Hive beeline -e in shell script

Re: Insert overwrite query failing with Execution ...

Re: How do I connect to HBase on Sandbox VM from h...

Re: Can Ambari server and agent run on same host ?

Re: How do I remove LDAP accounts from Ambari

Re: How to start flume agent using ambari?

Re: Cannot start data node - did the troubleshooti...

Re: MapReduce job failing after kerberos

Re: Is it possible to ingest data into kafka from ...

Re: Recommended value for vm.overcommit_memory for...

Re: HDInsight Component Comparison to HDP

Re: How to Completely Clean, Remove or Uninstall A...

Re: NIFI Twitter extract, ID's to follow is not wo...

Re: How to copy HDFS file to AWS S3 Bucket? hadoo...

Re: how to set up pam authentication for Apache dr...

Content Data Store

OpenHAB - IOT and you can set up

Re: HDP-AWS (Hortonworks-AWS)

Re: Metron setup - full-dev-platform

Re: Apache Metron dev install error

Apache Chronos

Marathon - PaaS to deploy applications