About bhavintandel

bhavintandel · ‎08-21-2017

@Félicien Catherin have you set CLASSPATH variable in zeppelin-env, if yes, please comment it and try again.

bhavintandel · ‎07-11-2017

@Facundo Bianco you could define, 1. Parent queue PRP(pre production) min:50%, max:100% which has two leaf queue DEV and LABS. Both leaf queue will have min:50% and max:100% 2. PRD(production) with min:50%, max:50%. In this set up, child queue for example DEV could use 100% resouces if its idle. But for this setup we need to have pre-emption enable.

bhavintandel · ‎06-24-2017

For example, I ran that analyze query from the job on one hiveserver. Then opened one other connection to the same hiveserver and Executed "show databases" command. It took 492 seconds (8.2 minutes) to get the response. Is the following jira relevant: https://issues.apache.org/jira/browse/HIVE-13374

bhavintandel · ‎05-21-2017

bhavintandel · ‎05-10-2017

Hey Daniel, Thanks for the response, however this is possible only if we can see the notebook but if the user has restricted reader then we will not be able to see the notebook on our UI. For example: So no other user will be able to see the notebook. P.S. This might be only in zeppelin 0.7

bhavintandel · ‎05-04-2017

This is needed because, if a user leaves the company then we should clean up the zeppelin.

bhavintandel · ‎04-19-2017

@yvora Sorry for late reply, i am again getting the same issue. It is just sc.version

bhavintandel · ‎04-18-2017

Its actually in-memeory database by SAS and they has to say that they can see their DB running.

bhavintandel · ‎04-13-2017

So our application is requesting the containers but they are already running but we also see that Total Outstanding Resource Requests: <memory:921600, vCores:6> So bit confused that App is running or not. This is the app_attempt UI Also I am not able to see the logs for that containers as this will be ever running job.

bhavintandel · ‎04-10-2017

Could we have for instance Zeppelin 0.7 from HDP 2.6 but rest of the service remains at the previous version (HDP 2.5)

bhavintandel · ‎04-07-2017

well i couldn't figure out the issue with the server but it was up and running the next day without the need to do any change.

bhavintandel · ‎04-05-2017

Actually the home folder for zeppelin-principal was not present and after doing the need. We tried `livy.pyspark` and it asked us to push hive-site.xml file to spark-client/conf folder on all datanodes. And then it worked but then now again it stopped with the following error Error running rest call; nested exception is org.springframework.web.client.HttpClientErrorException: 413 Request Entity Too Large

bhavintandel · ‎04-03-2017

Hey @Vipin Rathor, I corrected the question. Yeah, even I think zeppelin don't have that feature yet. Thanks for the response .

bhavintandel · ‎04-03-2017

bhavintandel · ‎04-03-2017

Is there any way such that zeppelin can support multiple principalSuffix so that users from different domain can login into Zeppelin without specifying fully qualified domain ?

bhavintandel · ‎04-03-2017

Hey @yvora yup, I did follow that but error still persist.

bhavintandel · ‎03-31-2017

We have a kerberized cluster with AD integrated and I am getting this error. java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at org.apache.thrift.transport.TSocket.open(TSocket.java:182) at org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:51) at org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:37) at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:60) at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:861) at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435) at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:363) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.getClient(RemoteInterpreterProcess.java:189) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:173) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:338) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.getFormType(LazyOpenInterpreter.java:105) at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:262) at org.apache.zeppelin.scheduler.Job.run(Job.java:176) at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:328) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Also I have tried all other solutions present on this community

bhavintandel · ‎03-20-2017

Can you please check if the screenshots are uploaded properly because it is not seen on this end.

bhavintandel · ‎12-21-2016

@Sebastian Hätälä Do your cluster have connection to the internet ? I had the same issue and got to know that zeppelin download required jars using maven according to the versions of the component. So we need to have compatible jars, for example I did download jars from maven manually but they were of latest version and surprisingly it didn't work and I have to download older jars.

bhavintandel · ‎12-15-2016

@Sebastian Hätälä Did you manage to solve it ?

bhavintandel · ‎12-14-2016

So guys @kbadani and @jzhang the issue finally got solved and thank you for your support. It was very trivial but very important property, livy.superuser was set to `zeppelin-<cluster name in uppercase>` but the principal was in lower case 😛 . And changing that solved the issue, @kbadani You pointed out that property but I didnt know that it is case sensitive.

bhavintandel · ‎12-13-2016

@Geoffrey Shelton Okot @apappu Thank you guys for the response and I completely agree with your answer. I have an Ambari on rdeluhxxxxx.rz-c007-j650.xx-xx.xx which has an alias as ambari.xyz.com and I have created the certificate with the alias (ambari.xyz.com). But queue manager is expecting cert for that hostname (rdeluhxxxxx.rz-c007-j650.xx-xx.xx). So is there any property where I can change this ?

bhavintandel · ‎12-12-2016

@apappu So I have enabled ssl for yarn plugin for ranger. And I am using alias for ambari server for which i have store a certificate i keystore

bhavintandel · ‎12-12-2016

@kbadani Sorry for the delay, I have attached the live.out log livy-out.txt

bhavintandel · ‎12-09-2016

I have used an alias for ambari server but when i try to launch yarn queue manager, it is expecting certificate for actual hostname. Also i have attached the logs , if that helps. queuemanagerissue.txt

bhavintandel · ‎12-09-2016

Hey @kbadani, thanks for getting back. I did this but no luck, I also checked after restarting the services but the 403 error persists.

bhavintandel · ‎12-07-2016

yes, i have set it to zeppelin principal. But just for heads up i have not configured ldap for MIT Kerberos but i am using ldap with zeppelin.

bhavintandel · ‎12-06-2016

yes i have already set that to yarn-cluster mode

bhavintandel · ‎12-06-2016

@jzhang, So i did restart the server and checked yarn logs but the job is not getting submitted, I cannot see any submitted or failed jobs.

bhavintandel · ‎12-03-2016

Hey @jzhang, thanks for the interest. Yes, i have used ambari for kerberization and also i have set proxy users property for livy in hdfs

Online	Offline
Last Visited	‎04-10-2019 09:02 PM

Date Registered	‎07-20-2016 09:03 AM
Last Visited	‎04-10-2019 09:02 PM
Total Messages Posted	37
Total Kudos Received	3

Re: Using Hive through JDBCInterpreter in Zeppelin

Re: Getting error "User session not found 403" whe...

Re: HA Blueprints for Ambari2.4/HDP2.5

Re: Ansible outputs Unknown Job for ambari-agent

Re: HDP 2.6 spark on zeppelin doesn't work (nosuch...

Re: [YARN] Fair scheduler priority

why ANALYZE TABLE hangs hiveserver2 ?

what should we mention as job tracker in oozie if ...

Re: Is there a way for admin to delete notebooks w...

Is there a way for admin to delete notebooks which...

Re: Zeppelin livy not working with connection refu...

Re: Why we see Total Outstanding Resource Requests...

Why we see Total Outstanding Resource Requests: ?

Can we customize HDP stack ?

Re: Zeppelin livy not working with connection refu...

Re: Zeppelin livy not working with connection refu...

Re: Zeppelin multiple principalSuffix ?

Is there any best practice or guide to perform har...

Zeppelin multiple principalSuffix ?

Re: Zeppelin livy not working with connection refu...

Zeppelin livy not working with connection refused ...

Re: Disk size used is bigger than replication numb...

Re: Using Hive through JDBCInterpreter in Zeppelin

Re: Using Hive through JDBCInterpreter in Zeppelin

Re: Getting error "User session not found 403" whe...

Re: Yarn queue manager error: Couldn't connect to ...

Re: Yarn queue manager error: Couldn't connect to ...

Re: Getting error "User session not found 403" whe...

Yarn queue manager error: Couldn't connect to the ...

Re: Getting error "User session not found 403" whe...

Re: Getting error "User session not found 403" whe...

Re: Getting error "User session not found 403" whe...

Re: Getting error "User session not found 403" whe...

Re: Getting error "User session not found 403" whe...