About sbouguerra

sbouguerra · ‎11-07-2018

Correct @Matthieu Lamairesse Druid is case sensitive while Hive is not, thus, to make it work you need to make sure that all the columns are in lowercase format.

sbouguerra · ‎08-31-2018

If you are interested on rolling up SUM and Count then you output raw data as is and "druid.query.granularity"="HOUR" (FYI not segment granularity) will do the rollup for you. If you want to compute other rollups metrics like using MIN/MAX/AVG etc then you need to do the rollup before. If you share an example of your use cases i can help explaining more. Thanks.

preeti_padelkar · ‎07-05-2018

Hello, When I am trying to create a table from beeline using Druid Storage, I get the below error. Could you please guide on how to proceed further? Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. org.skife.jdbi.v2.exceptions.UnableToObtainConnectionException: java.sql.SQLException: Cannot create PoolableConnectionFactory (Access denied for user)

lnc_adoni · ‎05-03-2018

Thank Slim, that worked.

lnc_adoni · ‎05-02-2018

Hi Slim, Thanks for your response. That worked. I have few more questions, i will open a new thread.

sbouguerra · ‎04-03-2018

In this case increasing the Ulimit of number of processes to the Druid user will fix this issue. This Article explains more the issue and best way to fix such issue. Exception stack. 2018-04-02T23:41:56,827 ERROR [main] io.druid.cli.CliBroker-Errorwhen starting up.Failing.java.lang.OutOfMemoryError: unable to create newnative thread at java.lang.Thread.start0(NativeMethod)~[?:1.8.0_40]at java.lang.Thread.start(Thread.java:714)~[?:1.8.0_40]at java.util.concurrent.ThreadPoolExecutor.addWorker(ThreadPoolExecutor.java:950)~[?:1.8.0_40]at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1368)~[?:1.8.0_40]at org.jboss.netty.util.internal.DeadLockProofWorker.start(DeadLockProofWorker.java:38)~[netty-3.10.6.Final.jar:?]at org.jboss.netty.channel.socket.nio.AbstractNioSelector.openSelector(AbstractNioSelector.java:368)~[netty-3.10.6.Final.jar:?]at org.jboss.netty.channel.socket.nio.AbstractNioSelector.<init>(AbstractNioSelector.java:100)~[netty-3.10.6.Final.jar:?]at org.jboss.netty.channel.socket.nio.AbstractNioWorker.<init>(AbstractNioWorker.java:52)~[netty-3.10.6.Final.jar:?]at org.jboss.netty.channel.socket.nio.NioWorker.<init>(NioWorker.java:45)~[netty-3.10.6.Final.jar:?]at org.jboss.netty.channel.socket.nio.NioWorkerPool.newWorker(NioWorkerPool.java:44)~[netty-3.10.6.Final.jar:?]at org.jboss.netty.channel.socket.nio.NioWorkerPool.newWorker(NioWorkerPool.java:28)

hosako · ‎03-22-2018

Thanks a lot! java -Xmx256m -Duser.timezone=UTC -Dfile.encoding=UTF-8 -Dhdp.version=2.6.3.0-235 -Ddruid.storage.storageDirectory=hdfs://`hostname -f`:8020/tmp/data/index/output -Ddruid.storage.type=hdfs -classpath /usr/hdp/current/druid-overlord/extensions/druid-hdfs-storage/*:/usr/hdp/current/druid-overlord/lib/*:/usr/hdp/current/druid-overlord/conf/_common:/etc/hadoop/conf/ io.druid.cli.Main index hadoop ./hadoop_index_spec.json Above worked. Mine is sandbox so using `hostname -f`.

asreekumar · ‎03-13-2018

For full stack of error message from hive you could look into hiveserver log like @Slim was mentioning. Since hive interactive is enabled I believe you should look into hsihiveserver log on the node where HiveServer2 Interactive is running

samuel_peeters · ‎03-13-2019

Hive is NoSQL but it requires that all files residing in your hdfs location for your table have the same layout.

philip_walenta · ‎11-10-2017

@Slim Ok, I performed my upgrade and Druid was installed successfully. Two notes: Superset is now it's own install (documentation does not appear updated for this), and in the service list it still says druid 0.9.2, however in the installed versions list it shows a proper 0.10.1 Otherwise I'm in business. Thanks for the help.

Online	Offline
Last Visited	‎09-07-2019 05:22 AM

Member Since	‎08-05-2016 05:14 PM
Last Visited	‎09-07-2019 05:22 AM
Posts	76
Kudos received	10

Cloudera Community

Re: Druid kafka ingestion from Hive - HDP 3.0

Re: Hive to Druid Methodology

Re: Druid on Hive LLAP - HDP2.6.1

Re: Druid integration with Hive LLAP

Re: Druid 0.10.1 on Ambari

Re: Druid kafka ingestion from Hive - HDP 3.0

Re: Hive to Druid Methodology

Re: How to load delta data on daily basis into Hiv...

Re: Druid on Hive LLAP - HDP2.6.1

Re: Druid integration with Hive LLAP

Druid node failing with OOM "java.lang.OutOfMemory...

Re: What would be the right command to start Druid...

Re: How to debug Hive2 beeline ?

Re: Stuck as Hive- DruidIntegration

Re: Druid 0.10.1 on Ambari