Member since
11-09-2017
5
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
774 | 11-28-2017 01:45 PM |
11-28-2017
01:45 PM
Ok, after having done some extensive reading about Druid here's what I have determined. If you run a Tranquility job the indexing service automatically runs. This is in effect what the "Realtime" node does. So, if you need to get data into Druid via something Tranquility does not offer, then you use a Realtime Node. As I am bringing data in from Kafka via Tranquility I have no need to run an actual Realtime node (which supports things like HTTP input).
... View more
11-13-2017
06:39 PM
I've got Druid 0.10.1 running successfully and ingesting data which gets committed to deep storage after the default interval of an hour. What I need to do next is start up a realtime node so I can get some streaming jobs writing to Druid, then have some other jobs querying the realtime data immediately, which appears to be only immediately available in a realtime node. I know how to start a druid realtime node, however I don't see realtime "built" into the Ambari deployment. Do I simply build a config, and start it as an independent process inside the Hadoop cluster? Thanks for any and all advice.
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
-
Apache YARN
11-10-2017
04:54 PM
@Slim Ok, I performed my upgrade and Druid was installed successfully. Two notes: Superset is now it's own install (documentation does not appear updated for this), and in the service list it still says druid 0.9.2, however in the installed versions list it shows a proper 0.10.1 Otherwise I'm in business. Thanks for the help.
... View more
11-09-2017
06:52 PM
@slim I had no idea a new HDP/Ambari install was out. That would have saved me a fair bit of time. I'm working on the upgrade now. THanks!
... View more
11-09-2017
03:27 PM
I've been running an Ambari built Hadoop-cluster for a little over a month now. I'm supporting a number of devs that want to build several Apex based streaming apps that deliver data into Druid for some quick OLAP analysis. I started them with the technical preview which is version 0.9.2, however we've run into a few bugs. I managed to "slide" an upgrade in by replacing a bunch of jar files and the issues we were seeing are gone (only have 2/5 middeManagers that don't want to run). My questions are these: 1. Is there a way to "build" my own Ambari installer for Druid or anything else I'd like to add into Ambari? 2. Will Druid in Ambari be upgraded to 0.10.1 sometime soon? Thanks for any help.
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop