Member since
09-12-2017
2
Posts
0
Kudos Received
0
Solutions
09-13-2017
02:51 PM
Appreciate u replying. I have been poking around in Hive Github and I see you are a significant contributor to Druid integration 🙂 I set <property>
<name>hive.druid.broker.address.default</name>
<value>10.93.206.102:8082</value>
</property> in hive-site.xml and I am sure the datasource name I am using is correct because I can access Druid from Imply Pivot and Apache Superset using these params. Looking in the code for DruidStorageHandler I wonder if it may be something to do with me not setting the db type property anywhere? final String dbType = HiveConf .getVar(SessionState.getSessionConf(), HiveConf.ConfVars.DRUID_METADATA_DB_TYPE); as this would cause an exception in the constructor of the class? if (dbType.equals("mysql")) { connector = new MySQLConnector(storageConnectorConfigSupplier, Suppliers.ofInstance(druidMetadataStorageTablesConfig) ); } else if (dbType.equals("postgresql")) { connector = new PostgreSQLConnector(storageConnectorConfigSupplier, Suppliers.ofInstance(druidMetadataStorageTablesConfig) ); } else { throw new IllegalStateException(String.format("Unknown metadata storage type [%s]", dbType)); } I would have expected to see the exception logged at the hiveserver2 console on startup or when the [first] query is run... maybe? but I don't see anything but the semantic exception above.
... View more
09-13-2017
01:47 PM
Error: java.lang.NoClassDefFoundError: org/apache/hadoop/hive/metastore/DefaultHiveMetaHook (state=,code=0) is due to another missing JAR: hive-metastore-2.3.0.jar which is extended by the DruidStorageHandler class. After adding it, the exception is fixed, and now running the CREATE I get: SemanticException [Error 10043]: Either list of columns or a custom serializer should be specified The fact that we get the exceptions, and we fixed them, implies that the STORED BY is using DruidStorageHandler, but this message implies that for some reason it does not supply the column data from the Druid table. Anyone got past this point? I am thinking maybe its now a problem connecting to the Druid broker?
... View more