About sateesh_reddy

sateesh_reddy · ‎06-25-2017

I am planning to read from db2 database and do a update else insert into a hive table. what processors should be used to achive this.

sateesh_reddy · ‎06-21-2017

Hi jay I tried above command but it is throwing me below error jdbc:hive2://xxxx.com:10000/default;principal=hive/_HOST@EXAMPLE.COM nifi-kerb.jpg <property> <name>hive.metastore.kerberos.keytab.file</name> <value>/etc/security/keytabs/hive.service.keytab</value> </property> <property> <name>hive.metastore.kerberos.principal</name> <value>hive/_HOST@EXAMPLE.COM</value> </property>

sateesh_reddy · ‎06-18-2017

Hi Jay I went through the link but now sure which method is enabled. here is the snapshot of the hive-site.xml. <property> <name>hive.server2.allow.user.substitution</name> <value>true</value> </property> <property> <name>hive.server2.authentication</name> <value>NONE</value> </property> <property> <name>hive.server2.authentication.spnego.keytab</name> <value>HTTP/_HOST@EXAMPLE.COM</value> </property> <property> <name>hive.server2.authentication.spnego.principal</name> <value>/etc/security/keytabs/spnego.service.keytab</value> </property> <property> <name>hive.server2.enable.doAs</name> <value>false</value> </property> <property> <name>hive.server2.logging.operation.enabled</name> <value>true</value> </property> <property> <name>hive.server2.logging.operation.log.location</name> <value>/tmp/hive/operation_logs</value> </property> <property> <name>hive.server2.max.start.attempts</name> <value>5</value> </property> <property> <name>hive.server2.support.dynamic.service.discovery</name> <value>true</value> </property> <property> <name>hive.server2.table.type.mapping</name> <value>CLASSIC</value> </property> <property> <name>hive.server2.tez.default.queues</name> <value>default</value> </property> <property> <name>hive.server2.tez.initialize.default.sessions</name> <value>false</value> </property> <property> <name>hive.server2.tez.sessions.per.default.queue</name> <value>1</value> </property> <property> <name>hive.server2.thrift.http.path</name> <value>cliservice</value> </property> <property> <name>hive.server2.thrift.http.port</name> <value>10001</value> </property> <property> <name>hive.server2.thrift.max.worker.threads</name> <value>500</value> </property> <property> <name>hive.server2.thrift.port</name> <value>10000</value> </property> <property> <name>hive.server2.thrift.sasl.qop</name> <value>auth</value> </property> <property> <name>hive.server2.transport.mode</name> <value>binary</value> </property> <property> <name>hive.server2.use.SSL</name> <value>false</value> </property> <property> <name>hive.server2.zookeeper.namespace</name> <value>hiveserver2</value> </property>

sateesh_reddy · ‎06-17-2017

Hi Jay I dont have access to ambari. I tried both hive and hive2 comamnds but none of the are working. I am trying to connect hiveserver2 using NIFI tool hive2.jpgnifi.jpghive.jpg

sateesh_reddy · ‎06-17-2017

Hive Database Connection Pooling Service -- it says cannot create ppolable connection factory. I tried below command in the Database connection url. jdbc:hive2://myserver:8443/; Is there way to get the exact jdbc Database connection url

sateesh_reddy · ‎06-16-2017

When i try to create external table i get below below error. Can anybody help to resolve this issue. CREATE EXTERNAL TABLE DIM_ROOM1 ( ROOM_CATEGORY_ID INT, UPD_BATCH_ID INT) CLUSTERED BY (ROOM_CATEGORY_ID) INTO 3 BUCKETS ROW FORMAT DELIMITED STORED AS ORC location '/proj/arcadia/edw/opera/dim_room' TBLPROPERTIES("transactional"="true"); This is same syntax posted by hottom works at below link. https://community.hortonworks.com/articles/52856/stream-data-into-hive-like-a-king-using-nifi.html. Below is the error message . FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:default.DIM_ROOM1 cannot be declared transactional because it' s an external table)

Online	Offline
Last Visited	‎07-05-2017 11:51 AM

Member Since	‎06-16-2017 08:07 PM
Last Visited	‎07-05-2017 11:51 AM
Posts	10

Cloudera Community

Cloudera Community

Insert else update into hive table using NIFI

Re: Hive Database Connection Pooling Service

Re: Hive Database Connection Pooling Service

Re: Hive Database Connection Pooling Service

Hive Database Connection Pooling Service

External table error with TBLPROPERTIES("transacti...