Member since
09-25-2018
9
Posts
1
Kudos Received
0
Solutions
10-26-2018
09:31 AM
1 Kudo
Solved ! I needed to add /etc/hive/conf/hive-site.xml,/etc/hadoop/conf/core-site.xml,/etc/hadoop/conf/hdfs-site.xml to hive configuration resources tab. And give nifi write access to folder in /warehouse/tablespace/managed/hive/
... View more
10-26-2018
09:30 AM
Solved ! I needed to add /etc/hive/conf/hive-site.xml,/etc/hadoop/conf/core-site.xml,/etc/hadoop/conf/hdfs-site.xml to hive configuration resources tab. And give nifi write access to folder in /warehouse/tablespace/managed/hive/
... View more
10-25-2018
12:28 PM
Hello, I have created this table to test puthive33streaming processor : create table dev.streaming_orc
(
id int,
text string
)
CLUSTERED BY (id) INTO 5 BUCKETS
stored as ORC
TBLPROPERTIES ('transactional'='true'); I got the following error message : 2018-10-25 11:07:38,152 ERROR [Timer-Driven Process Thread-6] o.a.h.streaming.HiveStreamingConnection Fatal error on TxnId/WriteIds=[14839/1...14839/1] on connection = { metaStoreUri: thrift://xxx:9083,thrift://xxx:9083, database: dev, table: streaming_orc }; TxnStatus[O] LastUsed txnid:0; cause nulljava.lang.NullPointerException: null at org.apache.hive.streaming.AbstractRecordWriter.logStats(AbstractRecordWriter.java:547) at org.apache.hive.streaming.AbstractRecordWriter.close(AbstractRecordWriter.java:352) at org.apache.hive.streaming.HiveStreamingConnection$TransactionBatch.closeImpl(HiveStreamingConnection.java:979) at org.apache.hive.streaming.HiveStreamingConnection$TransactionBatch.close(HiveStreamingConnection.java:970) at org.apache.hive.streaming.HiveStreamingConnection$TransactionBatch.markDead(HiveStreamingConnection.java:833) at org.apache.hive.streaming.HiveStreamingConnection$TransactionBatch.<init>(HiveStreamingConnection.java:677) at org.apache.hive.streaming.HiveStreamingConnection$TransactionBatch.<init>(HiveStreamingConnection.java:596) at org.apache.hive.streaming.HiveStreamingConnection.createNewTransactionBatch(HiveStreamingConnection.java:485) at org.apache.hive.streaming.HiveStreamingConnection.beginNextTransaction(HiveStreamingConnection.java:466) at org.apache.hive.streaming.HiveStreamingConnection.beginTransaction(HiveStreamingConnection.java:507) at org.apache.nifi.processors.hive.PutHive3Streaming.onTrigger(PutHive3Streaming.java:419) at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27) at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1165) at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:203) at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) It is like it is a problem of metastore initialisation ?? Can anybody know where the error come from ? Thx in advance
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache NiFi
10-23-2018
03:01 PM
Hello ashok, this webpage should be what you are looking for. => https://supportmatrix.hortonworks.com/
... View more
10-18-2018
12:01 PM
Hello everyone, I encoutered a error working with puthive3streaming processor. => TxnStatus[O] LastUsed txnid:0; cause null (look at screenshot) 01-nifi-app-log.png here are my processor configuration 02-processor.png
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache NiFi
10-10-2018
08:05 AM
Hello @Wynner, You will find screenshots of my processor configuration. Thx.
... View more
10-08-2018
01:31 PM
Hello, I have MiNiFI on a windows 10 and NiFi on my cluster. I can work with MiNiFi with tailfile processor on Single File Mode but not on Multiple Files Mode. Is that normal ? Thanks you in advance.
... View more
Labels:
- Labels:
-
Apache MiNiFi
-
Apache NiFi
10-08-2018
01:26 PM
Finally it appears to be a problem of hortonworks sandbox.
... View more
09-25-2018
05:22 PM
Hi here. I am facing a weird problem, with the Microsoft.Hadoop.WebClient C# client Library. I can not upload into hdfs file with size more 250 kb. In fact these files are truncated, to approximately 250 kb. There is no error in log file for namenode or datanode. Before I used this same C# client with cloudera distribution without any trouble. Can anybody knows what to do ? Thanks in advance. Christian
... View more
Labels:
- Labels:
-
Apache Hadoop