Member since
09-19-2016
9
Posts
1
Kudos Received
0
Solutions
08-16-2017
01:24 PM
Thank you for the explanation, Use multiple splitText processors in series do the job.
... View more
08-16-2017
12:47 PM
Hello, I am trying to split a file of 2 GB with Nifi 1.3 with SplitText processor. I have not error but it's not working and i have to restart nifi (freeze). When i execute "service nifi status" from my server i have the following message : 2"017-08-16 14:13:21,844 ERROR [main] org.apache.nifi.bootstrap.Command Failed to send shutdown command to port 54120 due to java.net.SocketTimeoutException: Read timed out. Will kill the NiFi Process with PID 14752." Do you know if the file is too large ? Thank you
... View more
Labels:
- Labels:
-
Apache NiFi
05-28-2017
03:22 PM
Hi everyone, I am trying to download some data from url with invokehttp processor on Nifi.
This is my configration : with ${url_to} = https://www.data.gouv.fr/s/resources/elections-presidentielles-1965-2012-1/20150204-183729/cdsp_presi2007t2_circ.csv
But the response is : <html>
<head><title>405 Not Allowed</title><script type="text/javascript" src="http://gc.kis.v2.scr.kaspersky-labs.com/9F89BC97-55F2-F24A-ACA3-16FD48567D73/main.js" charset="UTF-8"></script></head>
<body bgcolor="white">
<center><h1>405 Not Allowed</h1></center>
<hr><center>nginx/1.10.3</center>
</body>
</html>
Do you know why ? When I try with the command "curl -POST " it works.
... View more
Labels:
- Labels:
-
Apache NiFi
05-11-2017
06:34 AM
thank you, it works perfectly !
... View more
05-09-2017
11:17 AM
I have this error " java.nio.charset.IllegalCharsetNameException: test ²éÃ" with this input file : "test ²éà" and this code : import json
import java.io
from org.apache.commons.io import IOUtils
from java.nio.charset import StandardCharsets
from org.apache.nifi.processor.io import StreamCallback
from java.io import ByteArrayOutputStream
from java.lang import String
import os
class ModJSON(StreamCallback):
def __init__(self):
pass
def process(self, inputStream, outputStream):
text = IOUtils.toString(inputStream, IOUtils.toString(inputStream,StandardCharsets.ISO_8859_1))
outputStream.write(text)
flowFile = session.get()
if (flowFile != None):
flowFile = session.write(flowFile, ModJSON())
flowFile = session.putAttribute(flowFile, "filename", '_translated.json')
session.transfer(flowFile, REL_SUCCESS)
session.commit()
... View more
05-09-2017
09:18 AM
Hi, i try this exemple but i don't understand how i can use it in "Python executeScript Processor". Could you share an exemple of nifi python script or help me to change my code ? import json
import java.io
from org.apache.commons.io import IOUtils
from java.nio.charset import StandardCharsets
from org.apache.nifi.processor.io import StreamCallback
import os
class ModJSON(StreamCallback):
def __init__(self):
pass
def process(self, inputStream, outputStream):
text = u'abcdé'
outputStream.write(text)
flowFile = session.get()
if (flowFile != None):
flowFile = session.write(flowFile, ModJSON())
flowFile = session.putAttribute(flowFile, "filename","test")
session.transfer(flowFile, REL_SUCCESS)
session.commit()
... View more
09-19-2016
08:51 PM
Does not metter my query, even a "Select *" i have the same issue.
I will check for the permissions. How i could check if my Hive connection pool is working ? (i have no logs about this or error message)
... View more
09-19-2016
02:22 PM
There is nothing in the nifi-app.log that goes with this error, only this java Exception : @Bryan Bende
... View more
09-19-2016
02:12 PM
1 Kudo
Hi, this is my configuration for a SelectHiveQL processor in Nifi , my database connection url is : jdbc:hive2:/************:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2 And i have this error : I tried to change output format but nothing changes, Somebody can help me ?
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache NiFi