Member since
10-24-2017
101
Posts
14
Kudos Received
4
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2170 | 07-26-2017 09:57 PM | |
4076 | 12-13-2016 12:08 PM | |
1184 | 07-28-2016 08:41 PM | |
4305 | 06-15-2016 07:57 AM |
12-13-2016
12:08 PM
1 Kudo
I have set "blockUnknown":true" to false and basic authentiaction mode was disablde
... View more
12-13-2016
07:31 AM
I uploaded the below to zookeepr enable basic authentication in solr. How can i disable basic authentication again? {
"authentication":{
"blockUnknown": true,
"class":"solr.BasicAuthPlugin",
"credentials":{"solr":"IV0EHq1OnNrj6gvRCwvFwTrZ1+z1oBbnQdiVC3otuq0= Ndd7LKvVBAaZIF0QAVi1ekCfAJXr1GGfLtRUXhgrF8c="}
},
"authorization":{
"class":"solr.RuleBasedAuthorizationPlugin",
"permissions":[{"name":"security-edit",
"role":"admin"}],
"user-role":{"solr":"admin"}
}}
... View more
Labels:
- Labels:
-
Apache Solr
12-02-2016
12:29 PM
Hello I want to send a file over http to nifi. When i do so, the filename attributes is set to a long sequence of numbers as shown below in the picture. How should my http url be? listenhttpflowfile.jpg this is the code im working with Code Sample as below: public string PutNifi(string filePath)
{
// Create a http request to the server endpoint that will pick up the
// file and file description.
string Message = "Failed";
try
{
HttpWebRequest requestToServerEndpoint = (HttpWebRequest)WebRequest.Create("http://db-hdf:8081/contentListener");
string boundaryString = "----SomeRandomText";
string fileUrl = filePath;
// Set the http request header \\
requestToServerEndpoint.Method = WebRequestMethods.Http.Post;
requestToServerEndpoint.ContentType = "multipart/form-data; boundary=" + boundaryString;
requestToServerEndpoint.KeepAlive = true;
requestToServerEndpoint.Credentials = System.Net.CredentialCache.DefaultCredentials;
// Use a MemoryStream to form the post data request,
// so that we can get the content-length attribute.
MemoryStream postDataStream = new MemoryStream();
StreamWriter postDataWriter = new StreamWriter(postDataStream);
// Include the file in the post data
postDataWriter.Write("\r\n--" + boundaryString + "\r\n");
postDataWriter.Write("Content-Disposition: form-data;"
+ "name=\"{0}\";"
+ "filename=\"{1}\""
+ "\r\nContent-Type: {2}\r\n\r\n",
"myFile",
Path.GetFileName(fileUrl),
Path.GetExtension(fileUrl));
postDataWriter.Flush();
// Read the file
FileStream fileStream = new FileStream(fileUrl, FileMode.Open, FileAccess.Read);
byte[] buffer = new byte[1024];
int bytesRead = 0;
while ((bytesRead = fileStream.Read(buffer, 0, buffer.Length)) != 0)
{
postDataStream.Write(buffer, 0, bytesRead);
}
fileStream.Close();
postDataWriter.Write("\r\n--" + boundaryString + "--\r\n");
postDataWriter.Flush();
// Set the http request body content length
requestToServerEndpoint.ContentLength = postDataStream.Length;
// Dump the post data from the memory stream to the request stream
using (Stream s = requestToServerEndpoint.GetRequestStream())
{
postDataStream.WriteTo(s);
}
postDataStream.Close();
Message = "Success";
}
catch (Exception ee)
{
Message = ee.ToString();
}
return Message;
}
}
... View more
Labels:
- Labels:
-
Apache NiFi
10-31-2016
02:53 PM
This means i have to reassign these permissions manually? Is there a way to automate the assignment with the already present windows permissions?
... View more
10-31-2016
01:31 PM
Hello I am copying files from a windows shared folder into HDFS. There are a set of active directory permissions associated with each file on windows. How can i maintain the same permissions in HDFS? Thanks Ahamd
... View more
Labels:
- Labels:
-
Apache Hadoop
10-02-2016
09:48 AM
2 Kudos
Hello I want to ingest data from a sharepoint repository, containing documents, into HDFS. What is the best way to do this? Nifi doesn't have a connector to a sharepoint repository. Has anyone faced a case like this? Thanks
... View more
Labels:
- Labels:
-
Apache Hadoop
07-23-2016
06:01 AM
Thank you for your answer. These attributes are part of the metadata of the .msg file. Shouldn't the updateattributes processor be able to extract them? i tried it but it didnt work.
... View more
07-22-2016
08:51 AM
1 Kudo
Hello I am using Nifi to ingest my hdfs cluster with emails (.msg) and i want to be able to extract custom attributes these emails have like (From, To, Title etc..). How should i approach this? I also want to create directories in my hdfs destination through nifi based on these attributes. Is this possible? Thanks Ahmad
... View more
Labels:
- Labels:
-
Apache NiFi