Member since
09-29-2021
5
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
354 | 09-30-2021 07:56 AM |
01-27-2023
08:37 AM
Hi guys, I have the same task, I need to transfer On premises file (in hdfs) to AWS3 using Nifi, what are the processors you're using to complete the task? Thank you so much.
... View more
10-01-2021
06:17 AM
Hi all, I have just installed hdp sandbox 3.0.1 on vmware, I leaved default hardware settings, but I have very low performance. Time taken: 709.678 seconds for a select count(*) in on a table with 50 records. I tried with Data Analytics Studio and with beeline, same result. How can I improve performance on sandbox? Is there any settings I can do? Thanks, Simone
... View more
Labels:
09-30-2021
07:56 AM
Hi all, it was simpler than I thought. - leave NAT on vmware network settings. - in your windows host add entry in file hosts: - Download and install Nifi on hdp sandbox: http://nifi.apache.org/download.html - in conf/nifi.properties modify https web properties from nifi.web.https.host=127.0.0.1 to nifi.web.https.host=sandbox-hdp.hortonworks.com - start Nifi https://sandbox-hdp.hortonworks.com:8443/nifi/
... View more
09-30-2021
12:05 AM
Hi all, I'm trying to connect NiFi (installed in my windows host) to HDP sandbox 3.0.1 (vmware) , but I have some trouble. For example if i try to use ListHDFS processor, it works, but if I try to use FetchHDFS it doesn't work, I got the error: ERROR [Timer-Driven Process Thread-7] o.a.nifi.processors.hadoop.FetchHDFS FetchHDFS[id=32589ddd-017c-1000-5c99-2e601313c742] Failed to process session due to org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from org.apache.hadoop.hdfs.client.HdfsDataInputStream@2dec7fd9: org.apache.hadoop.hdfs.DFSInputStream@7eb12001 for StandardFlowFileRecord[uuid=8a5cd0d3-8a89-43e7-a3af-7f369a8e8412,claim=,offset=0,name=00000_0,size=0] due to org.apache.nifi.processor.exception.FlowFileAccessException: Unable to create ContentClaim due to org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-1419118625-172.17.0.2-1543512323726:blk_1073742033_1212 file=<path>; Processor Administratively Yielded for 1 sec: org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-1419118625-172.17.0.2-1543512323726:blk_1073742033_1212 file=<path> ? causes: org.apache.nifi.processor.exception.FlowFileAccessException: Unable to create ContentClaim due to org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-1419118625-172.17.0.2-1543512323726:blk_1073742033_1212 file=<path> ? causes: org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from org.apache.hadoop.hdfs.client.HdfsDataInputStream@2dec7fd9: org.apache.hadoop.hdfs.DFSInputStream@7eb12001 for StandardFlowFileRecord[uuid=8a5cd0d3-8a89-43e7-a3af-7f369a8e8412,claim=,offset=0,name=00000_0,size=0] due to org.apache.nifi.processor.exception.FlowFileAccessException: Unable to create ContentClaim due to org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-1419118625-172.17.0.2-1543512323726:blk_1073742033_1212 file=<path> org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from org.apache.hadoop.hdfs.client.HdfsDataInputStream@2dec7fd9: org.apache.hadoop.hdfs.DFSInputStream@7eb12001 for StandardFlowFileRecord[uuid=8a5cd0d3-8a89-43e7-a3af-7f369a8e8412,claim=,offset=0,name=00000_0,size=0] due to org.apache.nifi.processor.exception.FlowFileAccessException: Unable to create ContentClaim due to org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-1419118625-172.17.0.2-1543512323726:blk_1073742033_1212 file=<path> I tried to change network settings from NAT to Host-Only in vmware options (I found this solution in some other thread) but I got this error while starting VM: I tried also to install NiFi on VM without success. How can I solve this issue? Thanks to all Simone
... View more
Labels:
09-29-2021
10:22 AM
Hi, I'm very new with HDP sandbox. I have same issue and I'm trying to solve it. I tried changing network settings from NAT to Host Only but it doesn't work, I have this while the VM is starting: now I'm trying your solution, but what do you mean with " I still use the default NAT network but changed the IP addresses to the current localhost IP at the setting of Port forwarding ". How can I do it? Thank you so much
... View more