Cloudera Community
Announcements
Celebrating as our community reaches 100,000 members! Thank you!
himock
user rank
Explorer
My Accepted Solutions
Show All

Re: transfer On premises file to AWS S3 using nifi

by Explorer in Support Questions
‎01-27-2023 08:37 AM
‎01-27-2023 08:37 AM
Hi guys, I have the same task, I need to transfer On premises file (in hdfs) to AWS3 using Nifi, what are the processors you're using to complete the task?   Thank you so much. ... View more

HDP sandbox 3.0.1 performance

by Explorer in Support Questions
‎10-01-2021 06:17 AM
‎10-01-2021 06:17 AM
Hi all,   I have just installed hdp sandbox 3.0.1 on vmware, I leaved default hardware settings, but I have very low performance.    Time taken: 709.678 seconds for a select count(*) in on a table with 50 records. I tried with Data Analytics Studio and with beeline, same result.   How can I improve performance on sandbox? Is there any settings I can do?   Thanks, Simone ... View more

Re: Unable to connect NiFi to HDFS on HDP sandbox ...

by Explorer in Support Questions
‎09-30-2021 07:56 AM
‎09-30-2021 07:56 AM
Hi all,   it was simpler than I thought.   - leave NAT on vmware network settings. - in your windows host add entry in file hosts:   - Download and install Nifi on hdp sandbox:  http://nifi.apache.org/download.html - in conf/nifi.properties modify https web properties from nifi.web.https.host=127.0.0.1 to nifi.web.https.host=sandbox-hdp.hortonworks.com - start Nifi   https://sandbox-hdp.hortonworks.com:8443/nifi/           ... View more

Unable to connect NiFi to HDFS on HDP sandbox 3.0....

by Explorer in Support Questions
‎09-30-2021 12:05 AM
‎09-30-2021 12:05 AM
Hi all,   I'm trying to connect NiFi (installed in my windows host) to HDP sandbox 3.0.1 (vmware) , but I have some trouble. For example if i try to use ListHDFS processor, it works, but if I try to use FetchHDFS it doesn't work, I got the error:   ERROR [Timer-Driven Process Thread-7] o.a.nifi.processors.hadoop.FetchHDFS FetchHDFS[id=32589ddd-017c-1000-5c99-2e601313c742] Failed to process session due to org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from org.apache.hadoop.hdfs.client.HdfsDataInputStream@2dec7fd9: org.apache.hadoop.hdfs.DFSInputStream@7eb12001 for StandardFlowFileRecord[uuid=8a5cd0d3-8a89-43e7-a3af-7f369a8e8412,claim=,offset=0,name=00000_0,size=0] due to org.apache.nifi.processor.exception.FlowFileAccessException: Unable to create ContentClaim due to org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-1419118625-172.17.0.2-1543512323726:blk_1073742033_1212 file=<path>; Processor Administratively Yielded for 1 sec: org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-1419118625-172.17.0.2-1543512323726:blk_1073742033_1212 file=<path> ? causes: org.apache.nifi.processor.exception.FlowFileAccessException: Unable to create ContentClaim due to org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-1419118625-172.17.0.2-1543512323726:blk_1073742033_1212 file=<path> ? causes: org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from org.apache.hadoop.hdfs.client.HdfsDataInputStream@2dec7fd9: org.apache.hadoop.hdfs.DFSInputStream@7eb12001 for StandardFlowFileRecord[uuid=8a5cd0d3-8a89-43e7-a3af-7f369a8e8412,claim=,offset=0,name=00000_0,size=0] due to org.apache.nifi.processor.exception.FlowFileAccessException: Unable to create ContentClaim due to org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-1419118625-172.17.0.2-1543512323726:blk_1073742033_1212 file=<path> org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from org.apache.hadoop.hdfs.client.HdfsDataInputStream@2dec7fd9: org.apache.hadoop.hdfs.DFSInputStream@7eb12001 for StandardFlowFileRecord[uuid=8a5cd0d3-8a89-43e7-a3af-7f369a8e8412,claim=,offset=0,name=00000_0,size=0] due to org.apache.nifi.processor.exception.FlowFileAccessException: Unable to create ContentClaim due to org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-1419118625-172.17.0.2-1543512323726:blk_1073742033_1212 file=<path>   I tried to change network settings from NAT to Host-Only in vmware options (I found this solution in some other thread) but I got this error while starting VM:     I tried also to install NiFi on VM without success. How can I solve this issue?   Thanks to all Simone     ... View more

Re: Unable to copy files from NiFi to HDFS

by Explorer in Support Questions
‎09-29-2021 10:22 AM
‎09-29-2021 10:22 AM
Hi, I'm very new with HDP sandbox. I have same issue and I'm trying to solve it. I tried changing network settings from NAT to Host Only but it doesn't work, I have this while the VM is starting:     now I'm trying your solution, but what do you mean with "I still use the default NAT network but changed the IP addresses to the current localhost IP at the setting of Port forwarding". How can I do it?   Thank you so much ... View more
Contact Me
Online
Offline
Last Visited
‎05-11-2023 01:45 PM
Community Statistics
Member Since ‎09-29-2021 10:15 AM
Last Visited ‎05-11-2023 01:45 PM
Posts 5