himock
New Contributor
My Accepted Solutions
Show All

HDP sandbox 3.0.1 performance

by New Contributor in Support Questions
‎10-01-2021 06:17 AM
‎10-01-2021 06:17 AM
Hi all,   I have just installed hdp sandbox 3.0.1 on vmware, I leaved default hardware settings, but I have very low performance.    Time taken: 709.678 seconds for a select count(*) in on a table with 50 records. I tried with Data Analytics Studio and with beeline, same result.   How can I improve performance on sandbox? Is there any settings I can do?   Thanks, Simone ... View more

Re: Unable to connect NiFi to HDFS on HDP sandbox ...

by New Contributor in Support Questions
‎09-30-2021 07:56 AM
‎09-30-2021 07:56 AM
Hi all,   it was simpler than I thought.   - leave NAT on vmware network settings. - in your windows host add entry in file hosts:   - Download and install Nifi on hdp sandbox:  http://nifi.apache.org/download.html - in conf/nifi.properties modify https web properties from nifi.web.https.host=127.0.0.1 to nifi.web.https.host=sandbox-hdp.hortonworks.com - start Nifi   https://sandbox-hdp.hortonworks.com:8443/nifi/           ... View more

Unable to connect NiFi to HDFS on HDP sandbox 3.0....

by New Contributor in Support Questions
‎09-30-2021 12:05 AM
‎09-30-2021 12:05 AM
Hi all,   I'm trying to connect NiFi (installed in my windows host) to HDP sandbox 3.0.1 (vmware) , but I have some trouble. For example if i try to use ListHDFS processor, it works, but if I try to use FetchHDFS it doesn't work, I got the error:   ERROR [Timer-Driven Process Thread-7] o.a.nifi.processors.hadoop.FetchHDFS FetchHDFS[id=32589ddd-017c-1000-5c99-2e601313c742] Failed to process session due to org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from org.apache.hadoop.hdfs.client.HdfsDataInputStream@2dec7fd9: org.apache.hadoop.hdfs.DFSInputStream@7eb12001 for StandardFlowFileRecord[uuid=8a5cd0d3-8a89-43e7-a3af-7f369a8e8412,claim=,offset=0,name=00000_0,size=0] due to org.apache.nifi.processor.exception.FlowFileAccessException: Unable to create ContentClaim due to org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-1419118625-172.17.0.2-1543512323726:blk_1073742033_1212 file=<path>; Processor Administratively Yielded for 1 sec: org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-1419118625-172.17.0.2-1543512323726:blk_1073742033_1212 file=<path> ? causes: org.apache.nifi.processor.exception.FlowFileAccessException: Unable to create ContentClaim due to org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-1419118625-172.17.0.2-1543512323726:blk_1073742033_1212 file=<path> ? causes: org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from org.apache.hadoop.hdfs.client.HdfsDataInputStream@2dec7fd9: org.apache.hadoop.hdfs.DFSInputStream@7eb12001 for StandardFlowFileRecord[uuid=8a5cd0d3-8a89-43e7-a3af-7f369a8e8412,claim=,offset=0,name=00000_0,size=0] due to org.apache.nifi.processor.exception.FlowFileAccessException: Unable to create ContentClaim due to org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-1419118625-172.17.0.2-1543512323726:blk_1073742033_1212 file=<path> org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from org.apache.hadoop.hdfs.client.HdfsDataInputStream@2dec7fd9: org.apache.hadoop.hdfs.DFSInputStream@7eb12001 for StandardFlowFileRecord[uuid=8a5cd0d3-8a89-43e7-a3af-7f369a8e8412,claim=,offset=0,name=00000_0,size=0] due to org.apache.nifi.processor.exception.FlowFileAccessException: Unable to create ContentClaim due to org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-1419118625-172.17.0.2-1543512323726:blk_1073742033_1212 file=<path>   I tried to change network settings from NAT to Host-Only in vmware options (I found this solution in some other thread) but I got this error while starting VM:     I tried also to install NiFi on VM without success. How can I solve this issue?   Thanks to all Simone     ... View more

Re: Unable to copy files from NiFi to HDFS

by New Contributor in Support Questions
‎09-29-2021 10:22 AM
‎09-29-2021 10:22 AM
Hi, I'm very new with HDP sandbox. I have same issue and I'm trying to solve it. I tried changing network settings from NAT to Host Only but it doesn't work, I have this while the VM is starting:     now I'm trying your solution, but what do you mean with " I still use the default NAT network but changed the IP addresses to the current localhost IP at the setting of Port forwarding ". How can I do it?   Thank you so much ... View more
Contact Me
Online
Offline
Last Visited
‎10-05-2021 09:33 AM
Public Statistics
Date Registered ‎09-29-2021 10:15 AM
Last Visited ‎10-05-2021 09:33 AM
Total Messages Posted 4