Hi Guys, I am new on NIFI. I have 2 instances one is for HDF and another one is for HDP. I want to ingest data into HDFS but it is not available into my HDF so i created another vm for HDP to use HDFS. I have researched about data ingestion into HDFS and performed the following steps. 1- Downloaded core-site.xml and hdfs-site.xml from HDP and uploaded into the instance of HDF. 2- Replaced "sandbox-hdp.hortonworks.com" by IP of HDP that is "http://192.168.12.11" in above files. 3- Added a property in to hdfs-site.xml <property> <name>dfs.client.use.datanode.hostname</name> <value>true</value> </property> 4- Open the nifi UI and add 2 processors "GetFile" and "PutHDFS" as you can see (image: 1-Error). 5- Configured "PutHDFS" processor as shown in (Image: 2-PutHDFS_Configuration). 6- My source file's location can be seen in (Image: 3-Source (Instance-1)) 7- My destination folder has full rights as you can see in (Image: 4-Destination (Instance-2)) The issue is PutHDFS writing 0 bytes (creates an empty file in HDFS) and throws an exception as shown in (image: 1-Error). Looking for your help. Thanks, Mohsin ... View more

Hi, I am new on sqoop and facing a problem since last 2 days. I am using Ambari-sandbx on VMware. These the version details HDP 2.6 Sqoop 1.4.6 I am unable to connect MsSql in sqoop . When i try to list the databases using below command then i got this error. command: sqoop list-databases --connect jdbc:sqlserver://VM-TFS/ --username abc --password test123 error: ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not load db driver class: com.microsoft.sqlserverDriver I googled this error and find a solution here, According to @Artem Ervits copy sqljdbc42.jar file into the usr/hdp/current/sqoop-client/lib folder As you can see in the left section of the image-1 that i can view hdp folder In CLI but not in WinSCP. I downloaded sqljdbc42.jar on my window pc and copied it in to /usr/local by using WinSCP. Then tried to copy this jar file from /usr/local to /usr/hdp/current/sqoop-client/lib as suggested in the above solution by using below command but got another error. command: cp /usr/local/sqljdbc42.jar /usr/hdp/current/sqoop-client/lib error: cp: cannot stat `/usr/local/sqljdbc42.jar': No such file or directory Although sqljdbc42.jar is available in usr/local as you can see in image-2 but i don't know why i getting this error. Kindly help me. ... View more