Member since
06-22-2016
36
Posts
7
Kudos Received
0
Solutions
09-13-2016
10:47 AM
@Laurence Da Luz Thanks for the response. What if the process fails while fetching (or) storing the data. Is it feasible for production use. How to execute this NIFI on Hourly basis.
... View more
09-13-2016
07:04 AM
@Rajkumar Singh I did tried this example. But my Mongo Json data is Very complex
... View more
09-13-2016
05:55 AM
2 Kudos
Hi All, Can someone please kind to tell me how to import the data from MongoDB to HBase using Spark or Without Using Spark. If not any other Way. Regards, Vijay
... View more
Labels:
- Labels:
-
Apache HBase
-
Apache Spark
08-20-2016
04:42 AM
Thanks @Kuldeep Kulkarni It was an permission issue.
... View more
08-19-2016
04:44 PM
Hi all, I have created a shell action in oozie workflow. It was executing perfectly a while ago. Later day it started showing below error. Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.ShellMain], main() threw exception, Cannot run program "checkForFileExistance.sh" (in directory "/data1/hadoop/yarn/local/usercache/hadoop/appcache/application_1471524954637_0316/container_e27_1471524954637_0316_01_000002"): error=2, No such file or directory Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], main() threw exception, Cannot run program "checkForFileExistance.sh" (in directory "/data1/hadoop/yarn/local/usercache/hadoop/appcache/application_1471524954637_0316/container_e27_1471524954637_0316_01_000002"): error=2, No such file or directory
java.io.IOException: Cannot run program "checkForFileExistance.sh" (in directory "/data1/hadoop/yarn/local/usercache/hadoop/appcache/application_1471524954637_0316/container_e27_1471524954637_0316_01_000002"): error=2, No such file or directory
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
at org.apache.oozie.action.hadoop.ShellMain.execute(ShellMain.java:95)
at org.apache.oozie.action.hadoop.ShellMain.run(ShellMain.java:57)
at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:47)
at org.apache.oozie.action.hadoop.ShellMain.main(ShellMain.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:241)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.io.IOException: error=2, No such file or directory
at java.lang.UNIXProcess.forkAndExec(Native Method)
at java.lang.UNIXProcess.<init>(UNIXProcess.java:248)
at java.lang.ProcessImpl.start(ProcessImpl.java:134)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)
... 17 more Please help me with the error. Please not that the shell script is available in lib folder under workflow directory.
... View more
Labels:
- Labels:
-
Apache Oozie
08-16-2016
03:55 PM
@Timothy Spann I have followed the same. Now i can able to read the parquet file. But how can it be solution.
... View more
08-16-2016
02:15 PM
@Timothy Spann As per your suggestion i have downloaded the parquet tools from github and tried to package , it is throwing an error. Failed to execute goal on project parquet-tools: Could not resolve dependencies for project com.twitter:parquet-tools:jar:1.6.0rc3-SNAPSHOT: Failure to find com.twitter:parquet-hadoop:jar:1.6.0rc3-SNAPSHOT in https://oss.sonatype.org/content/repositories/snapshots was cached in the local repository, resolution will not be reattempted until the update interval of sonatype-nexus-snapshots has elapsed or updates are forced
Please help me !!!
... View more
08-12-2016
08:42 PM
@gopal If i do total number of Id is 4030. Whether i use distinct or not the result will be same, as the Id doesnt have any duplicate records
... View more
08-12-2016
07:25 PM
Hadoop version: 2.7.1.2.4.0.0-169
... View more
08-12-2016
07:23 PM
Spark version : 1.6.0 hive version : 1.2.1
... View more