Member since
05-22-2016
14
Posts
1
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2869 | 05-29-2016 04:01 PM |
05-05-2017
06:22 PM
It doesn't work for me, here is the screenshot: What am I missing here? Thank you very much.
... View more
06-28-2016
01:28 PM
I followed the suggestion and put the code in my flume.conf, it looks like: TwitterAgent.sources.TwitterSource.type=org.apache.flume.source.twitter.TwitterSource
#TwitterAgent.sources.Twitter.type = com.cloudera.flume.source.TwitterSource It prompts that there is no type for sources.Twitter I then modified it to: TwitterAgent.sources.Twitter.type=org.apache.flume.source.twitter.TwitterSource
#TwitterAgent.sources.Twitter.type = com.cloudera.flume.source.TwitterSource no more complain for " no type for sources.Twitter" but the original error appears again: How do I troubleshoot and fix this error? Thanks.
... View more
06-28-2016
08:12 AM
1 Kudo
I am also having the same problem after I created directory and move the jar to the plugin folder: Here is the details: You can see I have the .jar file in the right lib folder: My environment variables are: export FLUME_HOME=/opt/flume
export FLUME_CONF_DIR=$FLUME_HOME/conf
export FLUME_CLASSPATH=$FLUME_HOME_DIR
export PATH=$FLUME_HOME/bin:$PATH and I am doing this under root user, below is the error message: 16/06/28 10:48:21 ERROR node.PollingPropertiesFileConfigurationProvider: Failed to load configuration data. Exception follows.
org.apache.flume.FlumeException: Unable to load source type: com.cloudera.flume.source.TwitterSource, class: com.cloudera.flume.source.TwitterSource
at org.apache.flume.source.DefaultSourceFactory.getClass(DefaultSourceFactory.java:67)
at org.apache.flume.source.DefaultSourceFactory.create(DefaultSourceFactory.java:40)
at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:327)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException: com.cloudera.flume.source.TwitterSource
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.source.DefaultSourceFactory.getClass(DefaultSourceFactory.java:65) Can anyone shed any light on this with me? Thank you very much.
... View more
05-29-2016
04:01 PM
I repeated the process and it works now, but the last script is showing no result, I will open a different post for that.
... View more
05-29-2016
04:12 AM
I double checked and confirmed the log exists in hdfs: [cloudera@quickstart examples]$ hadoop fs -ls /user/hive/warehouse/original_access_logs Found 1 items -rw-r--r-- 1 hdfs supergroup 39593868 2016-05-28 06:23 /user/hive/warehouse/original_access_logs/access.log.2
... View more
05-28-2016
07:06 PM
In Hive query editor, it shows "The operation has no results.". In Impala, it shows: Your query has the following error(s): AnalysisException: Failed to load metadata for table: 'intermediate_access_logs' CAUSED BY: TableLoadingException: Failed to load metadata for table: intermediate_access_logs CAUSED BY: InvalidStorageDescriptorException: Impala does not support tables of this type. REASON: SerDe library 'org.apache.hadoop.hive.contrib.serde2.RegexSerDe' is not supported. Thanks.
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Hive
-
Apache Impala
05-24-2016
06:24 PM
My case seems different, I didn't make any change, just stop and start and the error is gone
... View more