Hi, I recently tried to create an Eclipse project of the kite-sdk, but the step to create the "Kite Data HBase module" failed with this error: " [ERROR] Failed to execute goal on project kite-data-hbase: Could not resolve dependencies for project org.kitesdk:kite-data-hbase:jar:0.10.1-SNAPSHOT: Could not find artifact org.kitesdk:kite-data-core:jar:0.10.1-SNAPSHOT in com.cloudera.releases (https://repository.cloudera.com/artifactory/cloudera-repos/) -> [Help 1] " Yes, the given URL doesn't contain com.cloudera.releases...   The steps I executed are: git clone https://github.com/kite-sdk/kite.git cd git export JAVA_HOME=/usr/lib/jvm/java-6-openjdk-amd64/jre && mvn eclipse:eclipse The output looks like: ... [INFO] ------------------------------------------------------------------------ [INFO] Building Kite Data HBase Module 0.10.1-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] >>> maven-eclipse-plugin:2.9:eclipse (default-cli) @ kite-data-hbase >>> [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Kite Development Kit .............................. SUCCESS [0.838s] [INFO] Kite Data Module .................................. SUCCESS [0.013s] [INFO] Kite Data Core Module ............................. SUCCESS [2.090s] [INFO] Kite Data Crunch Module ........................... SUCCESS [0.621s] [INFO] Kite Data Flume Module ............................ SUCCESS [0.280s] [INFO] Kite Data Hive Module ............................. SUCCESS [1.087s] [INFO] Kite Data HBase Module ............................ FAILURE [0.339s] [INFO] Kite Flume Avro Event Serializer .................. SKIPPED [INFO] Kite Maven Plugin ................................. SKIPPED [INFO] Kite Tools Module ................................. SKIPPED [INFO] Kite Morphlines Parent ............................ SKIPPED [INFO] Kite Morphlines Core .............................. SKIPPED [INFO] Kite Morphlines Avro .............................. SKIPPED [INFO] Kite Morphlines JSON .............................. SKIPPED [INFO] Kite Morphlines Maxmind ........................... SKIPPED [INFO] Kite Morphlines Metrics Servlets .................. SKIPPED [INFO] Kite Morphlines Saxon ............................. SKIPPED [INFO] Kite Morphlines Tika Core ......................... SKIPPED [INFO] Kite Morphlines Tika Decompress ................... SKIPPED [INFO] Kite Morphlines Twitter ........................... SKIPPED [INFO] Kite Morphlines Hadoop Core ....................... SKIPPED [INFO] Kite Morphlines Hadoop Record Columnar (RC) File .. SKIPPED [INFO] Kite Morphlines Hadoop Sequence File .............. SKIPPED [INFO] Kite Morphlines UserAgent ......................... SKIPPED [INFO] Kite Morphlines Solr Core ......................... SKIPPED [INFO] Kite Morphlines Solr Cell ......................... SKIPPED [INFO] Kite Morphlines Dependency Aggregator ............. SKIPPED [INFO] Kite Morphlines Dependency Aggregator (Excluding Solr) SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 7.192s [INFO] Finished at: Sat Dec 14 21:37:29 CET 2013 [INFO] Final Memory: 33M/346M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal on project kite-data-hbase: Could not resolve dependencies for project org.kitesdk:kite-data-hbase:jar:0.10.1-SNAPSHOT: Failure to find org.kitesdk:kite-data-core:jar:0.10.1-SNAPSHOT in https://repository.cloudera.com/artifactory/cloudera-repos/ was cached in the local repository, resolution will not be reattempted until the update interval of com.cloudera.releases has elapsed or updates are forced -> [Help 1]   what am I missing, or doing wrong?   thanks...Gerd...   ... View more

Hi, I'm curious if it is possible to solve this problem with Flume: I have a SpoolingDir source where files with names in the format "prefixA.prefixB.importantPart.csv" will be moved to The files shall be put into HDFS (with its original filename) into the corresponding directory "hdfs://basepath/importantPart/", so that the absolute path for a file is "hdfs://basepath/importantPart/prefixA.prefixB.importantPart.csv". a) how can I parse the filename to extract "importantPart" to create the output HDFS path accordingly, or is this possible at all with Flume? b) how to preserve the original filename so that the HDFS sink writes to the file with the same filename, again, possible at all?   Yes, I know, Flume isn't the right tool for such "file copy" approaches it's working on events, but nevertheless it is interesting if it is possible or if someone did this already.   Any hint highly appreciated.... ... View more

Hi, today I successfully upgraded our cluster to CM4.8.0 and in parallel to Java7 (1.7.0_45, Oracle7). Everything ran smoothly and as expected. Except one thing: after the upgrade I started the HostInspector and it told me that all nodes are using still the old java version 1.6.0_36 HostInspector is just kidding, I thought, but nope....after restarting the whole cluster the HostInspector still reported the old version. But ALL the services on the cluster nodes have been started using java-1.7.0_45. To achive this I set the JAVA_HOME property on each "service environment safety valve" and I verified it by executing "ps auxf  | grep java" on the nodes. I was wondering why the HostInspector still reports a different java version, and, more important, how he detects the version. After adding the Java7 path to the file /usr/lib64/cmf/service/common/cloudera-config.sh everything was fine, HostInspector now shows the correct java version for all nodes.   Now my question: why does the HostInspector just rely on a setting in the mentioned shell script to determine (and display) the java version the cluster services are running with ? Is this on purpose or is this a bug ?!?! I'd expect that the HostInspector is checking the REAL USED jvm of the running Hadoop service processes and displays it. It's a weak source of truth if it reports a different version than the output of the process list tells. What do you think?   many thanks...Gerd... ... View more

Hi,   since I didn't find a proper way to detect the version number of the installed components (is there a way to gather this?), I'd suggest to e.g. add a column in the general service overview. What do you think?   regards...Gerd... ... View more