Did you solve this problem? I have a very simple way. You can use JSONPath expression like "$[-1].id" in EvaluateJsonPath. "-1" means last index of attribute. ... View more

@Jay Kumar SenSharma Thanks for your help. I solved this problem as follows: Create a sqoop job for extract data and load in HDFS Using a hive job for execute a "load data inpath" for load data inside hive ... View more

@yassine sihi Thanks for sharing the solution to check the password file first. [root@sandbox ~]# cat /etc/ambari-server/conf/password.dat bigdata ... View more

we get many error like EmulatedXAResource@64deb58f, error code TMNOFLAGS and transaction: [DataNucleus Transaction, ID=Xid=#, enlisted resources=[]] 2017-11-01 10:35:20,363 DEBUG [main]: DataNucleus.Transaction (Log4JLogger.java:debug(58)) - Running enlist operation on resource: org.datanucleus.store.rdbms.ConnectionFactoryImpl$EmulatedXAResource@64deb58f, error code TMNOFLAGS and transaction: [DataNucleus Transaction, ID=Xid=#, enlisted resources=[]] javax.jdo.JDODataStoreException: Error executing SQL query "select "DB_ID" from "DBS"". java.sql.SQLSyntaxErrorException: Table/View 'DBS' does not exist. Caused by: ERROR 42X05: Table/View 'DBS' does not exist. java.lang.RuntimeException: Error applying authorization policy on hive configuration: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ... View more

@Chaitanya D Please run HDFS Service check from Ambari Server UI to see if all the DataNodes are healthy and running? java.lang.Exception: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /user/hduser/sqoop_import/customers/_temporary/0/_temporary/attempt_local270107642_0001_m_000000_0/part-m-00000 could only be replicated to 0 nodes instead of minReplication (=1). There are 0 datanode(s) running and no node(s) are excluded in this operation. Above error indicates that No DataNodes are running or DataNodes are not healthy. So please check if your Sqoop is using the correct hdfs-site.xml / core-site.xml in it's classpath with Valid Running DataNodes. . You can also try running your Sqoop command using "--verbose" option to see the "Classpath" setting to know if it is including the correct "hadoop/conf" directory something like: "/usr/hdp/2.6.0.3-8/hadoop/conf" . Please check the DataNode process is running and try to put sode file to HDFS to see if your HDFS store operations are running fine? # ps -ef | grep DataNode # su - hdfs # hdfs dfs -put /var/log/messages /tmp . ... View more

When cloning and building Metron locally you have to be careful about adding extra files within your local copy. There is a plugin that runs (Apache Rat) that checks for licenses whenever you build. You likely added some files that don't have license headers and your best bet is to remove the files flagged in /path/to/metron/target/rat.txt. ... View more

No answer since that date? 😞 Hi @Jay Kumar SenSharma, I'm facing nearly the same problem, and you're my last chance to ingest my data file 😞 Using Zookeeper for Druid. Trying to ingest static data from a file. Managed to do it with the wiki example in the documentation but not with my own data: Druid Quickstart I've tried all the commands above and everything seems to be ok. Here they are: ```hostname -f``` debian ```netstat -tnlpa | grep 2181``` tcp6 0 0 :::2181 :::* LISTEN 347/java tcp6 0 0 ::1:2181 ::1:43774 ESTABLISHED 347/java tcp6 0 0 ::1:43760 ::1:2181 ESTABLISHED 783/java tcp6 0 0 ::1:43774 ::1:2181 ESTABLISHED 736/java tcp6 0 0 ::1:43764 ::1:2181 ESTABLISHED 827/java tcp6 0 0 ::1:2181 ::1:43764 ESTABLISHED 347/java tcp6 0 0 ::1:2181 ::1:43750 ESTABLISHED 347/java tcp6 0 0 ::1:43750 ::1:2181 ESTABLISHED 907/java tcp6 0 0 127.0.0.1:2181 127.0.0.1:39780 ESTABLISHED 347/java tcp6 0 0 ::1:2181 ::1:43760 ESTABLISHED 347/java tcp6 0 0 127.0.0.1:39780 127.0.0.1:2181 ESTABLISHED 771/java ```echo state | nc localhost 2181``` Zookeeper version: 3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f, built on 03/23/2017 10:13 GMT Clients: /0:0:0:0:0:0:0:1:43750[1](queued=0,recved=1982,sent=2016) /0:0:0:0:0:0:0:1:43774[1](queued=0,recved=1927,sent=1969) /0:0:0:0:0:0:0:1:43764[1](queued=0,recved=1964,sent=2019) /127.0.0.1:39780[1](queued=0,recved=1908,sent=1946) /0:0:0:0:0:0:0:1:43760[1](queued=0,recved=1913,sent=1923) /127.0.0.1:40918[0](queued=0,recved=1,sent=0) Latency min/avg/max: 0/0/124 Received: 10219 Sent: 10424 Connections: 6 Outstanding: 0 Zxid: 0xb1 Mode: standalone Node count: 51 ```nc -v $ZOOKEEPER_HOSTNAME 2181``` localhost [127.0.0.1] 2181 (?) open ```less /var/log/zookeeper/zookeeper.log``` Doesn't work, but the log file "zookeeper.out" shows no errors. ```ps -ef | grep zookeeper``` root 347 1 0 09:26 ? 00:00:47 java -Dzookeeper.log.dir=. -Dzookeeper.root.logger=INFO,CONSOLE -cp /root/zookeeper-3.4.10/bin/../build/classes:/root/zookeeper-3.4.10/bin/../build/lib/*.jar:/root/zookeeper-3.4.10/bin/../lib/slf4j-log4j12-1.6.1.jar:/root/zookeeper-3.4.10/bin/../lib/slf4j-api-1.6.1.jar:/root/zookeeper-3.4.10/bin/../lib/netty-3.10.5.Final.jar:/root/zookeeper-3.4.10/bin/../lib/log4j-1.2.16.jar:/root/zookeeper-3.4.10/bin/../lib/jline-0.9.94.jar:/root/zookeeper-3.4.10/bin/../zookeeper-3.4.10.jar:/root/zookeeper-3.4.10/bin/../src/java/lib/*.jar:/root/zookeeper-3.4.10/bin/../conf: -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.local.only=false org.apache.zookeeper.server.quorum.QuorumPeerMain /root/zookeeper-3.4.10/bin/../conf/zoo.cfg root 11486 1173 0 14:33 pts/0 00:00:00 grep zookeeper ... View more

Thanks for not leaving the thread with out proper solution . @Rafael Coss HCC rocks 🙂 ... View more

@Jalender Reddy The Fix is to Have the TEZ as default engine from now on. ... View more