Member since
06-05-2019
128
Posts
133
Kudos Received
11
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1792 | 12-17-2016 08:30 PM | |
1334 | 08-08-2016 07:20 PM | |
2375 | 08-08-2016 03:13 PM | |
2475 | 08-04-2016 02:49 PM | |
2280 | 08-03-2016 06:29 PM |
08-08-2016
07:32 PM
1 Kudo
Hi @john doe I recently ran PutKafka and GetKafka in NiFi (connecting to a local VM). I found that adding the FQDN and ip to /etc/hosts made this work for me. For example if the FQDN is host1.local and IP is 192.168.4.162 then adding 192.168.4.162 host1.local to /etc/hosts Made this work.
... View more
08-08-2016
07:20 PM
Hi @João Souza Personally, I'd create a script by each individual table. This way I can focus on the one table (if something changes) rather than modifying a larger script that encompasses all the tables (which would of course be more coding - creating a steeper learning curve for another developer).
... View more
08-08-2016
04:53 PM
@Deepak k Are you referring to HDP (Hortonworks Data Platform) as a custom stack?
... View more
08-08-2016
03:13 PM
1 Kudo
Hi @Mayank Pandey If you have existing tables (not in ORC format), I'd recommend creating the ORC tables. Then run: insert into yourorctable
select * from yourexistingtable; Is this how you are currently inserting data?
... View more
08-04-2016
02:49 PM
2 Kudos
Hi @Joshua Adeleke Can you access http://server:8088/proxy/application_1469778114081_4192 ? There should be some helpful logs that tell you exactly what happened (from the MapReduce side).
... View more
08-03-2016
06:29 PM
1 Kudo
Hi @john doe (by the way love the name) Take a look at this https://community.hortonworks.com/questions/44374/nifi-putkafka-and-verifying-published-messages.html -> it looks like the same issue.
... View more
08-02-2016
10:40 PM
1 Kudo
Hi @kavitha velaga https://cwiki.apache.org/confluence/display/Hive/Setting+Up+HiveServer2 This is the new standard to impersonate (doAs) hive.server2.enable.doAs – Impersonate the connected user, default true. The most recent documentation doesn't seem to discuss "hive.server2.enable.impersonation", therefore, I'd stick with doAs
... View more
08-02-2016
09:50 PM
Hi @Jay Ch Great question. You must register your df1 as a temporary table like: val table = sqlContext.read.format("orc").load("/apps/hive/warehouse/yourtable")
table.registerTempTable("yourtable") and then run: val tester = sqlContext.sql("select * from yourtable");
tester.columns
You'll get the actual column names
... View more
08-02-2016
07:28 PM
Hi @Kyle Dunn Can you open Ambari, click on the Admin tab and Versions? Are you installing HDP on the same machines as Pivotal? Are they pointing to a separate instance of HDFS? How much data are you dealing with? I'd suggest using distcp to copy over the necessary data.
... View more
08-02-2016
05:25 PM
Hi @Shiv kumar Can you run the following in Python on each host (this verifies the FQDN matches up) import socket socket.getfqdn() Do you in fact get centos.test.com, centos1.test.com, centos2.test.com, centos3.test.com? Also, do you have passwordless ssh enabled from centos.test.com (I'm guessing where Ambari-server is running?) to the other hosts centos1.test.com, centos2.test.com, centos3.test.com?
... View more