About sunile_manjee

sunile_manjee · ‎11-04-2016

I use -u and -e here is example [hive@sunman1 ~]$ beeline -u jdbc:hive2://localhost:10000 -n hive -e 'show tables' Connecting to jdbc:hive2://localhost:10000 Connected to: Apache Hive (version 1.2.1000.2.5.0.0-1245) Driver: Hive JDBC (version 1.2.1000.2.5.0.0-1245) Transaction isolation: TRANSACTION_REPEATABLE_READ +-----------+--+ | tab_name | +-----------+--+ | airline1 | +-----------+--+ 1 row selected (0.215 seconds) Beeline version 1.2.1000.2.5.0.0-1245 by Apache Hive Closing: 0: jdbc:hive2://localhost:10000 [hive@sunman1 ~]$

sunile_manjee · ‎11-04-2016

I would say go with 256 gb ram. but 128 is def do-able and often seen in the field. Go with Dual 10Gbps NIC. I would go with at least 12-2TB drives broken down into 2 OS drives with raid-1 mirror. 6 drives in raid-10 (metadata) 4 spare drives

sunile_manjee · ‎11-04-2016

I created a phoenix table with 100 columns. I forgot what the primary key for the table. The primary key was build with at least 5 to 6 columns, can't say for sure. Any easy way to have phoenix tell me what the primary key is on a table?

sunile_manjee · ‎11-04-2016

on a hadoop cluster, yes. you will need to avoid setting the path variable and maintain the path yourself based on which version of pig you want to use.

sunile_manjee · ‎11-04-2016

Can you check if the file system is clean? run fsck -y yourdisk/mountpoints

sunile_manjee · ‎11-01-2016

I am interested in using ListenSMTP processor. The use case is the exchange team will forward emails via SMTP forwarder and expects listening side (nifi) to handle smtp protocol. The use case is working well during testing and POC. However I have 3 nodes and each has ListenSMTP processor running. If I have exchange forward messages to a specific DNS:port, does nifi load balance it self by routing smtp message to other slaves nodes, basically so not all messages have to be consumed by single slave node ListenSMTP processor. Or do I need a load balancer which will give me single DNS:Port, and it will route message to slave nodes in some algorithm type (ie round robin)? your insights appreciated.

sunile_manjee · ‎11-01-2016

Does NiFi have a processor to post messages to IBM MQseries? I read this post: https://community.hortonworks.com/questions/1142/does-nifi-have-the-ability-to-connect-to-ibm-mq.html but it seems to be around consuming message. I want ability to post message to mq series. any ideas?

sunile_manjee · ‎11-01-2016

@Zack Riesland to use scripts I would go with oozie.

sunile_manjee · ‎11-01-2016

@Zack Riesland many ways to do this, but .02 easiest with oozie. Oozie has a hive action where you can specify the hsql you want to run decision points after each step, ie failure do this, success do that. It is simple workflow. OBTW, the new workflow manager is available in 2.5 where you can orchestrate this workflow via UI Another option is NiFi. You can execute series of hive scripts and make decision points after each script based on if it failed or succeeded.

sunile_manjee · ‎10-31-2016

Just to close this out as i was able to get info required. Sharing RDD and context outside of zeppelin is not supported.

Online	Offline
Last Visited	‎05-25-2022 10:07 AM

Member Since	‎05-30-2018 10:40 PM
Last Visited	‎05-25-2022 10:07 AM
Posts	1,322
Kudos received	713

Cloudera Community

Re: Iterate over ADLS files using spark?

Re: Install NiFi CA service post nifi cluster inst...

Re: Which storage format is optimum for training m...

Re: Ambari custom alert failing

Re: df.cache() is not working on jdbc table

Re: Query on Hive Commands / Beeline

Re: Hardware Profile for Management Nodes

describe phoenix table to find primary key

Re: Can we run multiple pig versions in same clus...

Re: New datanode not starting (added to an existin...

Does ListenSMTP need LB?

Is there a NiFi processor to post messages to IBM ...

Re: How to determine whether a hive script fails?

Re: How to determine whether a hive script fails?

Re: Is sharing spark RDD or context a supported in...