About jordan_co_in

jordan_co_in · ‎08-13-2018

@subash sharma How did you solve this?

jordan_co_in · ‎05-10-2018

@Olivér Szabó Its exactly the same error again Exception in thread "main" org.apache.zookeeper.KeeperException$NoAuthException: KeeperErrorCode = NoAuth for /hive at org.apache.zookeeper.KeeperException.create(KeeperException.java:113) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155) at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345) at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342) at org.apache.solr.common.cloud.SolrZkClient.printLayout(SolrZkClient.java:583) at org.apache.solr.common.cloud.SolrZkClient.printLayout(SolrZkClient.java:608) at org.apache.solr.common.cloud.SolrZkClient.printLayoutToStdOut(SolrZkClient.java:624) at org.apache.solr.cloud.ZkCLI.main(ZkCLI.java:244)

jordan_co_in · ‎05-10-2018

I was using FQDN just replaced with local host as I didnt want to post the hostname there. Tried both with FQDN and localhost

jordan_co_in · ‎05-10-2018

If not a keytab you should have the trust store of the hive and pass it along for the knox to connect to hive. So if you are making a db connection it should look something like knoxhsot.com:8443;ssl=1;sslTrustStore=/path/to/keystore.jks;trustStorePassword=passwordofkeystore;transportMode=http;httpPath=hive/gateway/path

jordan_co_in · ‎05-10-2018

Can you try using the host name instead of the ip in the hdfs path? Also make sure the user has permissions on that folder on hdfs to create new folder and write data to it.

jordan_co_in · ‎05-10-2018

Trying to access the access zookeeper from the client. Throws up a Auth error. Executing as ./zkcli.sh -zkhost localhost:2181 -cmd list from the folder /usr/lib/ambari-infra-solr/server/scripts/cloud-scripts Gived the exception Exception in thread "main" org.apache.zookeeper.KeeperException$NoAuthException: KeeperErrorCode = NoAuth for /hive at org.apache.zookeeper.KeeperException.create(KeeperException.java:113) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155) at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345) at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:342) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342) at org.apache.solr.common.cloud.SolrZkClient.printLayout(SolrZkClient.java:583) at org.apache.solr.common.cloud.SolrZkClient.printLayout(SolrZkClient.java:608) at org.apache.solr.common.cloud.SolrZkClient.printLayoutToStdOut(SolrZkClient.java:624) at org.apache.solr.cloud.ZkCLI.main(ZkCLI.java:244) The kerberos ticket is initialized using kinit and have the permissions to access zk. Any pointers? Can some one let me know what Auth that is needed here?

jordan_co_in · ‎03-27-2018

Do you have any updated version of this program with the latest libraries and also with a secure hbase?

jordan_co_in · ‎02-02-2018

If your vm can drive can deliver the required throughput it should be fine.

jordan_co_in · ‎01-26-2018

if you are using files or dirs starting with . and _ they are considered to be hidden in hdfs .. check from hive console if you can see the path properly for the table that got created.

jordan_co_in · ‎01-24-2018

as it is trying to re over write means it could be stale or corrupt. clean up the file and try again.

jordan_co_in · ‎01-24-2018

Check if the URL http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7 is accessible and you are write permissions to /etc/yum.repos.d/ambari-hdp-52.repo

jordan_co_in · ‎01-16-2018

OK when you said "yum install command it works as expected" I assumed proxy was working. with out that even yum wouldn't work directly.

jordan_co_in · ‎01-13-2018

The processes hangs randomly which I too have observed. Did you try restarting ambar-server?

jordan_co_in · ‎01-13-2018

Check the permissions on /var/lib/ambari-agent/cache/common-services/NIFI/ and make sure you have execute permissions for the nifi user.

jordan_co_in · ‎11-29-2017

May be the the UNIX param needs to be set accordingly. Set it to unlimited or to a desired number ulimit -u unlimited

jordan_co_in · ‎11-16-2017

Verify the space and format and characters in the cron, may be some special characters spoiling the format.

jordan_co_in · ‎11-15-2017

Also depends on how much data is being processed by each job and how intensive is your processing or transformation of data. Going by average system you could look at 128 G

jordan_co_in · ‎11-14-2017

Totally depends on the data, Though Hortonworks has the recommendations, finally it will be how much data data and how many jobs are running.

jordan_co_in · ‎11-14-2017

Which is the user you are running the shell as? Are you able to write a file to that dir? If yes, then it could be the tmp cache that is getting cleared and the process getting killed abnormal.

jordan_co_in · ‎11-14-2017

Check if you have the write permissions to the user that is running the job Make sure your tmp dir is not being cleaned up as it runs or conflicting with another job

jordan_co_in · ‎11-14-2017

https://nifi.apache.org/docs/nifi-docs/rest-api/index.html

jordan_co_in · ‎11-14-2017

Not an answer, Wouldn't that be a security issue where the local hdfs gets used up? What is the use case for it. WebHDFS is a REST based app.. you can try exploring adding api.

jordan_co_in · ‎11-14-2017

@Michael DeGuzis Any pointers?

jordan_co_in · ‎11-08-2017

You can load the file into spark -> apply filters -> write the rest of the df to avro..

jordan_co_in · ‎03-14-2017

During what operation? Share what you tried to do, what you have done and the entire transcript log. Just a line out of no where will not help in anyway

jordan_co_in · ‎03-14-2017

Even single table import you are seeing this error?

jordan_co_in · ‎03-13-2017

As I mentioned --schema is not supported by import-all-tables. Looks like it takes the db name as the schema name by default. or if you have write access to db2, create a schema with same name and create aliases/synonyms or all tables in that schema. should work.

jordan_co_in · ‎03-13-2017

That is something related to DB2 you need to resolve. -206 object-name IS NOT VALID IN THE CONTEXT WHERE IT IS USED https://www.ibm.com/support/knowledgecenter/en/SSEPEK_10.0.0/codes/src/tpc/n206.html To isolate the problem just get that single table and see how it goes.

jordan_co_in · ‎03-13-2017

Can you check what it he contents of PROJECT_ID, looks like the issue is on that. What type of field is that

jordan_co_in · ‎03-13-2017

few lines prior to this?

Online	Offline
Last Visited	‎08-14-2018 03:55 PM

Date Registered	‎10-12-2016 11:30 PM
Last Visited	‎08-14-2018 03:55 PM
Total Messages Posted	37
Total Kudos Received	3

Re: Sqoop import all tables

Re: How to connect to Hive through Knox using JDBC...

Re: zkcli client unable to fetch data

Re: zkcli client unable to fetch data

Re: NiFi Knox - Secured Hadoop

Re: Hbase Incremental backup to remote hdfs

zkcli client unable to fetch data

Re: Creating a Spring Boot Java 8 Microservice To ...

Re: zookeeper on vm in a physical server

Re: creating table with .data and .item files taki...

Re: HDP 2.6.3 Installation

Re: HDP 2.6.3 Installation

Re: Installing HDP using Ambari hanging at install...

Re: Installing HDP using Ambari hanging at install...

Re: NiFi Certificate Authority Start is failing to...

Re: I am getting "Too many open files" error in ni...

Re: I have InvokeHTTP processor scheduled as CRON ...

Re: How to select proper RAM size for hadoop comp...

Re: How to select proper RAM size for hadoop comp...

Re: Getting error while running sqoop.

Re: Getting error while running sqoop.

Re: Is a working Apache Nifi REST API Client exist...

Re: WebHDFS Download / Copy to local from HDFS to ...

Re: manully replicate ranger audits in ambari-infr...

Re: Avro file creation from a Fixed width format f...

Re: Sqoop import all tables

Re: Sqoop import all tables

Re: Sqoop import all tables

Re: Sqoop import all tables

Re: Sqoop import all tables

Re: Sqoop import all tables