Member since
02-16-2016
89
Posts
24
Kudos Received
10
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
10212 | 05-14-2018 01:54 PM | |
1607 | 05-08-2018 05:07 PM | |
1152 | 05-08-2018 04:46 PM | |
3035 | 02-13-2018 08:53 PM | |
3653 | 11-09-2017 04:24 PM |
03-15-2017
03:55 PM
1 Kudo
Please verify what have you configured for "Maximum-Value Column" in the QueryDatabaseTable processor. Plus how is your table structured. Nifi needs an increment key to determine the maximum id previously fetched. Following article will help" https://community.hortonworks.com/articles/51902/incremental-fetch-in-nifi-with-querydatabasetable.html
... View more
03-14-2017
03:32 PM
I would strongly recommend you reconsider your usecase to import a table from SQL Server to HBase. HBase is not a relation database, and most of the practice applied on relational database will not work or degrade HBase performance. Consider Hive or similar technologies for SQL server or relation DB offload. Example, if you don't know your row key prefix in HBase you will end up doing a full table scan, which is an expensive operation in HBase. So designing rowkey is the most important step in HBase unlike relational DBs. More information here and why: https://hbase.apache.org/book.html#rowkey.design
... View more
03-02-2017
05:27 PM
2 Kudos
The patch to create Hive external tables from Sqoop is still unresolved: https://issues.apache.org/jira/browse/SQOOP-816 Unfortunately you will not be able to pull updates from source tables using only id column. You will need a timestamped (last modified) column for Sqoop to know which rows were updated. So the best practice is rather at your database side where it is always best to keep columns like 'modified', 'modified by' in your tables. https://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_incremental_imports
... View more
02-27-2017
03:46 PM
Here is the solution: https://community.hortonworks.com/articles/82106/ambari-manually-disable-kerberos-authentication-fo.html
... View more
02-23-2017
05:16 PM
3 Kudos
Latest documentation here: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_cluster-planning/content/ch_hardware-recommendations_chapter.html
... View more
10-31-2016
09:06 PM
Do you have or need (in future) a Hadoop cluster? If answer is yes pick HBase else Cassandra should work. Is Cassandra/HBase right choice? Maybe, depends on how you are planning to use it. If you are looking for 'as database' solution please consider alternate technologies. HBase is not a database, its a key value store. Redis is one of a good alternate to look at. .Net support for Cassandra here: https://academy.datastax.com/resources/getting-started-apache-cassandra-and-c-net For HBase you can use Thrift or Rest: https://community.hortonworks.com/questions/25101/is-there-a-way-to-connect-to-hbase-using-c.html
... View more
10-26-2016
05:37 PM
I believe ShareLib for Sqoop is not registered or missing from Oozie. Check the ooize sharelib by: $ oozie admin -oozie http://localhost:11000/oozie -shareliblist if sqoop is missing from the list, copy jars into /user/ooize/share/lib directory and run: $ oozie admin -oozie http://localhost:11000/oozie -sharelibupdate ref:http://oozie.apache.org/docs/4.1.0/DG_CommandLineTool.html#Getting_list_of_available_sharelib
... View more
10-17-2016
06:21 PM
Please check if the user running the cron job has permission to read keytab file. Following is a relevant post that can help you further. https://community.hortonworks.com/questions/5488/what-are-the-required-steps-we-need-to-follow-in-s.html
... View more
07-11-2016
07:14 PM
In your hosts file add: IP_ADDR_HERE HOSTNAME_HERE Add all ips and hostnames in this file. Copy this file to all the nodes. Seems to me your cluster is not able to map hostname to ip (DNS issue). After the host file changes, try to ping using hostname, which should resolve to IPs.
... View more
03-11-2016
07:16 PM
1 Kudo
Are you still getting the same error? It will help if you list the directory permissions and error section of hiveserver2.log file. Plus also verify if you have checked Neeraj's comment to see if another hive process is running.
... View more
- « Previous
- Next »