Member since
10-01-2015
3933
Posts
1150
Kudos Received
374
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 3655 | 05-03-2017 05:13 PM | |
| 3013 | 05-02-2017 08:38 AM | |
| 3275 | 05-02-2017 08:13 AM | |
| 3220 | 04-10-2017 10:51 PM | |
| 1684 | 03-28-2017 02:27 AM |
02-19-2016
02:53 PM
run it manually and paste error here @Mark Thorson yum install -y mysql-server
... View more
02-19-2016
02:32 PM
1 Kudo
@Rushikesh Deshmukh you're welcome, use that first before reading any other material, Lar's blog is really good but the blog post is from 2010, HBase is innovating fast and blogs tend to become dated, information does not get updated if there are changes in WAL. Your first point of reference should always be reference guide, it is one of the most well-documented material for an open source project.
... View more
02-19-2016
02:24 PM
@Rushikesh Deshmukh best reference is HBase reference guide https://hbase.apache.org/book.html 67.6. Write Ahead Log (WAL) 67.6.1. Purpose The Write Ahead Log (WAL) records all changes to data in HBase, to file-based storage. Under normal operations, the WAL is not needed because data changes move from the MemStore to StoreFiles. However, if a RegionServer crashes or becomes unavailable before the MemStore is flushed, the WAL ensures that the changes to the data can be replayed. If writing to the WAL fails, the entire operation to modify the data fails. HBase uses an implementation of the WAL interface. Usually, there is only one instance of a WAL per RegionServer. The RegionServer records Puts and Deletes to it, before recording them to the MemStore for the affected [store]. The HLog Prior to 2.0, the interface for WALs in HBase was named HLog . In 0.94, HLog was the name of the implementation of the WAL. You will likely find references to the HLog in documentation tailored to these older versions. The WAL resides in HDFS in the /hbase/WALs/ directory (prior to HBase 0.94, they were stored in /hbase/.logs/), with subdirectories per region. For more general information about the concept of write ahead logs, see the Wikipedia Write-Ahead Log article.
... View more
02-19-2016
02:20 PM
@Mark Thorson what is the exact issue you're facing? I see you have postgres installed, is that the issue that you're getting errors on dependency? You can uninstall Postgres and ambari-server and try again, ambari-server will pull postgres as part of install automatically. Check the ambari-server requirements for Postgres in our documentation for the right versions, v. 8 and 9 are supported.
... View more
02-19-2016
02:05 PM
ok good, but in general my original answer still applies, Nifi is not an Oozie and Sqoop replacement. @Shishir Saxena you need either Change Data Capture (CDC) like Golden Gate or Attunity Replicate or Sqoop job with metastore keeping track of all rows processed. Good luck!
... View more
02-19-2016
02:01 PM
ssh root@machine
yum repolist
cd /etc/yum.repos.d/
vi filename.repo look for the .repo files that are similar like HDP.repo HDP-UTILS.repo, ambari.repo and find dupes that way with repolist command above, you can get a response saying what is listed twice, then find that file and edit it to remove the duplicate entry. @Mark Thorson
... View more
02-19-2016
01:43 PM
yes but see the note about using --driver and specifying class name. @rajdip chaudhuri
... View more
02-19-2016
01:33 PM
@rajdip chaudhuri please see the link https://community.hortonworks.com/questions/2879/bug-in-sandbox-232-hitting-sqoop-1400.html
... View more
02-19-2016
01:28 PM
@rajdip chaudhuri look at my response right above and see this https://community.hortonworks.com/questions/2879/bug-in-sandbox-232-hitting-sqoop-1400.html
... View more