About vromeo

vromeo · ‎03-22-2017

Looks like openscoring also offers jpmml under a BSD license for a fee, see below. Unfortunately, it appears there's a gray area between "we just want to use the software" and "want to redistribute proprietary software based on this code." The wording of the attached blurb from openscoring suggests they think "use" of AGPL code is fine, even though the FSF stance seems to be that GNU AGPL is only compatible w/ GPL: https://www.gnu.org/licenses/why-affero-gpl.en.html

vromeo · ‎03-17-2017

hive.exec.scratchdir on this cluster is /tmp/hive. Don't know why the user appears to be exceeding quota on a personal directory.

vromeo · ‎10-31-2016

I thought those 2 settings pre-dated the introduction of ACID tables. I can understand the "External tables cannot be ACID tables..." part, but I would think those settings could be used to allow users to issue an "exclusive lock" on an external table to prevent reading from it thru hive while external jobs manipulate the underlying files....

vromeo · ‎10-27-2016

From what I'm hearing from other sources this answer was inaccurate and totally fails to take into consideration how our cluster is being used. I disagree with it being tagged "best answer".

vromeo · ‎09-07-2016

Looks like the features I was after have been back-ported. It gets confusing when the primary documentation hortonworks points users to is the Apache docs, which states these features are in 1.6... I don't understand why hwx seems to be avoiding 1.6.

vromeo · ‎09-06-2016

Any word on when Flume 1.6 is likely be rolled into HDP? I haven't switched to 2.5.0 yet, but was disappointed to see the release notes indicate flume 1.5.2 is still the latest in HDP 2.5 even tho flume 1.6 has been out for over a year....

vromeo · ‎09-01-2016

We seem to be getting bitten by HIVE-10809, where pig scripts using org.apache.hive.hcatalog.pig.HCatStorer are leaving behind empty _scratch directories with every run. Does anyone have a suggested workaround, or someone in the HWX community working on pig have any update on this jira? (It has a status of patch available, but hasn't been updated since May 2015.)

vromeo · ‎09-01-2016

I've been asked to set hive.txn.manager = org.apache.hadoop.hive.ql.lockmgr.DbTxnManager and hive.support.concurrency = true, because a subset of users is concerned about dirty reads on an external table while an external job runs to consolidate small files within a partition, so they want to do an exclusive lock during the consolidation.... Anyone no of a reason I should be wary of the above settings? Is there potential for performance impacts for other jobs/users that might have had no need for the above settings? I guess another question would be does "lock table" even work on an external table? Thx, -Vince

vromeo · ‎09-01-2016

I'm interested in the telecom use case, too.... We're dealing with hourly ingests that result in a number of small files we'd like regularly compacted...

vromeo · ‎08-23-2016

I think our hive-env template is missing the section related to setting the heapsize.... We're reaching out to support for a fresh copy of that.

Online	Offline
Last Visited	‎07-11-2018 05:45 PM

Member Since	‎06-13-2016 03:43 PM
Last Visited	‎07-11-2018 05:45 PM
Posts	34
Kudos received	9

Cloudera Community

Re: Streamline PMML Evaluator

Re: Sqoop job failing with DSQuotaExceededExceptio...

Re: Any disadvantage to enabling concurrency in hi...

Re: Any disadvantage to enabling concurrency in hi...

Re: Flume 1.6 in HDP?

Flume 1.6 in HDP?

scratch files left by org.apache.hive.hcatalog.pig...

Any disadvantage to enabling concurrency in hive?

Re: Appending to existing partition with Pig

Re: Ambari's hive config references hive.metastore...