Member since
08-20-2018
7
Posts
0
Kudos Received
0
Solutions
10-03-2016
11:38 PM
Bump. Any recommendations to this above question? We are also looking for such a solution.
... View more
10-03-2016
06:54 PM
@Rajeshbabu Chintaguntla Thanks for that detailed post, there seems to be two really good approaches there. Which approach would likely provide better performance? It seems like the CsvBulkLoadTool might better than ImportTsv but wanted to verify.
... View more
10-03-2016
06:51 PM
@Constantin Stanca Thanks for the insight. Based on your comment, does Phoenix chunk the data automically if we ingest it through it?
... View more
09-29-2016
07:25 PM
We have a 250GB CSV file that contains 60 Million records and roughly 600 columns. The file lives within HDFS currently and we are trying to ingest it into HBase and have a phoenix table on top of it. The approach we tried so far was to create a Hive table backed by HBase and then execute an overwrite command in Hive which ingests the data in HBase. The biggest problem we have is that the job currently takes about 3-4 days to run!! this is running on a 10 node cluster with medium spec cluster (30GB of RAM each node, and 2TB on each). Any advice on how to speed this up or different methods that can be more efficient?
... View more
Labels:
08-09-2016
03:21 AM
So i guess you have to modify the schema in order for it to pick up the new columns -- it doesnt update schema automatically on the fly
... View more
08-07-2016
03:23 AM
I have created an hbase table using Phoenix with 3 columns. Then after creating the schema structure and populating with data, I wanted to add one new row with new dynamic columns. After doing so, I want to do a SELECT statement and get all columns including dynamic ones. However this is not working when doing "SELECT * FROM EXAMPLE;" -- any ideas how to do this?
Here is my code: Table Structure: CREATE TABLE example (
my_pk bigint not null,
m.first_name varchar(50),
m.last_name varchar(50)
CONSTRAINT pk PRIMARY KEY (my_pk))
Table Data: 12345,John,Doe
67890,Mary,Poppins Inserted dynamic data like so: UPSERT INTO EXAMPLE (MY_PK, FIRST_NAME, LAST_NAME, lastGCTime TIME, usedMemory BIGINT, maxMemory BIGINT)
VALUES(1, 'this', 'test', CURRENT_TIME(), 512, 1024)
... View more
Labels: