Member since
05-30-2018
1322
Posts
715
Kudos Received
148
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 4125 | 08-20-2018 08:26 PM | |
| 2000 | 08-15-2018 01:59 PM | |
| 2428 | 08-13-2018 02:20 PM | |
| 4225 | 07-23-2018 04:37 PM | |
| 5107 | 07-19-2018 12:52 PM |
07-02-2018
07:46 PM
@Geetha Anne helped me find the issue. I had to issue kinit using kinit -kt /etc/security/keytabs/spnego.service.keytab HTTP/MYREALM@LAKE
... View more
06-13-2018
03:18 PM
https://community.hortonworks.com/content/kbentry/109629/how-to-achieve-better-load-balancing-using-nifis-s.html
... View more
06-10-2018
06:11 PM
@sunile.manjee Thank you:)
... View more
06-21-2018
04:53 AM
1 Kudo
I recommend you take a look at building a uber jar. This will allow you to solve classpath issues where dependencies are not found.
... View more
06-11-2018
05:38 AM
yes that is it. Basically inside the iterator you would create a large insert statement. INSERT INTO films (code, title, did, date_prod, kind) VALUES
('B6717', 'Tampopo', 110, '1985-02-10', 'Comedy'),
('HG120', 'The Dinner Game', 140, DEFAULT, 'Comedy'); Your column names can come from the dataframe and the values are from the dataframe it self. therefore nothing is hard coded and you can reuse this code for virtually any database which uses ansi sql inserts.
... View more
03-27-2017
04:01 PM
3 Kudos
There are many ways to validate a json file against a avro schema to verify all is kosher. Sharing a practice I have been using for few years. Objective - Validate avro schema well bound to the json file First you must have a avro schema and json file. From there download the latest a avro-tools jar. At the moment 1.8.1 is the latest avro-tools version jar available. Store the avro schema and json file in the same directory. Issue a wget to fetch the avro-tools jar wget http://www.us.apache.org/dist/avro/avro-1.8.1/java/avro-tools-1.8.1.jar Here is what the directory looks like Objective Details - Validate avro schema student.avsc binds to student.json How - Issue the following java -jar ./avro-tools-1.8.1.jar fromjson --schema-file YourSchemaFile.avsc YourJsonFile.json > AnyNameForYourBinaryAvro.avro Using the student files example: java -jar ./avro-tools-1.8.1.jar fromjson --schema-file student.avsc student.json > student.avro Validation passed, a avro binary was created. Now as a last step lets break something. Another avro schema (student2.avsc) is created which does not conform to student.json. Lets verify the avro-tools jar will fails to build a avro binary As you can see from above output the avro binary failed to create due to validation errors
... View more
03-24-2017
01:59 AM
@Sriharsha Chintalapani Thank you very much. Found the issue. My SASL port is 6668 not 6667
... View more
03-21-2017
11:31 AM
1 Kudo
You cannot add a description / comment to a Phoenix table in the same way as you would add in Oracle/TD, that is: no equivalent to the `COMMENT ON TABLE` SQL command, neither in the Phoenix SQL, nor in the underlying Hbase api. You can accomplish your goal by using external tools to keep tab on your table metadata.
... View more
11-22-2018
02:39 PM
Does Master to Master or cyclic keeps on replicating the data back and forth ? If an upsert is executed from C1 and it is propogated to C2. Now as C1 is added in C2 as peer will the replication happen to C1 back and then again to C2 (Going C1 to C2 to C1 to C2 to C1 .....)
... View more
03-22-2017
01:15 PM
Hi @Sunile Manjee, you article is great. I tried following the same steps and was successful in creating a schema and a table within it. But if i try to drop the table, i see the error that "Table not found". And if i try to create the table, i see the message "Table exists". Any thoughts on it.
... View more