About SQLShaw

SQLShaw · ‎01-06-2016

Atlas only supports the sqoop bridge for hiveimport. http://atlas.incubator.apache.org/Bridge-Sqoop.html. Currently I don't see any Pig integration. The metadata is stored in a Titan\HBase repository. This is a graph database. Here is the link to the architecture: http://atlas.incubator.apache.org/Architecture.html. I have not heard recently of 3rd party integration with Atlas but I suspect its on the roadmap.

SQLShaw · ‎12-30-2015

Hi @R M. Instead of sqoop you may want to try using the native Teradata Hadoop connector http://downloads.teradata.com/download/connectivity/teradata-connector-for-hadoop-command-line-edition.

SQLShaw · ‎12-29-2015

Try echo $HIVE_CONF_DIR and view the output. It shoudl be /etc/hive/conf

SQLShaw · ‎12-28-2015

@Sam Mingolelli Agree, but its only because those are the set minimum TTL requirements. Change the TTL values and you should be able to get by with less space. It took 2 months to fill up for you. I've seen it fill up in days with multi-node clusters.

SQLShaw · ‎12-28-2015

@Sam Mingolelli Which version of Amabri are you using? Ambari 2.1 does allow you to truncate. It would be easier to remove AMS and reinstall. We also recommend a dedicated minimum of 10 GB for AMS. See: https://cwiki.apache.org/confluence/display/AMBAR... You may also want to edit your TTL settings - https://cwiki.apache.org/confluence/display/AMBARI/Known+Issues and here - https://cwiki.apache.org/confluence/display/AMBARI/Configuration

SQLShaw · ‎12-28-2015

@Pardeep is correct. You can only use a local SQL Server account for a Sqoop import. You may want to secure the connection by using the "password-file" hint. https://sqoop.apache.org/docs/1.4.5/SqoopUserGuide.html#_connecting_to_a_database_server

SQLShaw · ‎12-16-2015

@Mamta Chawla will Hive's CTE syntax help in your case? https://cwiki.apache.org/confluence/display/Hive/C...

SQLShaw · ‎12-15-2015

Notifying @Alan Gates

SQLShaw · ‎12-15-2015

@PRADEEP /usr/hdp/current contains symlinks to versioned directories As always, verify correct permissions exist on the directories.

SQLShaw · ‎12-15-2015

You can also try using the browser based shell connection: http://sandbox.hortonworks.com:4200/

Online	Offline
Last Visited	‎06-25-2024 10:10 AM

Member Since	‎07-31-2019 06:56 AM
Last Visited	‎06-25-2024 10:10 AM
Posts	346
Kudos received	257

Cloudera Community

Re: Regarding to activate HIVE ACID transactions o...

Re: Hive 1.2.1++

Re: What is the fastest way to load data into Apac...

Re: Do i have to commit my insert statment in hive...

Re: Deploying hortonworks sandbox VM to cluster

Re: Does Atlas support Pig, Sqoop

Re: SQoop job too slow importing data from Teradat...

Re: Hue configuration Error | Beewax | File Brows...

Re: Method for recovering from a full HDD due to A...

Re: Method for recovering from a full HDD due to A...

Re: sqoop sqlserver with windows authentication

Re: Select Quesry ResultSet as named Data Set

Re: Error on concatenating ORC Hive table (merge f...

Re: /usr/hdp/current/hadoop-client/conf doesn't ex...

Re: how to start sandbox?