Member since
02-11-2019
78
Posts
1
Kudos Received
0
Solutions
11-22-2020
03:53 AM
Everything is done as per the installation guide you provided.... still no joy Weird thing is import from Teradata to CDH works seamlessly, Just can't get export working
... View more
11-20-2020
08:28 AM
the export command is correct, just typo when I typed it here Tried exporting entire table: Hive to Teradata Error: com.teradata.connector.common.exception.connectorException: Index outof boundary both tables in source and destination have exact same columns all varchar in Teradata and string in Hive/Impala
... View more
11-17-2020
03:51 PM
Trying to export specific columns from Hive Table to Teradata tables. Can we export specific columns not entire Hive table getting Unsupported parameter --columns from below export command sqoop export --connect jdbc:teradat://.... --username xxx --password bbb --table table_name --columns "col1, col2, col3" --m 6 --export-dir /table/location Running Sqoop Version 1.4.7-cdh6.2.1
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Sqoop
11-13-2020
09:35 PM
could you give a working example of this in spark 2.4 using scala dataframe can't seem to find the correct syntax... val result = dataFrame.select(count(when( col("col_1") === "val_1" && col("col_2") === "val_2", 1)
... View more
11-13-2020
10:55 AM
Please explain this " ... E.g. the following would require only a single scan of the table (although it might be more expensive cause you don't have filtering from the where clause)...." not sure what you mean by the comment in brackets how will it be more expensive, what can we do to fix that.
... View more
11-13-2020
10:49 AM
Where clause relies on multiple columns
... View more
11-11-2020
08:15 AM
Have a list of about 100+ SQL Count Queries to run against a Hive Data Table,
Looking for the most efficient way to run these queries.
Queries are accessed at runtime as a list of queries stored in another Hive Table, generated by a different process.
Queries like these each with a different where clause, where clauses are complex:
1. Select count(1) as count1 from MyTable where (... complex where clause here...)
2. Select Count(1) as Count1 from MyTable where (... where clause here ...)
3. etc..
Environment:
Cloudera CDH 6.2
... View more
Labels:
04-15-2020
12:27 PM
Thanks @pauldefusco I would like to do it in spark - scala
... View more
04-15-2020
11:30 AM
I have a source table Like ID USER DEPT 1 User1 Admin 2 User1 Accounts 3 User2 Finance 4 User3 Sales 5 User3 Finance I want to generate a DataFrame like this ID USER DEPARTMENT 1 User1 Admin,Accounts 2 User2 Finance 3 User3 Sales,Finance
... View more
Labels:
- Labels:
-
Apache Spark