"When Avro data is stored in a file, its schema is stored with it, so that files may be processed later by any program." I believe the schema is required so it is stored with the data you imported into HDFS. Could you run the following command to have more details about the error? yarn logs -applicationId application_1473774257007_0002 ... View more

I'd recommend you upgrading to a more recent version of HDP. In recent versions of Ambari you can install Grafana that proposes such graphs and much more. http://hortonworks.com/blog/advanced-metrics-visualization-dashboarding-apache-ambari/ Otherwise you have a real time representation of your current queues use in the YARN resource manager UI. If you want to do something custom, you can have a look at the REST APIs exposed by YARN: https://hadoop.apache.org/docs/r2.7.0/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html Hope this helps. ... View more

You need to go where your Spark client is installed. Depending of your install/OS, it may be : /usr/hdp/current/spark-client/sbin Hope this helps. ... View more

Do you have a full stack trace that you could share? What is your schema (maybe some types are not yet supported with Teradata connector depending of the version)? ... View more

Could you try with lower case? --compression-codec lzop Based on the code: https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/io/CodecMap.java it may be case sensitive... ... View more

Hi, Based on this documentation : https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.2/bk_HortonworksConnectorForTeradata/content/ch_HortonworksConnectorForTeradata.html#ch_HortonworksConnectorForTeradata-Appendix-Options-Sqoop I think you need to: - "Note: If you will run Avro jobs, download avro-mapred-1.7.4-hadoop2.jar and place it under $SQOOP_HOME/lib." - Give as argument the Avro schema of the data you want to import through the option 'avroschemafile'. This is a connector-specific argument so you would need to do something like: sqoop import--connection-manager org.apache.sqoop.teradata.TeradataConnManager--connect jdbc:teradata://**.***.***.**/DATABASE=***** --username ****** --password ***** --table employee --target-dir /home/****/tera_to_hdfs125 --as-avrodatafile -m 1 -- --avroschemafile <schema> Hope this helps. ... View more