Member since
01-19-2017
3676
Posts
632
Kudos Received
372
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 483 | 06-04-2025 11:36 PM | |
| 1011 | 03-23-2025 05:23 AM | |
| 536 | 03-17-2025 10:18 AM | |
| 1996 | 03-05-2025 01:34 PM | |
| 1257 | 03-03-2025 01:09 PM |
08-11-2016
12:41 PM
@chaitanya vasamsetty I hit the same problem a I have 2 entries in the MySQL DB for the adminprivileges ? I guess the id.1 is for the admin but I don't want to take a guess so could you tel me what exatctly you deleted?
... View more
08-10-2016
09:35 AM
@Jaime Unfortunately no official date is out there. But keep checking the hortonworks website for the breaking news ! An be the first to test drive it ...
... View more
07-27-2016
09:08 PM
1 Kudo
@milind pandit Watch out for blank space in the hostname .. The easiest solution is to rename the host .
... View more
07-19-2016
04:13 PM
@Jawed Ansari That will only affect the sandbox NOT even you host machine ...If you are so scared then I fear you won't learn I like screwing up stuff and trying to find my way out!! Its safe so go ahead and its just a Sandbox no production stuff !!
... View more
07-18-2016
06:09 AM
@Jawed Ansari Please see the attached document . In the screenshot attached I am using HDP 2.3.2 but I had to tweak the network settings, you can see that the tutorials are available. Please let me know if that helped you
... View more
07-13-2016
06:54 AM
@Rajib Mandal Can you describe your network setup ??ie Firewall rules bwteen these 3 nodes ?
... View more
07-13-2016
06:22 AM
@Rajib Mandal Check the data directories to confirm they are mounted as expected.unmounted data directories on the root partition may indicate that a data directory is writing to the root partition, which is undesirable. Error Datanode_unmounted_data_dir Also check permissions. Can you post the
/var/log/ambari-metrics-collector/ambari-metrics-collector.log
... View more
07-13-2016
04:45 AM
@Rajib Mandal The below services are NOT started. MapReduce2
Hive
Hbase
Oozie
Falcon
Storm
Altlas
Kafka Pinging the hosts isn't no big deal. Questions Did you configure the passwordless logon from the Ambari to the other 2 nodes?
Disable firewall /Iptables or Ip6tables?
Disable SeLinux.?
Disables THP ?
Configure NTPD? And lastly did you configure the Database for Hive or Oozie if you ain't using the default derby? Can you post here these logs Ambari Server logs are found at /var/log/ambari-server/ambari-server.log
Ambari Agent logs are found at /var/log/ambari-agent/ambari-agent.log .
... View more
07-07-2016
05:37 AM
@Sindhu The code snippet didn't work see [root@sandbox ~]# su - hdfs [hdfs@sandbox ~]$ hdfs dfs -chown -R sqoop:hdfs /user/root
chown: `/user/root': No such file or directory So what I did I just run the sqoop command as hdfs and it run successfully [hdfs@sandbox ~]$ sudo sqoop import --connect jdbc:oracle:thin:@192.168.0.15:1521/PROD --username sqoop -P --table DEPT_INFO
We trust you have received the usual lecture from the local System
Administrator. It usually boils down to these three things:
#1) Respect the privacy of others.
#2) Think before you type.
#3) With great power comes great responsibility.
[sudo] password for hdfs:
[hdfs@sandbox ~]$ sqoop import --connect jdbc:oracle:thin:@192.168.0.15:1521/PROD --username sqoop -P --table DEPT_INFO
Warning: /usr/hdp/2.3.2.0-2950/accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
16/07/07 05:25:32 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.3.2.0-2950
Enter password:
16/07/07 05:25:39 INFO oracle.OraOopManagerFactory: Data Connector for Oracle and Hadoop is disabled.
16/07/07 05:25:39 INFO manager.SqlManager: Using default fetchSize of 1000
16/07/07 05:25:39 INFO tool.CodeGenTool: Beginning code generation
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/hdp/2.3.2.0-2950/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/hdp/2.3.2.0-2950/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
16/07/07 05:25:52 INFO manager.OracleManager: Time zone has been set to GMT
16/07/07 05:25:53 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM DEPT_INFO t WHERE 1=0
16/07/07 05:25:53 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/hdp/2.3.2.0-2950/hadoop-mapreduce
Note: /tmp/sqoop-hdfs/compile/075dc9427b098234773ffaadf17b1b5f/DEPT_INFO.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
16/07/07 05:25:57 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hdfs/compile/075dc9427b098234773ffaadf17b1b5f/DEPT_INFO.jar
16/07/07 05:25:57 INFO manager.OracleManager: Time zone has been set to GMT
16/07/07 05:25:57 INFO manager.OracleManager: Time zone has been set to GMT
16/07/07 05:25:57 INFO mapreduce.ImportJobBase: Beginning import of DEPT_INFO
16/07/07 05:25:58 INFO manager.OracleManager: Time zone has been set to GMT
16/07/07 05:26:00 INFO impl.TimelineClientImpl: Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/
16/07/07 05:26:01 INFO client.RMProxy: Connecting to ResourceManager at sandbox.hortonworks.com/192.168.0.104:8050
16/07/07 05:26:06 INFO db.DBInputFormat: Using read commited transaction isolation
16/07/07 05:26:06 INFO db.DataDrivenDBInputFormat: BoundingValsQuery: SELECT MIN(DEPT_ID), MAX(DEPT_ID) FROM DEPT_INFO
16/07/07 05:26:06 INFO mapreduce.JobSubmitter: number of splits:4
16/07/07 05:26:06 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1467711992449_0004
16/07/07 05:26:07 INFO impl.YarnClientImpl: Submitted application application_1467711992449_0004
16/07/07 05:26:07 INFO mapreduce.Job: The url to track the job: http://sandbox.hortonworks.com:8088/proxy/application_1467711992449_0004/
16/07/07 05:26:07 INFO mapreduce.Job: Running job: job_1467711992449_0004
16/07/07 05:26:32 INFO mapreduce.Job: Job job_1467711992449_0004 running in uber mode : false
16/07/07 05:26:32 INFO mapreduce.Job: map 0% reduce 0%
16/07/07 05:26:55 INFO mapreduce.Job: map 25% reduce 0%
16/07/07 05:27:22 INFO mapreduce.Job: map 50% reduce 0%
16/07/07 05:27:25 INFO mapreduce.Job: map 100% reduce 0%
16/07/07 05:27:26 INFO mapreduce.Job: Job job_1467711992449_0004 completed successfully
16/07/07 05:27:27 INFO mapreduce.Job: Counters: 30
File System Counters
FILE: Number of bytes read=0
FILE: Number of bytes written=584380
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=417
HDFS: Number of bytes written=95
HDFS: Number of read operations=16
HDFS: Number of large read operations=0
HDFS: Number of write operations=8
Job Counters
Launched map tasks=4
Other local map tasks=4
Total time spent by all maps in occupied slots (ms)=164533
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=164533
Total vcore-seconds taken by all map tasks=164533
Total megabyte-seconds taken by all map tasks=41133250
Map-Reduce Framework
Map input records=9
Map output records=9
Input split bytes=417
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=871
CPU time spent (ms)=10660
Physical memory (bytes) snapshot=659173376
Virtual memory (bytes) snapshot=3322916864
Total committed heap usage (bytes)=533200896
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=95
16/07/07 05:27:27 INFO mapreduce.ImportJobBase: Transferred 95 bytes in 87.9458 seconds (1.0802 bytes/sec)
16/07/07 05:27:27 INFO mapreduce.ImportJobBase: Retrieved 9 records.
... View more
07-07-2016
04:36 AM
@Angel Kafazov Did you take note of no.9 "zookeeper.znode.parent" and restart all the components
... View more