Member since
07-18-2016
262
Posts
12
Kudos Received
21
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
6766 | 09-21-2018 03:16 AM | |
3255 | 07-25-2018 05:03 AM | |
4227 | 02-13-2018 02:00 AM | |
1979 | 01-21-2018 02:47 AM | |
38150 | 08-08-2017 10:32 AM |
08-01-2016
10:52 AM
Could you follow below process 1)# sudo service postgresql start Starting
postgresql service:[FAILED] If failed 2))Moved
the data directory to [root@centos
pgsql]# cd /var/lib/pgsql [root@centos
pgsql]# mv -f data/ data_bkp [root@centos
pgsql]# pwd /var/lib/pgsql 3) Check how your postgresql address how its listening $ grep listen /var/lib/pgsql/data/postgresql.conf if 'localhost' change to "*" 4) Start the postgresql database # sudo service postgresql start ( It should be ok) Then proceed with install ambari and setup the server.
... View more
08-01-2016
10:15 AM
Please find more information on Apache hadoop org https://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html#Job_Input
... View more
08-01-2016
10:13 AM
Please find more information InputFormat describes the input-specification for a MapReduce job. The MapReduce framework relies on the InputFormat of the job to:
Validate the input-specification of the job. Split-up the input file(s) into logical InputSplit instances, each of which is then assigned to an individual Mapper. Provide the RecordReader implementation used to glean input records from the logical InputSplit for processing by the Mapper. The default behavior of file-based InputFormat implementations, typically sub-classes of FileInputFormat, is to split the input into logical InputSplit instances based on the total size, in bytes, of the input files. However, the FileSystem blocksize of the input files is treated as an upper bound for input splits. A lower bound on the split size can be set via mapreduce.input.fileinputformat.split.minsize. Clearly, logical splits based on input-size is insufficient for many
applications since record boundaries must be respected. In such cases,
the application should implement a RecordReader, who is responsible for respecting record-boundaries and presents a record-oriented view of the logical InputSplit to the individual task. TextInputFormat is the default InputFormat. The Hadoop job client then submits the job (jar/executable etc.) and configuration to the ResourceManager which then assumes the responsibility of distributing the software/configuration to the slaves(HDFS or Datanodes), scheduling tasks and monitoring them, providing status and diagnostic information to the job-client. if this is help full coments and accept are appreciated.
... View more
08-01-2016
09:29 AM
Thanks for your reply. I did the following this it worked for me. 1) Stopped the Ambari and Postgresql database [root@centos ~]# ambari-server stop
Using python /usr/bin/python2.6
Stopping ambari-server
Ambari Server stopped
[root@centos ~]# service postgresql stop
Stopping postgresql service: [ OK ]
[root@centos ~]# 2) Changed the network setting VM ware from Bridge to NAT 3) Restarted the Network Service #service network restart 4) Started the Postgresql database [root@centos ~]# service postgresql start
Starting postgresql service: [ OK ] 5) Stared the Ambari-service [root@centos ~]# ambari-server stop
Using python /usr/bin/python2.6
Starting ambari-server After complete this mine Ambari Web Interface was working fine.
... View more
07-31-2016
01:13 PM
1)Both Installed on same server 2)Could you elaborate ambari-properties has correct end point ?
... View more
07-31-2016
07:04 AM
Thank you for reply I was able to connect when i have installed & Setup the ambar, however now not able to login 1) Postgrec SQl is listening the port to 5432 2) Its running fine , please find log postgres 1604 1 0 11:01 ? 00:00:00 /usr/bin/postmaster -p 5432 -D /var/lib/pgsql/data
postgres 1606 1604 0 11:01 ? 00:00:00 postgres: logger process
postgres 1608 1604 0 11:01 ? 00:00:01 postgres: writer process 3) How to verify the firewall , kindly advise
... View more
07-31-2016
06:28 AM
Each tolls and purpose of its http://www.datamation.com/applications/hadoop-and-big-data-60-top-open-source-tools-1.html
... View more
07-31-2016
06:26 AM
You check this , it also gives some basic information, which tool used for what purpose http://hortonworks.com/products/data-center/hdp/
... View more
07-31-2016
06:19 AM
From ambari logfile
31 Jul 2016 07:03:08,401 INFO [main] Configuration:594 - Reading password from existing file
31 Jul 2016 07:03:08,447 INFO [main] Configuration:864 - Hosts Mapping File null
31 Jul 2016 07:03:08,448 INFO [main] HostsMap:60 - Using hostsmap file null
31 Jul 2016 07:03:09,669 INFO [main] ControllerModule:185 - Detected POSTGRES as the database type from the JDBC URL
31 Jul 2016 07:03:12,339 INFO [main] ControllerModule:558 - Binding and registering notification dispatcher class org.apache.ambari.server.notifications.dispatchers.AlertScriptDispatcher
31 Jul 2016 07:03:12,375 INFO [main] ControllerModule:558 - Binding and registering notification dispatcher class org.apache.ambari.server.notifications.dispatchers.EmailDispatcher
31 Jul 2016 07:03:12,678 INFO [main] ControllerModule:558 - Binding and registering notification dispatcher class org.apache.ambari.server.notifications.dispatchers.SNMPDispatcher
31 Jul 2016 07:04:29,015 INFO [main] Configuration:594 - Reading password from existing file
31 Jul 2016 07:04:29,061 INFO [main] Configuration:864 - Hosts Mapping File null
31 Jul 2016 07:04:29,061 INFO [main] HostsMap:60 - Using hostsmap file null
31 Jul 2016 07:04:30,049 INFO [main] ControllerModule:185 - Detected POSTGRES as the database type from the JDBC URL
31 Jul 2016 07:04:32,210 INFO [main] ControllerModule:558 - Binding and registering notification dispatcher class org.apache.ambari.server.notifications.dispatchers.AlertScriptDispatcher
31 Jul 2016 07:04:32,227 INFO [main] ControllerModule:558 - Binding and registering notification dispatcher class org.apache.ambari.server.notifications.dispatchers.EmailDispatcher
31 Jul 2016 07:04:32,388 INFO [main] ControllerModule:558 - Binding and registering notification dispatcher class org.apache.ambari.server.notifications.dispatchers.SNMPDispatcher
31 Jul 2016 07:05:38,265 ERROR [main] DBAccessorImpl:100 - Error while creating database accessor
org.postgresql.util.PSQLException: Connection refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:207)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:64)
at org.postgresql.jdbc2.AbstractJdbc2Connection.<init>(AbstractJdbc2Connection.java:138)
at org.postgresql.jdbc3.AbstractJdbc3Connection.<init>(AbstractJdbc3Connection.java:29)
.
.
.
at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1024)
at com.google.inject.internal.InjectionRequestProcessor$StaticInjection.injectMembers(InjectionRequestProcessor.java:110)
at com.google.inject.internal.InjectionRequestProcessor.injectMembers(InjectionRequestProcessor.java:78)
at com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:170)
at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:109)
at com.google.inject.Guice.createInjector(Guice.java:95)
at com.google.inject.Guice.createInjector(Guice.java:72)
at com.google.inject.Guice.createInjector(Guice.java:62)
at org.apache.ambari.server.controller.AmbariServer.main(AmbariServer.java:701)
Caused by: java.net.ConnectException: Connection timed out
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:345)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at java.net.Socket.connect(Socket.java:538)
at org.postgresql.core.PGStream.<init>(PGStream.java:60)
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:101)
... 47 more
Please can you help
... View more
Labels:
- Labels:
-
Apache Ambari
07-27-2016
01:25 PM
Restarted the HRegion Server Servicefor this and We came out of the error .
... View more