@hardik desai The error seems to be because of logon to oracle DB. df = sqlContext.read.format("jdbc").option("driver", "oracle.jdbc.OracleDriver").option("url","jdbc:oracle:thin:NE/Network_147@10.77.1.147:1521/ELLDEV").option("dbtable","NE.INTER_APP_EVENT").load() py4j.protocol.Py4JJavaError: An error occurred while calling o42.load. : java.sql.SQLRecoverableException: Io exception: Broken pipe at oracle.jdbc.driver.SQLStateMapping.newSQLException(SQLStateMapping.java:101) at oracle.jdbc.driver.DatabaseError.newSQLException(DatabaseError.java:133) at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:199) at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:263) at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:521) at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:418) at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:508) at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:203) . You should check few things : 1. Using some sqlplus or oracle client tool are you able to connect to the mentioned URL? jdbc:oracle:thin:NE/Network_147@10.77.1.147:1521/ELLDEV 2. Try doing telnet from the machine where you are executing the script to see port access. telnet 10.77.1.147 1521 3. Broken Pipe error usually indicates a broken communication. Mostly due to abrupt termination of connection from the other end or N/W issue. 4. Check if the Oracle credentials that you are using are correct not expired/blocked. 5. Can you try passing the credentials as well using "user" and "password" options? Instead of passing it via the URL of the DB options.put("user", "USER").options.put("password", "PASS") . In General: The driver is trying to create a new connection and the DBMS breaking the socket between it and the driver, at a very early stage of the process. This has to be either a network issue, or more likely a DBMS issue like if there are too many connection requests at once or in a short burst, the DBMS listener process gets overloaded and severs some of the incoming sockets. ... View more

@Palanivelrajan Chellakutty When you manage the cluster using Ambari then you should make modification in the configurations changes Only via Ambari UI or using ambari APIs, Because if you manually make the configuration changes on a particular host XML file then ambari will not be aware of that change and hence if you restart your services from ambari UI then ambari will again push the Older XML configuration (that are present in the ambari UI service configurations) while starting the services/components, This will cause your manual changes to be undone. . ... View more

@Sara Alizadeh Are you able to access the repository from the host where you are trying to install Falcon? wget http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.5.3.0/hdp.repo . - I am suspecting that the "There are unfinished transactions remaining." message is appearing because of some old yum transaction was going on. Are you getting the same message every time you are trying to install falcon? - Regarding the timeout message i am suspecting that it might be due to slow N/W or Are you using any Proxy on your host or at the yum level? Which might be causing the slow installation and ultimately the agent timeout (because by default ambari agent takes 1800 seconds to complete the task, Please see agent.package.install.task.timeout=1800 in "/etc/ambari-server/conf/ambari.properties". The mentioned time is usually enough, But if you have any N/W issue (internet slowness) or proxy server issue then you might see the timeout. ... View more

@Rohit Sharma As per the release notes of Ambari 2.5 , Zeppelin View is removed from Ambari, So you can not use it. You will have to use the Zeppelin UI instead. If you are in Ambari 2.4 then you can try using the lower version of JDK to avoid the issue that you reported. Because Zeppelin view doesn't work with JDK 1.8_91+ : https://issues.apache.org/jira/browse/AMBARI-18918 ... View more

@Rohit Sharma 1. Do you see any response from the following URL: http://<${ATS_HOSTNAME}:${ATS_PORT}/ws/v1/timeline/TEZ_DAG_ID?limit=1 2. Do you have YARN ACLs is enabled ? 3. Do you have the following settings in your "yarn-site.xml" ? "yarn.timeline-service.enabled" "yarn.timeline-service.webapp.address" this Value must be the IP:PORT on which timeline server is running 4. Do you see the complete error stack trace in the ambari-server log? Can you please share the log. 5. Also please check the ATS log to see if there is any error. 6. Do you have ResourceManager HA enabled? . ... View more

@vsubramanian Did you try the "recursive=true" option as following: Example: curl -X GET "http://erie1.example.com:50070/webhdfs/v1/user/admin?op=LISTSTATUS&recursive=true" It will search recursively the "/user/admin" and will list all the files/directories details. Then we can use "grep" to find the particular File or Directory from the output JSON response. . ... View more

@Rohit Sharma According to Ambari 2.5 Release Notes (Deprecated Notice) list the "Zeppelin" and "Storm" views are removed from Ambari 2.5 so you won't see them in the Ambari UI any more. https://docs.hortonworks.com/HDPDocuments/Ambari-2.5.0.3/bk_ambari-release-notes/content/ambari_relnotes-2.5.0.3-deprecation-notices.html ... View more

@Rahul Gupta From Ambari UI --> HDFS --> Configs --> Advanced --> NameNode --> NameNode New Generation Size & NameNode maximum new generation size . ... View more

@John Cleveland Good to know that after fixing the path one issue is resolved. It will be really great if you mark this thread as answered by clicking the "Accept" link, this will help other community users to quickly go through the correct answers. ... View more