Reply
Highlighted
Explorer
Posts: 17
Registered: ‎01-14-2017

Spark History Server Error - Unexpected end-of-input: expected close marker for OBJECT

Hello,

 

I am unable to retrieve information about completed jobs from the Spark2 history server. When I select the URL, the browser spins for a long time and then an error is displayed. This is logged in the history server log. 

 

It's Spark2 2.1.0.cloudera1-1.cdh5.7.0.po.120904

 on CDH 5.14.0-1.cdh5.15.0.p0.24

 

Thanks in advance.

--Willie

 

 

2018-03-16 15:39:18,323 WARN org.spark_project.jetty.servlet.ServletHandler: /history/application_1520027530212_0115/1
com.fasterxml.jackson.core.JsonParseException: Unexpected end-of-input: expected close marker for OBJECT (from [Source: {"Event":"SparkListenerTaskEnd"
,"Stage ID":17,"Stage Attempt ID":0,"Task Type":"ShuffleMapTask","Task End Reason":{"Reason":"Success"},"Task Info":{"Task ID":380625,"Index":109491,"A
ttempt":0,"Launch Time":1521151335745,"Executor ID":"19","Host":"spark-cnd-6.cndnet.mitre.org","Locality":"PROCESS_LOCAL","Speculative":false,"Getting
Result Time":0,"Finish Time":1521151335768,"Failed":false,"Killed":false,"Accumulables":[{"ID":6507727,"Name":"internal.metrics.executorDeserializeTime
","Update":3,"Value":203231,"Internal":true,"Count Failed Values":true},{"ID":6507728,"Name":"internal.metrics.executorDeserializeCpuTime","Update":241
5036,"Value":195264139124,"Internal":true,"Count Failed Values":true},{"ID":65077; line: 1, column: 704])
 at [Source: {"Event":"SparkListenerTaskEnd","Stage ID":17,"Stage Attempt ID":0,"Task Type":"ShuffleMapTask","Task End Reason":{"Reason":"Success"},"Ta
sk Info":{"Task ID":380625,"Index":109491,"Attempt":0,"Launch Time":1521151335745,"Executor ID":"19","Host":"spark-cnd-6.cndnet.mitre.org","Locality":"
PROCESS_LOCAL","Speculative":false,"Getting Result Time":0,"Finish Time":1521151335768,"Failed":false,"Killed":false,"Accumulables":[{"ID":6507727,"Nam
e":"internal.metrics.executorDeserializeTime","Update":3,"Value":203231,"Internal":true,"Count Failed Values":true},{"ID":6507728,"Name":"internal.metr
ics.executorDeserializeCpuTime","Update":2415036,"Value":195264139124,"Internal":true,"Count Failed Values":true},{"ID":65077; line: 1, column: 2149]
        at com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:1581)
        at com.fasterxml.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:533)
[...]
        at org.apache.spark.deploy.history.HistoryServer$$anon$1.doGet(HistoryServer.scala:86)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:687)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
        at org.spark_project.jetty.servlet.ServletHolder.handle(ServletHolder.java:812)
        at org.spark_project.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:587)
        at org.spark_project.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
        at org.spark_project.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
        at org.spark_project.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
        at org.spark_project.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
        at org.spark_project.jetty.servlets.gzip.GzipHandler.handle(GzipHandler.java:479)
        at org.spark_project.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
        at org.spark_project.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
        at org.spark_project.jetty.server.Server.handle(Server.java:499)
        at org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:311)
        at org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
        at org.spark_project.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
        at org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
        at org.spark_project.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
        at java.lang.Thread.run(Thread.java:745)

 

 

 

Announcements