Reply
New Contributor
Posts: 4
Registered: ‎07-20-2017

Error while working with csv file in Envelope

i am using following conf file

 

application {
name = VoteData
executors = 2
}
steps {
fsInput {
input {
type = filesystem
path =/user/prashanth/Vote.txt
format = csv
separator ="\t"
field.names = [data1,data2,data3,data4,date]
field.types = [int,int,double,double,string]
}
}
fsProcess{
dependencies = [fsInput]
deriver {
type = sql
query.literal = "SELECT * FROM fsInput"
}
planner = {
type = append
}
output = {
type = filesystem
path = /user/prashanth
format = csv
}
}
}

 

 

i am getting the following error

 

Exception in thread "main" com.typesafe.config.ConfigException$BadPath: path parameter: Invalid path 'null-value': Token not allowed in path expression: '-' (Invalid number: '-') (you can double-quote this token if you really want it here)
at com.typesafe.config.impl.Parser.parsePathExpression(Parser.java:934)

 

 

Cloudera Employee
Posts: 18
Registered: ‎08-26-2015

Re: Error while working with csv file in Envelope

Hi,

I tried to replicate the error but wasn't able to. Are you sure that was
the configuration file you used? I don't see any reference to 'null-value'
in there. But either way if you could provide the full stack trace that
should be enough to narrow it down.
New Contributor
Posts: 4
Registered: ‎07-20-2017

Re: Error while working with csv file in Envelope

Exception in thread "main" com.typesafe.config.ConfigException$BadPath: path parameter: Invalid path 'null-value': Token not allowed in path expression: '-' (Invalid number: '-') (you can double-quote this token if you really want it here)
at com.typesafe.config.impl.Parser.parsePathExpression(Parser.java:934)
at com.typesafe.config.impl.Parser.parsePath(Parser.java:974)
at com.typesafe.config.impl.Path.newPath(Path.java:220)
at com.typesafe.config.impl.SimpleConfig.hasPath(SimpleConfig.java:71)
at com.cloudera.labs.envelope.utils.ConfigUtils$OptionMap.resolve(ConfigUtils.java:80)
at com.cloudera.labs.envelope.input.FileSystemInput.configure(FileSystemInput.java:165)
at com.cloudera.labs.envelope.input.InputFactory.create(InputFactory.java:62)
at com.cloudera.labs.envelope.run.Runner.extractSteps(Runner.java:114)
at com.cloudera.labs.envelope.run.Runner.run(Runner.java:72)
at com.cloudera.labs.envelope.EnvelopeMain.main(EnvelopeMain.java:45)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:729)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

Cloudera Employee
Posts: 18
Registered: ‎08-26-2015

Re: Error while working with csv file in Envelope

Interesting. It appears Envelope is referencing Typesafe Config v1.0.2
instead of the v1.2.1 that it is supposed to compile with. Can you provide:

- How you built the Envelope jar
- Your spark2-submit call
- Your CDH and Spark versions
Announcements

Currently incubating in Cloudera Labs:

Envelope
HTrace
Ibis
Impyla
Livy
Oryx
Phoenix
Spark Runner for Beam SDK
Time Series for Spark
YCSB