I was facing the same issue. Looks like this is a bug in spark or documentation.
Solved it by giving “–conf hdp.version=2.2.0.0-2041″ in the spark command.
I was facing the same issue. Looks like this is a bug in spark or documentation.
Solved it by giving “–conf hdp.version=2.2.0.0-2041″ in the spark command.