This is an issue with SparkSQL. When it creates the Spark table, it needs Hive meta store under HDFS and without it, the issue you ran into manifests.
The workaround is to run with hdfs user and it has all the downside of elevated priviledges.
This is an issue with SparkSQL. When it creates the Spark table, it needs Hive meta store under HDFS and without it, the issue you ran into manifests.
The workaround is to run with hdfs user and it has all the downside of elevated priviledges.