Quantcast
Channel: Hortonworks » All Replies
Viewing all articles
Browse latest Browse all 3435

storing data in hive in orc format through Java Spark API

$
0
0

I am using spark 1.3.1 and i want to store data in hive as a ORC format..

Below lines showing error, it looks like orc is not supporing as a data source in spark 1.3.1

dataframe.save(“/apps/hive/warehouse/person_orc_table_5″, “orc”);
Spark 1.4 has..

write.format(“orc”).partitionBy(“age”).save(“peoplePartitioned”)
to stored as an orc format..

Is there any way to store file in ORC format in spark 1.3.1 ??

Thanks,


Viewing all articles
Browse latest Browse all 3435

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>