We just published the technical preview of Spark 1.1.0 with HDP
Check out http://hortonworks.com/kb/spark-1-1-0-technical-preview-hdp-2-1-5/
Notable new features among other Spark 1.1.0 features.
* Run Spark on YARN and runs the canonical Spark examples of running SparkPI and Wordcount
* Work with a built-in UDF, collect-list, a key feature of Hive 13. This technical preview provides support for Hive 0.13.1 and instructions on how to call this UDF from Spark shell.
* Use ORC file as an HadoopRDD.