unable to change log level for spark apps in mode yarn-cluser

Hi,

I’m unable to change the log4j settings when running a streaming Spark app in yarn-cluster mode. When I’m executing it as yarn-client by modifying “spark.driver.extraJavaOptions” and “spark.executor.extraJavaOptions” I can properly set the level of logging.

With yarn-cluster these changes have no effect and the log in the containers keep growing and growing with a lot of INFO messages. I also tried to modify the “Advanced spark-log4j-properties” in the Ambari’s Spark configuration page with no luck.

YARN version: 2.6.0.2.2
Ambari version: 2.0.0
Spark version: 1.2.0.2.2

Thanks!