Reply To: Required executor memory is above the max threshold of this cluster

I suspect you are setting max allocation too small. Please check the following configuration in yarn-site.xml whether it is 512M. IMO, 512 is too small for most of applications.  Please increase it like 16384m (16g). You need to restart the cluster to make it take effect)

yarn.scheduler.maximum-allocation-mb