Quantcast
Channel: Hortonworks » All Replies
Viewing all articles
Browse latest Browse all 3435

Reply To: Performance improvement techniques for Spark SQL DataFrames

$
0
0

It’s hard to give direct solution for your problem. First you need figure what’s the performance bottleneck of you current problem. What kind of join do you use (is it one large table join with one small table). Do you have GC issue ? Do you have enough memory in executor to cache the table ? etc…


Viewing all articles
Browse latest Browse all 3435

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>