Spark Case Study – optimise executor memory and cores per executor
I was recently working on a task where I have to read more than a Terabyte of data spread across multiple parquet files. Also some filters were applied on that data to get the required result set. I did a […]
Read more