Apache Spark

Spark single application consumes all resources – Good or Bad for your cluster ?

While working with Spark, I hear it so many times when client or my team “complaints” that single Spark job is taking all resources. So is it bad for your cluster ? Whether to consider this as bad or good totally depends on the type of applications you are running. There can be two scenarios

Spark single application consumes all resources – Good or Bad for your cluster ? Read More »