GCP(Dataproc) - When do you run Spark jobs in Cluster Mode on Dataproc?
Reddit r/dataengineering2d4 min read
I get the basic argument that running concurrent jobs on dataproc can cause Driver OOM and poor performance. But how do you decide between increasing the master node memory/compute or adding 1 more master node vs choosing cluster mode? submitted by /u/SinkNeither1527 [link] [comments]
