Spark Memory Management Overview Tricks of the Trade: Tuning JVM Memory for Large-scale Services Managing Spark Partitions with Coalesce and Repartition The hidden cost of Spark withColumn Logging Spark Streaming Logging Configuration S3 Log4j Appender Log4j appender with S3 and search publishing