-
GC Problems in Spark Streaming Under Light Workloads 
Liao Jiayi #JVM A Spark troubleshooting case involving a simple job that reads from Kafka, applies tagging operators, and writes to Hive.
-
Spark - Cleaning Up Objects with WeakReference Liao Jiayi #JVM#Spark#Apache Spark A Stack Overflow question about when Spark reclaims Accumulator and Broadcast variables led me to explore how ContextCleaner uses WeakReference and a reference queue to clean up unused objects.
-
java.lang.OutOfMemoryError: Map failed Liao Jiayi #JVM An incident in which Map Failed caused a JVM out-of-memory error, with its causes and remedies.
-
Understanding hs_err_pid.log Liao Jiayi #Memory#Linux#JVM A guide to JVM fatal-error logs, including thread states, native frames, and memory information.