Apache Spark components and architecture An architecture diagram generated by Archify. SparkContext · Driver Program SparkContext Cluster Manager · Architecture component Cluster Manager Cache · Worker Node › Executor Cache Task · Worker Node › Executor Task Task · Worker Node › Executor Task Cache · Worker Node › Executor Cache Task · Worker Node › Executor Task Task · Worker Node › Executor Task Driver Program Executor Worker Node Executor Worker Node Legend SparkContext Cache Cluster manager Task