Event language
UI language
<p>Apache Spark often feels like a black box to beginners because it does not execute code line by line like traditional Python or Pandas programs. This talk introduces a practical mental model to understand how Spark decides what to run and when execution actually happens. It explains lazy evaluation, the role of transformations and actions, and how Spark builds logical and physical execution plans that form a DAG.</p><p>The session also demonstrates how developers can take a peek into Spark’s execution plan and reason about performance issues. Aimed at PySpark beginners, this talk focuses on understanding Spark’s execution behaviour without diving deep into complex internals, helping developers write more predictable and efficient data pipelines.</p>