Difference between executor and container in Spark

•  Spark Executor runs within a Yarn Container, not across Containers.
• A Yarn Container is provided by the YARN Resource Manager on demand - at start of Spark Application of via YARN Dynamic Resource Allocation.
• A Yarn Container can have only one Spark Executor, but 1 or indeed more Cores can be assigned to the Executor.
• Each Spark Executor and Driver runs as part of its own YARN Container.
• Executors run on a given Worker.
• Moreover, everything is in the context of an Application and as such an Application has Executors on many Workers.