The existing notebook execution engine provides functionality to manage the lifecycle of the notebook containers. This was a great start, however we see the opportunity for expanding the notebook capabilities to clusters and additional distributed compute technology which requires a New Execution Engine.
Key Benefits of the New Execution Engine
Improved notebook container start up time
Support for Spark Clusters (Preview)
Cloud agnostic and in the future will enable Zepl deployments (SaaS and VPZ) to run on any Cloud Provider including Microsoft Azure and Google Cloud Platform
Support for additional distributed compute including GPU, Dask, and Ray in the future
Remote execution that in the future will move the execution even closer to the customer's data and into their cloud further reducing costs
The best part is there are no specific steps a user needs to take in order to utilize the New Execution Engine for containers. Zepl Support ([email protected]) can enable this for your organization(s) on request during Preview, and then this will become the standard execution engine for the future!