Optimized Spark Cluster configurations based on machine type and size
Bug Fixes
Fixed an issue with Spark Cluster billing to be more precise
Fixed an issue when cloning a notebook with Spark Clusters
Fixed an issue with test connections not working with MaxCompute data source
Fixed an issue with Snowflake SSO if the username and password specified are different from the one used to authenticate with SSO
Fixed an issue where published paragraphs using z.show tables and graphs don’t use the full width
September 17, 2021
Improvements
Added various security enhancements
Optimizations for executors and worker nodes when using Spark Clusters
Bug Fixes
Fixed an issue where 128GB containers would show not available
September 7, 2021
Improvements
Added a notification that a notebook is published (static) vs interactive
Bug Fixes
Fixed an issue where the General Purpose Cluster image was mistakenly assigned by default
Fixed an issue where publishing a paragraph redirects to the frontend and shows an error
Fixed an issue where publishing a paragraph in an iFrame was blocked by a security restriction
Fixed various issues around Spark Cluster stability
Fixed an issue where Shell commands were not working with Spark Clusters
Fixed an issue where the IPython interpreter failed to start with Spark Clusters
Fixed an issue where running a container shows stopped state then executes
Fixed an issue where R code in an Image caused a build error
Fixed an issue with permissions for deleting notebooks and spaces
August 24, 2021
New Features
Importing Private Library JAR files for Spark, Python, and R
Improvements
Added more statuses for Spark Clusters
Changed the Favicon to the DataRobot icon
Bug Fixes
Fixed an issue where where the Spark UI had an HTTP 400 error
Fixed an issue with the create notebook modal for Spark Clusters
Fixed an issue with large paragraph outputs that could crash a notebook
Fixed an issue with link this paragraph returning a 404 error
Fixed an issue where a notebook may crash if a paragraph is running and a user selects the run button again
Fixed an issue with Images when creating a BigQuery data source
Fixed an issue when toggling on a Spark Cluster which had a slight delay in the status
Fixed an issue where disabled paragraphs run the first time a notebook is run
Fixed various issues around Spark Cluster state management
August 11, 2021
New Features
Edge Execution Engine enables the control plane and data plane (compute) to be located in different regions (Limited Preview)
Improvements
New Image (General Purpose - Summer 2021) includes IRkernel for R, Snowflake Snowpark 0.7.0, and Zeppelin 0.9 support (Limited Preview)
Bug Fixes
Fixed an issue where container history is not showing any runs
Fixed an issue where a BigQuery data source times out after ~60 min
Fixed an issue where the progress bar for a paragraph was not running
Fixed an issue where the run button in a paragraph may be enabled while a paragraph is executing
Fixed an issue where a Spark Template was not providing any additional information in the Notebook Settings
Fixed an issue where the paragraph status was skipping pending and running which did not provide users the ability to stop a paragraph while executing
Fixed an issue when cloning an image “*library* is already installed to the image - please remove from the list above [HTTP 500]”
Fixed an issue with syntax highlighting not working properly
Fixed an issue when using native Plotly where the modebar may not render properly
Fixed an issue where a Spark Cluster could be created without a template assigned
Fixed an issue where the LaTeX equation editor was not formatting consistently
Fixed an issue where Snowflake Datasource Consumption not tracked properly so logging was added
July 27, 2021
Improvements
Updated button to start and stop a container or cluster
Bug Fixes
Fixed an issue where deleting a notebook did not delete the association with an Image
Fixed an issue where deleting a notebook did not delete any scheduled jobs
Fixed an issue where horizontal scroll bars were appearing all the time and now they only show when needed
July 13, 2021
Improvements
Added data range filter, triggered by and total cost fields to container and cluster monitoring
Updated button to start and stop a container or cluster
Bug Fixes
Fixed an issue where Plotly charts were not rendering through code
Fixed an issue where an abort message was displaying after stopping a container
Fixed an issue where the output of a notebook would clear after the notebook was closed
Fixed an issue which started two Spark clusters when clicking the run paragraph button while a Spark cluster is already starting
June 29, 2021
New Features
Spark Cluster Monitoring (Running & History)
Improvements
Auto-provision SSO users on successful sign-in
Changed invite screen to a modal
Bug Fixes
Fixed an issue where the default interpreter is not applied properly to new paragraphs
Fixed an issue printing data frames with many columns where the output could exceed the width of the paragraph
Fixed an issue when clicking on an ellipsis menu incorrectly shows an oval
Fixed an issue where a Spark Cluster appeared to run even though the user did not have permission
June 23, 2021
New Features
Start / stop a container or Spark Cluster for a notebook without running the notebook or paragraph(s)
Improvements
Open Spark UI in new browser tab
Enhanced sample notebook service
Publish paragraph permissions
Bug Fixes
Fixed an issue where Spark UI links were broken
June 2, 2021
Improvements
Enhanced sample notebook service
Bug Fixes
Fixed an issue where the interpreter output was not saved when using Zeppelin 0.9 image
Fixed an issue where the schedule modal doesn’t schedule from the Spaces page
Fixed an issue where the data source details page doesn’t show shared vs private detail
May 18, 2021
Improvements
New execution engine (GA) is the default going forward for any organizations that are created
Show Pendo guide for invited users
Bug Fixes
Fixed an issue for 'Test All Connections' in a notebook
Fixed an issue for Clone notebook not working from Spaces page
April 15, 2021
New Features
Publish paragraphs for anyone to access
Improvements
New execution engine for containers (Preview)
Idle timeout for containers moved to Notebook Settings
Removed New Container button on Resources > Containers page
Aligned Clone Notebook modal with Create Notebook modal
Bug Fixes
Fixed an issue when permissions for Spark Clusters were visible when Spark Clusters is not enabled
Fixed an issue to disable the Run button in a notebook if a user is not authorized
Fixed an issue to remove the Cluster radio button in Create Notebook modal when Spark Clusters is not enabled
February 10, 2021
New Features
Spark Clusters (Preview)
Improvements
New UI for Monitoring Containers (Running & History)
February 9, 2021
Improvements
Updated pricing ($100 worth of free Zepl credits, Scalable compute from 4GB to 128GB)
Miscellaneous improvements with Authentication Providers modal, Invite new member performance, Scheduled jobs modal
Bug Fixes
Fixed API links
Fixed Org Switcher state issues
February 2, 2021
Bug Fixes
Fixed error "exceeded number of concurrent notebooks allowed for this resource" [404]
Fixed Authentication Provider links to documentation
January 15, 2021
New Features
Firewall with Inclusion List and Exclusion List
Improvements
Added Conda support in Images
Bug Fixes
Fixed java.lang.OutofMemoryError: Java heap space with SparkR
Fixed inviting an existing user
January 8, 2021
Bug Fixes
Data Source credentials can not be updated by a user who did not create the data source
December 17, 2020
New Features
Batch querying for Google BigQuery
Block countries from accessing your organization
Improvements
Renamed 'Resources' to 'Containers'
Renamed 'Custom Images' to 'Images'
December 8, 2020
New Features
Access tokens available for API's in My Profile page
Improvements
Data source redesign
Bug Fixes
Fixed logout
Fixed adding members to teams
December 1, 2020
New Features
Secret Store for private storage of credentials, for example environment variables (passwords, secrets, and tokens) that are data source independent and can be accessed by any data source API