What's New

March 9, 2022
Improvements
Added Spark driver log that is available even after the cluster has been terminated
Removed the notebook key from the file upload box
Bug Fixes
Fixed an issue where the monitor history page could take a long time to load
Fixed an issue where a MaxCompute data source was not accessible when using a Spark cluster
Fixed an issue where websocket connections could fail
Fixed an issue where dynamic form fields may revert back to previous values when refreshing
Fixed an issue when opening the Clone dialog box
Fixed an issue where importing a notebook flow needs to prompt the user to login if no orgs have been stored as previously signed in
Fixed an issue on the registration flow to redirect to a new window when using an iFrame
Fixed an issue to persist and restore form params in LocalStorage
Fixed an issue to update Spark & Hadoop version in create new image dropdown
January 18, 2022
Improvements
Upgraded socket.io service to a newer version
Users that are deleted will now show a “Deleted” flag by their name, and the user profile will still be visible
Bug Fixes
Fixed an issue when no default image is found
Fixed an issue when a notebook may not start due to incorrectly selecting the image to use
Fixed an issue where scheduled jobs may not run daily as planned
Fixed an issue when deleting a user an error might occur
January 6, 2022
New Features
Added Qubole data source
Bug Fixes
Fixed an issue when uploading a file with the same name that the previous file would still be used
Fixed an issue where the Monitor page could load slowly if there is a lot of history
Fixed an issue where % datasource (SQL) does not work with Spark clusters
December 17, 2021
Improvements
Added the ability for an org admin to deactivate a user from the members page
Bug Fixes
Fixed an issue when running Spark Clusters and getting error ‘Internal error: EOF’
Fixed an issue when cloning a notebook to now also include the attached data source
Fixed an issue when refreshing the browser while a paragraph is running shows finished or abort
Fixed an issue when running a Spark Cluster which may crash when a physical memory limit is reached
Fixed an issue where frontend messages may be displayed out of order
Fixed an issue where a running notebook is not shutdown on notebook delete
Fixed an issue when selecting stop/cancel on a running paragraph could render the notebook to hang until it is restarted
November 16, 2021
Improvements
Added websocket messaging for the Spark UI so the button will only appear when the cluster is ready and will be removed when terminated
Bug Fixes
Fixed an issue when reordering paragraphs was not saved correctly
Fixed an issue where a notebook could run without any remaining credits
Fixed an issue where the delete button for notebooks and spaces was visible even though the user did not have permission
November 5, 2021
Bug Fixes
Fixed an issue with permissions for deleting notebooks and spaces
Fixed an issue with org switcher where an error may occur when switching orgs
Fixed an issue with importing a notebook (Fetch from URL) in a published notebook for error 'Unable to convert this notebook to a Zepl notebook’
November 4, 2021
Improvements
General Purpose - Fall 2021 image is generally available and includes hdbcli 2.9.28, Plotly 5.1.0, Snowpark 0.8.0, and DataRobot 2.25.1
Added timestamps to the API for uptime and startup time for containers and clusters
Published cluster events via WebSockets are displayed to the user
Bug Fixes
Fixed an issue where the notebook status was incorrect when a cluster was starting
Fixed an issue where multiple results that were returned quickly may have missed showing all output to the frontend 
Fixed an issue where the previous results were still showing in the frontend even though new results were available
Fixed an issue when reading large datasets using R and MaxCompute
October 19, 2021
Improvements
Updated H2O library to 3.32.0.2
Added a dropdown next to the Run button to simply create or view scheduled jobs
Moved data filters to the filter bar on the usage page
Added test connection for Snowpark data source
Bug Fixes
Fixed an issue in Pathfinder when importing a notebook to an existing or new org
Fixed an issue where the first Plotly chart was not rendering in a notebook
Fixed an issue when getting an error ‘ModuleNotFoundError: No module named ‘plotly’ when using PySpark with Spark Clusters
Fixed an issue with Snowflake SSO datasource with Spark Clusters
Fixed an issue where daily scheduled jobs may not run
October 6, 2021
Improvements
Updated General Purpose - Fall 2021 image to include new versions for hdbcli (2.9.28), Plotly (5.1.0), Snowpark (0.8.0), and DataRobot (2.25.1)
Updated login pages with new logos and naming
Bug Fixes
Fixed an issue in Pathfinder to remove the link on hover for a notebook name in a published notebook
Fixed an issue in Pathfinder when scrolling on a mobile device
Fixed an issue with performance when using hundreds of paragraphs in a notebook
Fixed an issue where Test Connection was not working with MaxCompute data source
Fixed an issue where the Login Chooser was empty after a deployment
September 22, 2021
New Features
Zepl Notebooks have been integrated into DataRobot Pathfinder as Notebook Accelerators (https:/​pathfinder.datarobot.com)
Improvements
Optimized Spark Cluster configurations based on machine type and size
Bug Fixes
Fixed an issue with Spark Cluster billing to be more precise
Fixed an issue when cloning a notebook with Spark Clusters
Fixed an issue with test connections not working with MaxCompute data source
Fixed an issue with Snowflake SSO if the username and password specified are different from the one used to authenticate with SSO
Fixed an issue where published paragraphs using z.show tables and graphs don’t use the full width
September 17, 2021
Improvements
Added various security enhancements
Optimizations for executors and worker nodes when using Spark Clusters
Bug Fixes
Fixed an issue where 128GB containers would show not available
September 7, 2021
Improvements
Added a notification that a notebook is published (static) vs interactive
Bug Fixes
Fixed an issue where the General Purpose Cluster image was mistakenly assigned by default
Fixed an issue where publishing a paragraph redirects to the frontend and shows an error
Fixed an issue where publishing a paragraph in an iFrame was blocked by a security restriction
Fixed various issues around Spark Cluster stability
Fixed an issue where Shell commands were not working with Spark Clusters
Fixed an issue where the IPython interpreter failed to start with Spark Clusters
Fixed an issue where running a container shows stopped state then executes
Fixed an issue where R code in an Image caused a build error
Fixed an issue with permissions for deleting notebooks and spaces
August 24, 2021
New Features
Importing Private Library JAR files for Spark, Python, and R 
Improvements
Added more statuses for Spark Clusters
Changed the Favicon to the DataRobot icon
Bug Fixes
Fixed an issue where where the Spark UI had an HTTP 400 error
Fixed an issue with the create notebook modal for Spark Clusters
Fixed an issue with large paragraph outputs that could crash a notebook
Fixed an issue with link this paragraph returning a 404 error
Fixed an issue where a notebook may crash if a paragraph is running and a user selects the run button again
Fixed an issue with Images when creating a BigQuery data source
Fixed an issue when toggling on a Spark Cluster which had a slight delay in the status
Fixed an issue where disabled paragraphs run the first time a notebook is run
Fixed various issues around Spark Cluster state management
August 11, 2021
New Features
Edge Execution Engine enables the control plane and data plane (compute) to be located in different regions (Limited Preview)
Improvements
New Image (General Purpose - Summer 2021) includes IRkernel for R, Snowflake Snowpark 0.7.0, and Zeppelin 0.9 support (Limited Preview)
Bug Fixes
Fixed an issue where container history is not showing any runs
Fixed an issue where a BigQuery data source times out after ~60 min
Fixed an issue where the progress bar for a paragraph was not running
Fixed an issue where the run button in a paragraph may be enabled while a paragraph is executing
Fixed an issue where a Spark Template was not providing any additional information in the Notebook Settings
Fixed an issue where the paragraph status was skipping pending and running which did not provide users the ability to stop a paragraph while executing 
Fixed an issue when cloning an image “*library* is already installed to the image - please remove from the list above [HTTP 500]”
Fixed an issue with syntax highlighting not working properly
Fixed an issue when using native Plotly where the modebar may not render properly
Fixed an issue where a Spark Cluster could be created without a template assigned
Fixed an issue where the LaTeX equation editor was not formatting consistently
Fixed an issue where Snowflake Datasource Consumption not tracked properly so logging was added
July 27, 2021
Improvements
Updated button to start and stop a container or cluster
Bug Fixes
Fixed an issue where deleting a notebook did not delete the association with an Image
Fixed an issue where deleting a notebook did not delete any scheduled jobs
Fixed an issue where horizontal scroll bars were appearing all the time and now they only show when needed
July 13, 2021
Improvements
Added data range filter, triggered by and total cost fields to container and cluster monitoring
Updated button to start and stop a container or cluster
Bug Fixes
Fixed an issue where Plotly charts were not rendering through code
Fixed an issue where an abort message was displaying after stopping a container
Fixed an issue where the output of a notebook would clear after the notebook was closed
Fixed an issue which started two Spark clusters when clicking the run paragraph button while a Spark cluster is already starting
June 29, 2021
New Features
Spark Cluster Monitoring (Running & History)
Improvements
Auto-provision SSO users on successful sign-in
Changed invite screen to a modal
Bug Fixes
Fixed an issue where the default interpreter is not applied properly to new paragraphs
Fixed an issue printing data frames with many columns where the output could exceed the width of the paragraph
Fixed an issue when clicking on an ellipsis menu incorrectly shows an oval
Fixed an issue where a Spark Cluster appeared to run even though the user did not have permission
June 23, 2021
New Features
Start / stop a container or Spark Cluster for a notebook without running the notebook or paragraph(s)
Improvements
Open Spark UI in new browser tab
Enhanced sample notebook service
Publish paragraph permissions
Bug Fixes
Fixed an issue where Spark UI links were broken
June  2, 2021
Improvements
Enhanced sample notebook service
Bug Fixes
Fixed an issue where the interpreter output was not saved when using Zeppelin 0.9 image
Fixed an issue where the schedule modal doesn’t schedule from the Spaces page
Fixed an issue where the data source details page doesn’t show shared vs private detail
May 18, 2021
Improvements
New execution engine (GA) is the default going forward for any organizations that are created
Show Pendo guide for invited users
Bug Fixes
Fixed an issue for 'Test All Connections' in a notebook
Fixed an issue for Clone notebook not working from Spaces page
April 15, 2021
New Features
Publish paragraphs for anyone to access
Improvements
New execution engine for containers (Preview)
Idle timeout for containers moved to Notebook Settings
Removed New Container button on Resources > Containers page
Aligned Clone Notebook modal with Create Notebook modal
Bug Fixes
Fixed an issue when permissions for Spark Clusters were visible when Spark Clusters is not enabled
Fixed an issue to disable the Run button in a notebook if a user is not authorized
Fixed an issue to remove the Cluster radio button in Create Notebook modal when Spark Clusters is not enabled
February 10, 2021
New Features
Spark Clusters (Preview)
Improvements
New UI for Monitoring Containers (Running & History)
February 9, 2021
Improvements
Updated pricing ($100 worth of free Zepl credits, Scalable compute from 4GB to 128GB)
Miscellaneous improvements with Authentication Providers modal, Invite new member performance, Scheduled jobs modal
Bug Fixes
Fixed API links 
Fixed Org Switcher state issues
February 2, 2021
Bug Fixes
Fixed error "exceeded number of concurrent notebooks allowed for this resource" [404] 
Fixed Authentication Provider links to documentation
January 15, 2021
New Features
Firewall with Inclusion List and Exclusion List
Improvements
Added Conda support in Images
Bug Fixes
Fixed java.lang.OutofMemoryError: Java heap space with SparkR
Fixed inviting an existing user
January 8, 2021
Bug Fixes
Data Source credentials can not be updated by a user who did not create the data source
December 17, 2020
New Features
Batch querying for Google BigQuery
Block countries from accessing your organization
Improvements
Renamed 'Resources' to 'Containers' 
Renamed 'Custom Images' to 'Images'
December 8, 2020
New Features
Access tokens available for API's in My Profile page
Improvements
Data source redesign
Bug Fixes
Fixed logout
Fixed adding members to teams
December 1, 2020
New Features
Secret Store for private storage of credentials, for example environment variables (passwords, secrets, and tokens) that are data source independent and can be accessed by any data source API
​SAP Data Warehouse Cloud data source
Improvements
SAP HDBCLI driver update to 2.6.61​
TA-Lib library for python added to General Purpose image
Pendo guide for invited users
Removed list of running containers from home page 
Bug Fixes
Fixed deleted notebooks in the job scheduler
November 20, 2020
Improvements
Added list of attached Notebooks to a custom image
Bug Fixes
Fixed Organization Owner can't create Teams or Resources
Fixed shared data sources should allow editing for the owner of the data source
Fixed switching orgs breaks publish
Fixed cannot click on "Upgrade Today"
Fixed data source private fields disappear on update
Fixed "Add" button greyed out in data source add screen
Fixed some CSS styling
Fixed list sort order in scheduled jobs list page
Removed TZ label in scheduled jobs list page
November 19, 2020
New Features
Swagger (OpenAPI) YAML for consumption 
Scheduled Jobs (GA)
Improvements
UX improvements to user management screens, including:
Profile page 
Password editing page 
Security policy assignment page
Invite user page
Bug Fixes
Fixed notebooks do not get sorted by Last Update correctly
Fixed 'Rename this Notebook' dialog box which was using the old pop up design
Fixed starting a container with Snowflake data source attached 
November 16, 2020
Bug Fixes
Fixed polling only changes
Fixed Socket.IO to resolve 502 and other errors
Fixed billing page not loading 
Fixed login loop (for good this time :))
November 13, 2020
Bug Fixes
Infinite loop when logging in
Login only works in incognito mode
Must clear cookies to login
Notebook sharing logs user out
Organizations not being populated into local storage
October 29, 2020
New Features
User filters available on Usage page
​Scheduled Jobs (Preview)
Authorizations for Organization level Permissions & Policies
Improvements
Removed JWT session cookie
Monitor > Usage page styling improved
Unified My Profile page with new design 
Removed ability to delete interpreters
Bug Fixes
Usage (User filter) retained when navigating away 
Usage report csv returns incomplete data  
Avatar path doesn’t work on component  
Editing scheduler repeat pattern did not save 
Usage report frontend doesn't reload when changing filters
Fixed UX of ‘New Invite Member’
Invited member doesn’t receive notebooks
Share notebook search fails when trying to add second person in the same modal 
Avatar path doesn’t work on component 
Editing scheduler repeat pattern did not save 
Hide the “Remove users from the organization” permission
Fixed ‘Test Connection’ for SAP HANA Cloud data source
October 16, 2020
New Features
Private (aka Service Accounts) data source 
Redshift data source
Option to restrict download file types (.tsv, .csv, .svg, .png)
Improvements
Updated General Purpose Image
Updated Guides persona carousel 
Bug Fixes
Fixed import notebook modal
September 22, 2020
New Features
Job Scheduler (Preview)
Improvements
Hover snippet for S3 with Spark and R  
Added Time Zone to My Account page 
New design for the notebook sidebar
New UI for authentication providers (Preview)
Bug Fixes
Trial countdown not working properly
Notebook shows ‘invalid date’ in paragraph 
Area chart resets to stacked when user reloads the notebook
Search indexing for inviting new users 
Onboarding creating sample resource error 
New line characters breaking table visualization 
Deleting a user from an org and then re-inviting them does not work