What's New
Zepl Notebooks have been integrated into DataRobot Pathfinder as Notebook Accelerators (https:/âpathfinder.datarobot.com)
Optimized Spark Cluster configurations based on machine type and size
Fixed an issue with Spark Cluster billing to be more precise
Fixed an issue when cloning a notebook with Spark Clusters
Fixed an issue with test connections not working with MaxCompute data source
Fixed an issue with Snowflake SSO if the username and password specified are different from the one used to authenticate with SSO
Fixed an issue where published paragraphs using z.show tables and graphs donât use the full width
Added various security enhancements
Optimizations for executors and worker nodes when using Spark Clusters
Fixed an issue where 128GB containers would show not available
Added a notification that a notebook is published (static) vs interactive
Fixed an issue where the General Purpose Cluster image was mistakenly assigned by default
Fixed an issue where publishing a paragraph redirects to the frontend and shows an error
Fixed an issue where publishing a paragraph in an iFrame was blocked by a security restriction
Fixed various issues around Spark Cluster stability
Fixed an issue where Shell commands were not working with Spark Clusters
Fixed an issue where the IPython interpreter failed to start with Spark Clusters
Fixed an issue where running a container shows stopped state then executes
Fixed an issue where R code in an Image caused a build error
Fixed an issue with permissions for deleting notebooks and spaces
Importing Private Library JAR files for Spark, Python, and R
Added more statuses for Spark Clusters
Changed the Favicon to the DataRobot icon
Fixed an issue where where the Spark UI had an HTTP 400 error
Fixed an issue with the create notebook modal for Spark Clusters
Fixed an issue with large paragraph outputs that could crash a notebook
Fixed an issue with link this paragraph returning a 404 error
Fixed an issue where a notebook may crash if a paragraph is running and a user selects the run button again
Fixed an issue with Images when creating a BigQuery data source
Fixed an issue when toggling on a Spark Cluster which had a slight delay in the status
Fixed an issue where disabled paragraphs run the first time a notebook is run
Fixed various issues around Spark Cluster state management
Edge Execution Engine enables the control plane and data plane (compute) to be located in different regions (Limited Preview)
New Image (General Purpose - Summer 2021) includes IRkernel for R, Snowflake Snowpark 0.7.0, and Zeppelin 0.9 support (Limited Preview)
Fixed an issue where container history is not showing any runs
Fixed an issue where a BigQuery data source times out after ~60 min
Fixed an issue where the progress bar for a paragraph was not running
Fixed an issue where the run button in a paragraph may be enabled while a paragraph is executing
Fixed an issue where a Spark Template was not providing any additional information in the Notebook Settings
Fixed an issue where the paragraph status was skipping pending and running which did not provide users the ability to stop a paragraph while executing
Fixed an issue when cloning an image â*library* is already installed to the image - please remove from the list above [HTTP 500]â
Fixed an issue with syntax highlighting not working properly
Fixed an issue when using native Plotly where the modebar may not render properly
Fixed an issue where a Spark Cluster could be created without a template assigned
Fixed an issue where the LaTeX equation editor was not formatting consistently
Fixed an issue where Snowflake Datasource Consumption not tracked properly so logging was added
Updated button to start and stop a container or cluster
Fixed an issue where deleting a notebook did not delete the association with an Image
Fixed an issue where deleting a notebook did not delete any scheduled jobs
Fixed an issue where horizontal scroll bars were appearing all the time and now they only show when needed
Added data range filter, triggered by and total cost fields to container and cluster monitoring
Updated button to start and stop a container or cluster
Fixed an issue where Plotly charts were not rendering through code
Fixed an issue where an abort message was displaying after stopping a container
Fixed an issue where the output of a notebook would clear after the notebook was closed
Fixed an issue which started two Spark clusters when clicking the run paragraph button while a Spark cluster is already starting
Spark Cluster Monitoring (Running & History)
Auto-provision SSO users on successful sign-in
Changed invite screen to a modal
Fixed an issue where the default interpreter is not applied properly to new paragraphs
Fixed an issue printing data frames with many columns where the output could exceed the width of the paragraph
Fixed an issue when clicking on an ellipsis menu incorrectly shows an oval
Fixed an issue where a Spark Cluster appeared to run even though the user did not have permission
Start / stop a container or Spark Cluster for a notebook without running the notebook or paragraph(s)
Open Spark UI in new browser tab
Enhanced sample notebook service
Publish paragraph permissions
Fixed an issue where Spark UI links were broken
Enhanced sample notebook service
Fixed an issue where the interpreter output was not saved when using Zeppelin 0.9 image
Fixed an issue where the schedule modal doesnât schedule from the Spaces page
Fixed an issue where the data source details page doesnât show shared vs private detail
New execution engine (GA) is the default going forward for any organizations that are created
Show Pendo guide for invited users
Fixed an issue for 'Test All Connections' in a notebook
Fixed an issue for Clone notebook not working from Spaces page
Publish paragraphs for anyone to access
New execution engine for containers (Preview)
Idle timeout for containers moved to Notebook Settings
Removed New Container button on Resources > Containers page
Aligned Clone Notebook modal with Create Notebook modal
Fixed an issue when permissions for Spark Clusters were visible when Spark Clusters is not enabled
Fixed an issue to disable the Run button in a notebook if a user is not authorized
Fixed an issue to remove the Cluster radio button in Create Notebook modal when Spark Clusters is not enabled
Spark Clusters (Preview)
New UI for Monitoring Containers (Running & History)
Updated pricing ($100 worth of free Zepl credits, Scalable compute from 4GB to 128GB)
Miscellaneous improvements with Authentication Providers modal, Invite new member performance, Scheduled jobs modal
Fixed API links
Fixed Org Switcher state issues
Fixed error "exceeded number of concurrent notebooks allowed for this resource" [404]
Fixed Authentication Provider links to documentation
Firewall with Inclusion List and Exclusion List
Added Conda support in Images
Fixed java.lang.OutofMemoryError: Java heap space with SparkR
Fixed inviting an existing user
Data Source credentials can not be updated by a user who did not create the data source
Batch querying for Google BigQuery
Block countries from accessing your organization
Renamed 'Resources' to 'Containers'
Renamed 'Custom Images' to 'Images'
Access tokens available for API's in My Profile page
Data source redesign
Fixed logout
Fixed adding members to teams
Secret Store for private storage of credentials, for example environment variables (passwords, secrets, and tokens) that are data source independent and can be accessed by any data source API
âSAP Data Warehouse Cloud data source
SAP HDBCLI driver update to 2.6.61â
TA-Lib library for python added to General Purpose image
Pendo guide for invited users
Removed list of running containers from home page
Fixed deleted notebooks in the job scheduler
Added list of attached Notebooks to a custom image
Fixed Organization Owner can't create Teams or Resources
Fixed shared data sources should allow editing for the owner of the data source
Fixed switching orgs breaks publish
Fixed cannot click on "Upgrade Today"
Fixed data source private fields disappear on update
Fixed "Add" button greyed out in data source add screen
Fixed some CSS styling
Fixed list sort order in scheduled jobs list page
Removed TZ label in scheduled jobs list page
Swagger (OpenAPI) YAML for consumption
Scheduled Jobs (GA)
UX improvements to user management screens, including:
Profile page
Password editing page
Security policy assignment page
Invite user page
Fixed notebooks do not get sorted by Last Update correctly
Fixed 'Rename this Notebook' dialog box which was using the old pop up design
Fixed starting a container with Snowflake data source attached
Fixed polling only changes
Fixed Socket.IO to resolve 502 and other errors
Fixed billing page not loading
Fixed login loop (for good this time :))
Infinite loop when logging in
Login only works in incognito mode
Must clear cookies to login
Notebook sharing logs user out
Organizations not being populated into local storage
User filters available on Usage page
âScheduled Jobs (Preview)
Authorizations for Organization level Permissions & Policies
Removed JWT session cookie
Monitor > Usage page styling improved
Unified My Profile page with new design
Removed ability to delete interpreters
Usage (User filter) retained when navigating away
Usage report csv returns incomplete data
Avatar path doesnât work on component
Editing scheduler repeat pattern did not save
Usage report frontend doesn't reload when changing filters
Fixed UX of âNew Invite Memberâ
Invited member doesnât receive notebooks
Share notebook search fails when trying to add second person in the same modal
Avatar path doesnât work on component
Editing scheduler repeat pattern did not save
Hide the âRemove users from the organizationâ permission
Fixed âTest Connectionâ for SAP HANA Cloud data source
Private (aka Service Accounts) data source
Redshift data source
Option to restrict download file types (.tsv, .csv, .svg, .png)
Updated General Purpose Image
Updated Guides persona carousel
Fixed import notebook modal
Job Scheduler (Preview)
Hover snippet for S3 with Spark and R
Added Time Zone to My Account page
New design for the notebook sidebar
New UI for authentication providers (Preview)
Trial countdown not working properly
Notebook shows âinvalid dateâ in paragraph
Area chart resets to stacked when user reloads the notebook
Search indexing for inviting new users
Onboarding creating sample resource error
New line characters breaking table visualization
Deleting a user from an org and then re-inviting them does not work