What's New
Check out the exciting new features and improvements we've been working on!
- Added Spark driver log that is available even after the cluster has been terminated
- Removed the notebook key from the file upload box
- Fixed an issue where the monitor history page could take a long time to load
- Fixed an issue where a MaxCompute data source was not accessible when using a Spark cluster
- Fixed an issue where websocket connections could fail
- Fixed an issue where dynamic form fields may revert back to previous values when refreshing
- Fixed an issue when opening the Clone dialog box
- Fixed an issue where importing a notebook flow needs to prompt the user to login if no orgs have been stored as previously signed in
- Fixed an issue on the registration flow to redirect to a new window when using an iFrame
- Fixed an issue to persist and restore form params in LocalStorage
- Fixed an issue to update Spark & Hadoop version in create new image dropdown
- Users that are deleted will now show a “Deleted” flag by their name, and the user profile will still be visible
- Fixed an issue when no default image is found
- Fixed an issue when a notebook may not start due to incorrectly selecting the image to use
- Fixed an issue where scheduled jobs may not run daily as planned
- Fixed an issue when deleting a user an error might occur
- Added Qubole data source
- Fixed an issue when uploading a file with the same name that the previous file would still be used
- Fixed an issue where the Monitor page could load slowly if there is a lot of history
- Fixed an issue where % datasource (SQL) does not work with Spark clusters
- Added the ability for an org admin to deactivate a user from the members page
- Fixed an issue when running Spark Clusters and getting error ‘Internal error: EOF’
- Fixed an issue when cloning a notebook to now also include the attached data source
- Fixed an issue when refreshing the browser while a paragraph is running shows finished or abort
- Fixed an issue when running a Spark Cluster which may crash when a physical memory limit is reached
- Fixed an issue where frontend messages may be displayed out of order
- Fixed an issue where a running notebook is not shutdown on notebook delete
- Fixed an issue when selecting stop/cancel on a running paragraph could render the notebook to hang until it is restarted
- Added websocket messaging for the Spark UI so the button will only appear when the cluster is ready and will be removed when terminated
- Fixed an issue when reordering paragraphs was not saved correctly
- Fixed an issue where a notebook could run without any remaining credits
- Fixed an issue where the delete button for notebooks and spaces was visible even though the user did not have permission
- Fixed an issue with permissions for deleting notebooks and spaces
- Fixed an issue with org switcher where an error may occur when switching orgs
- Fixed an issue with importing a notebook (Fetch from URL) in a published notebook for error 'Unable to convert this notebook to a Zepl notebook’
- General Purpose - Fall 2021 image is generally available and includes hdbcli 2.9.28, Plotly 5.1.0, Snowpark 0.8.0, and DataRobot 2.25.1
- Added timestamps to the API for uptime and startup time for containers and clusters
- Published cluster events via WebSockets are displayed to the user
- Fixed an issue where the notebook status was incorrect when a cluster was starting
- Fixed an issue where multiple results that were returned quickly may have missed showing all output to the frontend
- Fixed an issue where the previous results were still showing in the frontend even though new results were available
- Fixed an issue when reading large datasets using R and MaxCompute
- Updated H2O library to 3.32.0.2
- Added a dropdown next to the Run button to simply create or view scheduled jobs
- Moved data filters to the filter bar on the usage page
- Added test connection for Snowpark data source
- Fixed an issue in Pathfinder when importing a notebook to an existing or new org
- Fixed an issue where the first Plotly chart was not rendering in a notebook
- Fixed an issue when getting an error ‘ModuleNotFoundError: No module named ‘plotly’ when using PySpark with Spark Clusters
- Fixed an issue with Snowflake SSO datasource with Spark Clusters
- Fixed an issue where daily scheduled jobs may not run
- Updated General Purpose - Fall 2021 image to include new versions for hdbcli (2.9.28), Plotly (5.1.0), Snowpark (0.8.0), and DataRobot (2.25.1)
- Updated login pages with new logos and naming
- Fixed an issue in Pathfinder to remove the link on hover for a notebook name in a published notebook
- Fixed an issue in Pathfinder when scrolling on a mobile device
- Fixed an issue with performance when using hundreds of paragraphs in a notebook
- Fixed an issue where Test Connection was not working with MaxCompute data source
- Fixed an issue where the Login Chooser was empty after a deployment
- Zepl Notebooks have been integrated into DataRobot Pathfinder as Notebook Accelerators (https:/pathfinder.datarobot.com)
- Optimized Spark Cluster configurations based on machine type and size
- Fixed an issue with Spark Cluster billing to be more precise
- Fixed an issue when cloning a notebook with Spark Clusters
- Fixed an issue with test connections not working with MaxCompute data source
- Fixed an issue with Snowflake SSO if the username and password specified are different from the one used to authenticate with SSO
- Fixed an issue where published paragraphs using z.show tables and graphs don’t use the full width
- Added various security enhancements
- Optimizations for executors and worker nodes when using Spark Clusters
- Fixed an issue where 128GB containers would show not available
- Added a notification that a notebook is published (static) vs interactive
- Fixed an issue where the General Purpose Cluster image was mistakenly assigned by default
- Fixed an issue where publishing a paragraph redirects to the frontend and shows an error
- Fixed an issue where publishing a paragraph in an iFrame was blocked by a security restriction
- Fixed various issues around Spark Cluster stability
- Fixed an issue where Shell commands were not working with Spark Clusters
- Fixed an issue where the IPython interpreter failed to start with Spark Clusters
- Fixed an issue where running a container shows stopped state then executes
- Fixed an issue where R code in an Image caused a build error
- Fixed an issue with permissions for deleting notebooks and spaces
- Importing Private Library JAR files for Spark, Python, and R
- Added more statuses for Spark Clusters
- Changed the Favicon to the DataRobot icon
- Fixed an issue where where the Spark UI had an HTTP 400 error
- Fixed an issue with the create notebook modal for Spark Clusters
- Fixed an issue with large paragraph outputs that could crash a notebook
- Fixed an issue with link this paragraph returning a 404 error
- Fixed an issue where a notebook may crash if a paragraph is running and a user selects the run button again
- Fixed an issue with Images when creating a BigQuery data source
- Fixed an issue when toggling on a Spark Cluster which had a slight delay in the status
- Fixed an issue where disabled paragraphs run the first time a notebook is run
- Fixed various issues around Spark Cluster state management
- Edge Execution Engine enables the control plane and data plane (compute) to be located in different regions (Limited Preview)
- New Image (General Purpose - Summer 2021) includes IRkernel for R, Snowflake Snowpark 0.7.0, and Zeppelin 0.9 support (Limited Preview)
- Fixed an issue where container history is not showing any runs
- Fixed an issue where a BigQuery data source times out after ~60 min
- Fixed an issue where the progress bar for a paragraph was not running
- Fixed an issue where the run button in a paragraph may be enabled while a paragraph is executing
- Fixed an issue where a Spark Template was not providing any additional information in the Notebook Settings
- Fixed an issue where the paragraph status was skipping pending and running which did not provide users the ability to stop a paragraph while executing
- Fixed an issue when cloning an image “*library* is already installed to the image - please remove from the list above [HTTP 500]”
- Fixed an issue with syntax highlighting not working properly
- Fixed an issue when using native Plotly where the modebar may not render properly
- Fixed an issue where a Spark Cluster could be created without a template assigned
- Fixed an issue where the LaTeX equation editor was not formatting consistently
- Fixed an issue where Snowflake Datasource Consumption not tracked properly so logging was added
- Updated button to start and stop a container or cluster
- Fixed an issue where deleting a notebook did not delete the association with an Image
- Fixed an issue where deleting a notebook did not delete any scheduled jobs
- Fixed an issue where horizontal scroll bars were appearing all the time and now they only show when needed
- Added data range filter, triggered by and total cost fields to container and cluster monitoring
- Updated button to start and stop a container or cluster
- Fixed an issue where Plotly charts were not rendering through code
- Fixed an issue where an abort message was displaying after stopping a container
- Fixed an issue where the output of a notebook would clear after the notebook was closed
- Fixed an issue which started two Spark clusters when clicking the run paragraph button while a Spark cluster is already starting
- Spark Cluster Monitoring (Running & History)
- Auto-provision SSO users on successful sign-in
- Changed invite screen to a modal
- Fixed an issue where the default interpreter is not applied properly to new paragraphs
- Fixed an issue printing data frames with many columns where the output could exceed the width of the paragraph
- Fixed an issue when clicking on an ellipsis menu incorrectly shows an oval
- Fixed an issue where a Spark Cluster appeared to run even though the user did not have permission
- Start / stop a container or Spark Cluster for a notebook without running the notebook or paragraph(s)
- Open Spark UI in new browser tab
- Enhanced sample notebook service
- Publish paragraph permissions
- Fixed an issue where Spark UI links were broken
- Enhanced sample notebook service
- Fixed an issue where the interpreter output was not saved when using Zeppelin 0.9 image
- Fixed an issue where the schedule modal doesn’t schedule from the Spaces page
- Fixed an issue where the data source details page doesn’t show shared vs private detail
- New execution engine (GA) is the default going forward for any organizations that are created
- Show Pendo guide for invited users
- Fixed an issue for 'Test All Connections' in a notebook
- Fixed an issue for Clone notebook not working from Spaces page
- Publish paragraphs for anyone to access
- New execution engine for containers (Preview)
- Idle timeout for containers moved to Notebook Settings
- Removed New Container button on Resources > Containers page
- Aligned Clone Notebook modal with Create Notebook modal
- Fixed an issue when permissions for Spark Clusters were visible when Spark Clusters is not enabled
- Fixed an issue to disable the Run button in a notebook if a user is not authorized
- Fixed an issue to remove the Cluster radio button in Create Notebook modal when Spark Clusters is not enabled
- Spark Clusters (Preview)
- New UI for Monitoring Containers (Running & History)
- Updated pricing ($100 worth of free Zepl credits, Scalable compute from 4GB to 128GB)
- Miscellaneous improvements with Authentication Providers modal, Invite new member performance, Scheduled jobs modal
- Fixed API links
- Fixed Org Switcher state issues
- Fixed error "exceeded number of concurrent notebooks allowed for this resource" [404]
- Fixed Authentication Provider links to documentation
- Firewall with Inclusion List and Exclusion List
- Added Conda support in Images
- Fixed java.lang.OutofMemoryError: Java heap space with SparkR
- Fixed inviting an existing user
- Data Source credentials can not be updated by a user who did not create the data source
- Batch querying for Google BigQuery
- Block countries from accessing your organization
- Renamed 'Resources' to 'Containers'
- Renamed 'Custom Images' to 'Images'
- Access tokens available for API's in My Profile page
- Data source redesign
- Fixed logout
- Fixed adding members to teams
- Secret Store for private storage of credentials, for example environment variables (passwords, secrets, and tokens) that are data source independent and can be accessed by any data source API
- TA-Lib library for python added to General Purpose image
- Pendo guide for invited users
- Removed list of running containers from home page
- Fixed deleted notebooks in the job scheduler
- Added list of attached Notebooks to a custom image
- Fixed Organization Owner can't create Teams or Resources
- Fixed shared data sources should allow editing for the owner of the data source
- Fixed switching orgs breaks publish
- Fixed cannot click on "Upgrade Today"
- Fixed data source private fields disappear on update
- Fixed "Add" button greyed out in data source add screen
- Fixed some CSS styling
- Fixed list sort order in scheduled jobs list page
- Removed TZ label in scheduled jobs list page
- Swagger (OpenAPI) YAML for consumption
- Scheduled Jobs (GA)
- UX improvements to user management screens, including:
- Profile page
- Password editing page
- Security policy assignment page
- Invite user page
- Fixed notebooks do not get sorted by Last Update correctly
- Fixed 'Rename this Notebook' dialog box which was using the old pop up design
- Fixed starting a container with Snowflake data source attached
- Fixed polling only changes
- Fixed Socket.IO to resolve 502 and other errors
- Fixed billing page not loading
- Fixed login loop (for good this time :))
- Infinite loop when logging in
- Login only works in incognito mode
- Must clear cookies to login
- Notebook sharing logs user out
- Organizations not being populated into local storage
- User filters available on Usage page
- Authorizations for Organization level Permissions & Policies
- Removed JWT session cookie
- Monitor > Usage page styling improved
- Unified My Profile page with new design
- Removed ability to delete interpreters
- Usage (User filter) retained when navigating away
- Usage report csv returns incomplete data
- Avatar path doesn’t work on component
- Editing scheduler repeat pattern did not save
- Usage report frontend doesn't reload when changing filters
- Fixed UX of ‘New Invite Member’
- Invited member doesn’t receive notebooks
- Share notebook search fails when trying to add second person in the same modal
- Avatar path doesn’t work on component
- Editing scheduler repeat pattern did not save
- Hide the “Remove users from the organization” permission
- Fixed ‘Test Connection’ for SAP HANA Cloud data source
- Private (aka Service Accounts) data source
- Redshift data source
- Option to restrict download file types (.tsv, .csv, .svg, .png)
- Updated General Purpose Image
- Updated Guides persona carousel
- Fixed import notebook modal
- Job Scheduler (Preview)
- Hover snippet for S3 with Spark and R
- Added Time Zone to My Account page
- New design for the notebook sidebar
- New UI for authentication providers (Preview)
- Trial countdown not working properly
- Notebook shows ‘invalid date’ in paragraph
- Area chart resets to stacked when user reloads the notebook
- Search indexing for inviting new users
- Onboarding creating sample resource error
- New line characters breaking table visualization
- Deleting a user from an org and then re-inviting them does not work
Last modified 10mo ago