To tackle the most common data science challenges with Zepl out of the box, Zepl provides a General Purpose Image loaded with all the interpreters which we support and the most popular libraries for use in the notebook. This is set as the default image for all notebooks until replaced. If you find that any libraries are missing from this default image, you can install additional libraries to the container using established installer approaches for those respective interpreters.
The general purpose images also supports markdown and data source querying
The General Purpose Image includes Python version 3.7.6. The following libraries are installed:
%python!pip list --format columns------------------------------------------------ returns the following output----------------------------------------------Package Version----------------------------------------------absl-py 0.10.0asn1crypto 1.3.0astunparse 1.6.3attrs 20.2.0Automat 20.2.0azure-common 1.1.25azure-core 1.8.2azure-storage-blob 12.5.0backcall 0.2.0bcrypt 3.2.0bkzep 0.6.1bokeh 1.4.0boto3 1.10.9botocore 1.13.50cached-property 1.5.2cachetools 4.1.1cassandra-driver 3.22.0certifi 2020.6.20cffi 1.14.0chardet 3.0.4click 7.1.2conda 4.8.5conda-package-handling 1.6.0constantly 15.1.0cryptography 2.8cssselect 1.1.0cycler 0.10.0decorator 4.4.2distro 1.5.0docker 4.3.1docker-compose 1.27.4dockerpty 0.4.1docopt 0.6.2docutils 0.15.2fabric 2.5.0gast 0.3.3gensim 3.8.1geomet 0.1.2google-api-core 1.22.4google-auth 1.22.1google-auth-oauthlib 0.4.1google-cloud-bigquery 1.21.0google-cloud-core 1.4.2google-pasta 0.2.0google-resumable-media 0.4.1googleapis-common-protos 1.52.0grpcio 1.24.3h5py 2.10.0hdbcli 2.4.167hyperlink 20.0.1idna 2.7importlib-metadata 2.0.0incremental 17.5.0invoke 1.4.1ipykernel 5.1.3ipython 7.13.0ipython-genutils 0.2.0isodate 0.6.0jedi 0.17.2Jinja2 2.11.2jmespath 0.10.0joblib 0.17.0jsonschema 3.2.0jupyter-client 5.3.4jupyter-core 4.6.3Keras 2.3.1Keras-Applications 1.0.8Keras-Preprocessing 1.1.2kiwisolver 1.2.0lxml 4.5.2Markdown 3.2.2MarkupSafe 1.1.1matplotlib 3.1.1msrest 0.6.19mysql-connector-python 8.0.18nltk 3.4.5numpy 1.19.2oauthlib 3.1.0opt-einsum 3.3.0oscrypto 1.2.1packaging 20.4pandas 1.0.5pandasql 0.7.3paramiko 2.7.2parsel 1.6.0parso 0.7.1patsy 0.5.1pexpect 4.8.0pickleshare 0.7.5Pillow 6.2.1pip 20.0.2plotly 4.2.1prompt-toolkit 3.0.7Protego 0.1.16protobuf 3.10.0protobuf3-to-dict 0.1.5psycopg2-binary 2.8.4ptyprocess 0.6.0py4j 0.10.8.1pyarrow 0.17.1pyasn1 0.4.8pyasn1-modules 0.2.8pycosat 0.6.3pycparser 2.19pycryptodomex 3.9.8PyDispatcher 2.0.5pydot 1.4.1Pygments 2.7.1PyHamcrest 2.0.2PyJWT 1.7.1PyNaCl 1.4.0pyodps 0.8.4pyOpenSSL 19.1.0pyparsing 2.4.7pyrsistent 0.17.3PySocks 1.7.1python-dateutil 2.8.1python-dotenv 0.14.0pytz 2020.1PyYAML 5.3.1pyzmq 19.0.2queuelib 1.5.0requests 2.20.1requests-oauthlib 1.3.0retrying 1.3.3rsa 4.6ruamel-yaml 0.15.87s3transfer 0.2.1sagemaker 1.43.4.post1scikit-learn 0.23.2scipy 1.3.1Scrapy 1.8.0seaborn 0.9.0service-identity 18.1.0setuptools 45.2.0.post20200210six 1.14.0smart-open 2.2.1snowflake-connector-python 2.2.8SQLAlchemy 1.3.19statsmodels 0.12.0tensorboard 2.3.0tensorboard-plugin-wit 1.7.0tensorflow 2.3.0tensorflow-estimator 2.3.0termcolor 1.1.0texttable 1.6.3Theano 1.0.4threadpoolctl 2.1.0tornado 6.0.4tqdm 4.42.1traitlets 5.0.4Twisted 20.3.0urllib3 1.24.3w3lib 1.22.0wcwidth 0.2.5websocket-client 0.57.0Werkzeug 1.0.1wheel 0.34.2wrapt 1.12.1zipp 3.3.0zope.interface 5.1.2
You can learn more about interacting with the Python interpreter in that section of the documentation:
The General Purpose Image includes R version 3.6.3 running on top of Spark (SparkR). The following libraries are installed:
%rinstalled.packages()------------------------------------------------ returns the following output----------------------------------------------Library VersionSparkR “2.4.6”BH “1.72.0-3”BayesianFirstAid “0.1”DBI “1.1.0”DT “0.15”DatabaseConnector “3.0.0”DatabaseConnectorJars “1.1.0”KMsurv “0.1-5”MatrixModels “0.4-1”R6 “2.4.1”RJDBC “0.2-8”RSQLite “2.2.1”Rcpp “1.0.5”RcppArmadillo “0.9.900.3.0”RcppEigen “0.3.3.7.0”SparseM “1.78”SqlRender “1.6.8”XML “3.99-0.3”abind “1.4-5”askpass “1.1”assertthat “0.2.1”backports “1.1.10”base64enc “0.1-3”bestglm “0.37.3”bit “4.0.4”bit64 “4.0.5”blob “1.2.1”brew “1.0-6”broom “0.7.1”callr “3.4.4”car “3.0-10”carData “3.0-4”cellranger “1.1.0”checkmate “2.0.0”chron “2.3-56”cli “2.0.2”clipr “0.7.0”coda “0.19-4”colorspace “1.4-1”commonmark “1.7”conquer “1.0.2”corrplot “0.84”covr “3.5.1”cowplot “1.1.0”cpp11 “0.2.2”crayon “1.3.4”crosstalk “1.1.0.1”curl “4.3”data.table “1.13.0”dbplyr “1.4.4”desc “1.2.0”devtools “2.3.2”digest “0.6.25”doParallel “1.0.15”doRNG “1.8.2”dplyr “1.0.2”dplyr.snowflakedb “0.3.0”ellipsis “0.3.1”evaluate “0.14”exactRankTests “0.8-31”fansi “0.4.1”farver “2.0.3”fastmap “1.0.1”forcats “0.5.0”foreach “1.5.0”forestplot “1.10”fs “1.5.0”generics “0.0.2”ggplot2 “3.3.2”ggpubr “0.4.0”ggrepel “0.8.2”ggsci “2.9”ggsignif “0.6.0”gh “1.1.0”git2r “0.27.1”glmnet “4.0-2”glue “1.4.2”googleVis “0.6.6”gridExtra “2.3”grpreg “3.3.0”gsubfn “0.7”gtable “0.3.0”haven “2.3.1”highr “0.8”hms “0.5.3”htmltools “0.5.0”htmlwidgets “1.5.2”httpuv “1.5.4”httr “1.4.2”ini “0.3.1”isoband “0.2.2”iterators “1.0.12”jsonlite “1.7.1”km.ci “0.5-2”knitr “1.30”labeling “0.3”later “1.1.0.1”lazyeval “0.2.2”leaps “3.1”lifecycle “0.2.0”lme4 “1.1-23”lmtest “0.9-38”lubridate “1.7.9”magrittr “1.5”manipulateWidget “0.10.1”maptools “1.0-2”markdown “1.1”matrixStats “0.57.0”maxstat “0.7-25”memoise “1.1.0”mime “0.9”miniUI “0.1.1.1”minqa “1.2.4”mnormt “2.0.2”modelr “0.1.8”mplot “1.0.4”munsell “0.5.0”mvtnorm “1.1-1”nloptr “1.2.2.2”openssl “1.4.3”openxlsx “4.2.2”pbkrtest “0.4-8.6”pillar “1.4.6”pkgbuild “1.1.0”pkgconfig “2.0.3”pkgload “1.1.0”plogr “0.2.0”pls “2.7-3”plyr “1.8.6”polynom “1.4-0”praise “1.0.0”prettyunits “1.1.1”processx “3.4.4”progress “1.2.2”promises “1.1.1”proto “1.0.0”ps “1.3.4”purrr “0.3.4”quantreg “5.73”r2d3 “0.2.3”rJava “0.9-13”rcmdcheck “1.3.3”readr “1.4.0”readxl “1.3.1”rematch “1.0.1”rematch2 “2.1.2”remotes “2.2.0”reprex “0.3.0”reshape “0.8.8”reshape2 “1.4.4”rex “1.2.0”rgl “0.100.54”rio “0.5.16”rjags “4-10”rlang “0.4.7”rmarkdown “2.4”rngtools “1.5”roxygen2 “7.1.1”rprojroot “1.3-2”rstatix “0.6.0”rstudioapi “0.11”rversions “2.0.2”rvest “0.3.6”scales “1.1.1”selectr “0.4-2”sessioninfo “1.1.1”shape “1.4.5”shiny “1.5.0”shinydashboard “0.7.1”sourcetools “0.1.7”sp “1.4-2”sqldf “0.4-11”statmod “1.4.34”stringi “1.5.3”stringr “1.4.0”survMisc “0.5.5”survminer “0.4.8”sys “3.4”testthat “2.3.2”tibble “3.0.3”tidyr “1.1.2”tidyselect “1.1.0”tidyverse “1.3.0”tinytex “0.26”tmvnsim “1.0-2”triebeard “0.3.0”urltools “1.7.3”usethis “1.6.3”utf8 “1.1.4”vcd “1.4-8”vctrs “0.3.4”viridis “0.5.1”viridisLite “0.3.0”webshot “0.5.2”whisker “0.4”withr “2.3.0”xfun “0.18”xml2 “1.3.2”xopen “1.0.0”xtable “1.8-4”xts “0.12.1”yaml “2.2.1”zip “2.1.1”zoo “1.8-8”MatchIt “3.0.2”Matching “4.9-3”RColorBrewer “1.1-2”littler “0.3.9”rjson “0.2.20”KernSmooth “2.23-16”MASS “7.3-51.5”Matrix “1.2-18”base “3.6.3”boot “1.3-24”class “7.3-15”cluster “2.1.0”codetools “0.2-16”compiler “3.6.3”datasets “3.6.3”foreign “0.8-75”grDevices “3.6.3”graphics “3.6.3”grid “3.6.3”lattice “0.20-40”methods “3.6.3”mgcv “1.8-31”nlme “3.1-144”nnet “7.3-12”parallel “3.6.3”rpart “4.1-15”spatial “7.3-11”splines “3.6.3”stats “3.6.3”stats4 “3.6.3”survival “3.1-8”tcltk “3.6.3”tools “3.6.3”utils “3.6.3”
You can learn more about interacting with the R interpreter in that section of the documentation:
The General Purpose Image includes a single node Spark 2.4.6 instance. The following libraries are installed
activation-1.1.jaraether-api-1.12.jaraether-connector-file-1.12.jaraether-connector-wagon-1.12.jaraether-impl-1.12.jaraether-spi-1.12.jaraether-util-1.12.jarapacheds-i18n-2.0.0-M15.jarapacheds-kerberos-codec-2.0.0-M15.jarapi-asn1-api-1.0.0-M20.jarapi-util-1.0.0-M20.jarasm-5.0.3.jarasm-analysis-5.0.3.jarasm-tree-5.0.3.jarasm-util-5.0.3.jaravro-1.7.4.jaraws-java-sdk-core-1.10.6.jaraws-java-sdk-kms-1.10.6.jaraws-java-sdk-s3-1.10.6.jarbcpkix-jdk15on-1.52.jarbcprov-jdk15on-1.52.jarcglib-2.2.1-v20090111.jarcommons-beanutils-1.7.0.jarcommons-beanutils-core-1.8.0.jarcommons-cli-1.2.jarcommons-codec-1.6.jarcommons-codec-1.9.jarcommons-collections-3.2.2.jarcommons-compress-1.4.1.jarcommons-configuration-1.6.jarcommons-configuration-1.9.jarcommons-dbcp2-2.0.1.jarcommons-digester-1.8.jarcommons-exec-1.3.jarcommons-httpclient-3.1.jarcommons-io-2.4.jarcommons-io-2.6.jarcommons-lang-2.6.jarcommons-lang3-3.7.jarcommons-logging-1.1.3.jarcommons-logging-1.2.jarcommons-math3-3.1.1.jarcommons-net-3.1.jarcommons-pool2-2.3.jarcurator-client-2.7.1.jarcurator-framework-2.7.1.jarcurator-recipes-2.7.1.jargson-2.2.4.jargson-2.8.6.jargson-extras-0.2.1.jarguava-16.0.1.jarhadoop-annotations-2.8.3.jarhadoop-auth-2.8.3.jarhadoop-aws-2.8.3.jarhadoop-common-2.8.3.jarhtrace-core4-4.0.1-incubating.jarhttpclient-4.2.5.jarhttpclient-4.5.2.jarhttpcore-4.2.4.jarhttpcore-4.4.4.jarjackson-annotations-2.6.0.jarjackson-core-2.6.5.jarjackson-core-asl-1.9.13.jarjackson-databind-2.6.5.jarjackson-jaxrs-1.8.3.jarjackson-mapper-asl-1.9.13.jarjackson-xc-1.8.3.jarjava-xmlbuilder-0.4.jarjaxb-api-2.2.2.jarjaxb-impl-2.2.3-1.jarjcip-annotations-1.0.jarjdom2-2.0.6.jarjersey-core-1.9.jarjersey-json-1.9.jarjersey-server-1.9.jarjets3t-0.9.0.jarjettison-1.1.jarjetty-6.1.26.jarjetty-sslengine-6.1.26.jarjetty-util-6.1.26.jarjline-0.9.94.jarjline-2.14.3.jarjoda-time-2.9.4.jarjsch-0.1.54.jarjson-smart-1.1.1.jarjsoup-1.8.2.jarjsp-api-2.1.jarjsr305-3.0.0.jarlibthrift-0.9.2.jarlog4j-1.2.17.jarmarkdown4j-2.2-cj-1.0.jarmaven-aether-provider-3.0.3.jarmaven-artifact-3.0.jarmaven-model-3.0.3.jarmaven-model-builder-3.0.3.jarmaven-plugin-api-3.0.jarmaven-repository-metadata-3.0.3.jarnimbus-jose-jwt-3.9.jarparanamer-2.3.jarparboiled-core-1.1.7.jarparboiled-java-1.1.7.jarpegdown-1.6.0.jarplexus-classworlds-2.4.jarplexus-component-annotations-1.5.5.jarplexus-interpolation-1.14.jarplexus-utils-2.0.7.jarpostgresql-9.4-1201-jdbc41.jarprotobuf-java-2.5.0.jarsisu-guice-3.0.2-no_aop.jarsisu-inject-bean-2.2.2.jarsisu-inject-plexus-2.2.2.jarslf4j-api-1.7.10.jarslf4j-log4j12-1.7.10.jarsnappy-java-1.0.4.1.jarsnappy-java-1.1.4.jarsnowflake-jdbc.jarspark-interpreter-0.8.14.5-zepl-SNAPSHOT.jarstax-api-1.0-2.jarwagon-http-1.0.jarwagon-http-lightweight-1.0.jarwagon-http-shared-1.0.jarwagon-provider-api-1.0.jarxmlenc-0.52.jarxz-1.0.jarzeppelin-display-0.8.14.5-zepl-SNAPSHOT.jarzeppelin-interpreter-0.8.14.5-zepl-SNAPSHOT.jarzeppelin-jdbc-0.8.14.5-zepl-SNAPSHOT.jarzeppelin-markdown-0.8.14.5-zepl-SNAPSHOT.jarzeppelin-python-0.8.14.5-zepl-SNAPSHOT.jarzookeeper-3.4.6.jar
You can learn more about interacting with the Spark interpreter in that section of the documentation: