General Purpose Image
To tackle the most common data science challenges with Zepl out of the box, Zepl provides a General Purpose Image loaded with all the interpreters which we support and the most popular libraries for use in the notebook. This is set as the default image for all notebooks until replaced. If you find that any libraries are missing from this default image, you can install additional libraries to the container using established installer approaches for those respective interpreters.
General Purpose Image attached to a notebook
The general purpose images also supports markdown and data source querying
The General Purpose Image includes Python version 3.7.6. The following libraries are installed:
%python
!pip list --format columns
----------------------------------------------
-- returns the following output
----------------------------------------------
Package Version
----------------------------------------------
absl-py 0.10.0
asn1crypto 1.3.0
astunparse 1.6.3
attrs 20.2.0
Automat 20.2.0
azure-common 1.1.25
azure-core 1.8.2
azure-storage-blob 12.5.0
backcall 0.2.0
bcrypt 3.2.0
bkzep 0.6.1
bokeh 1.4.0
boto3 1.10.9
botocore 1.13.50
cached-property 1.5.2
cachetools 4.1.1
cassandra-driver 3.22.0
certifi 2020.6.20
cffi 1.14.0
chardet 3.0.4
click 7.1.2
conda 4.8.5
conda-package-handling 1.6.0
constantly 15.1.0
cryptography 2.8
cssselect 1.1.0
cycler 0.10.0
decorator 4.4.2
distro 1.5.0
docker 4.3.1
docker-compose 1.27.4
dockerpty 0.4.1
docopt 0.6.2
docutils 0.15.2
fabric 2.5.0
gast 0.3.3
gensim 3.8.1
geomet 0.1.2
google-api-core 1.22.4
google-auth 1.22.1
google-auth-oauthlib 0.4.1
google-cloud-bigquery 1.21.0
google-cloud-core 1.4.2
google-pasta 0.2.0
google-resumable-media 0.4.1
googleapis-common-protos 1.52.0
grpcio 1.24.3
h5py 2.10.0
hdbcli 2.4.167
hyperlink 20.0.1
idna 2.7
importlib-metadata 2.0.0
incremental 17.5.0
invoke 1.4.1
ipykernel 5.1.3
ipython 7.13.0
ipython-genutils 0.2.0
isodate 0.6.0
jedi 0.17.2
Jinja2 2.11.2
jmespath 0.10.0
joblib 0.17.0
jsonschema 3.2.0
jupyter-client 5.3.4
jupyter-core 4.6.3
Keras 2.3.1
Keras-Applications 1.0.8
Keras-Preprocessing 1.1.2
kiwisolver 1.2.0
lxml 4.5.2
Markdown 3.2.2
MarkupSafe 1.1.1
matplotlib 3.1.1
msrest 0.6.19
mysql-connector-python 8.0.18
nltk 3.4.5
numpy 1.19.2
oauthlib 3.1.0
opt-einsum 3.3.0
oscrypto 1.2.1
packaging 20.4
pandas 1.0.5
pandasql 0.7.3
paramiko 2.7.2
parsel 1.6.0
parso 0.7.1
patsy 0.5.1
pexpect 4.8.0
pickleshare 0.7.5
Pillow 6.2.1
pip 20.0.2
plotly 4.2.1
prompt-toolkit 3.0.7
Protego 0.1.16
protobuf 3.10.0
protobuf3-to-dict 0.1.5
psycopg2-binary 2.8.4
ptyprocess 0.6.0
py4j 0.10.8.1
pyarrow 0.17.1
pyasn1 0.4.8
pyasn1-modules 0.2.8
pycosat 0.6.3
pycparser 2.19
pycryptodomex 3.9.8
PyDispatcher 2.0.5
pydot 1.4.1
Pygments 2.7.1
PyHamcrest 2.0.2
PyJWT 1.7.1
PyNaCl 1.4.0
pyodps 0.8.4
pyOpenSSL 19.1.0
pyparsing 2.4.7
pyrsistent 0.17.3
PySocks 1.7.1
python-dateutil 2.8.1
python-dotenv 0.14.0
pytz 2020.1
PyYAML 5.3.1
pyzmq 19.0.2
queuelib 1.5.0
requests 2.20.1
requests-oauthlib 1.3.0
retrying 1.3.3
rsa 4.6
ruamel-yaml 0.15.87
s3transfer 0.2.1
sagemaker 1.43.4.post1
scikit-learn 0.23.2
scipy 1.3.1
Scrapy 1.8.0
seaborn 0.9.0
service-identity 18.1.0
setuptools 45.2.0.post20200210
six 1.14.0
smart-open 2.2.1
snowflake-connector-python 2.2.8
SQLAlchemy 1.3.19
statsmodels 0.12.0
tensorboard 2.3.0
tensorboard-plugin-wit 1.7.0
tensorflow 2.3.0
tensorflow-estimator 2.3.0
termcolor 1.1.0
texttable 1.6.3
Theano 1.0.4
threadpoolctl 2.1.0
tornado 6.0.4
tqdm 4.42.1
traitlets 5.0.4
Twisted 20.3.0
urllib3 1.24.3
w3lib 1.22.0
wcwidth 0.2.5
websocket-client 0.57.0
Werkzeug 1.0.1
wheel 0.34.2
wrapt 1.12.1
zipp 3.3.0
zope.interface 5.1.2
You can learn more about interacting with the Python interpreter in that section of the documentation:
The General Purpose Image includes R version 3.6.3 running on top of Spark (SparkR). The following libraries are installed:
%r
installed.packages()
----------------------------------------------
-- returns the following output
----------------------------------------------
Library Version
SparkR “2.4.6”
BH “1.72.0-3”
BayesianFirstAid “0.1”
DBI “1.1.0”
DT “0.15”
DatabaseConnector “3.0.0”
DatabaseConnectorJars “1.1.0”
KMsurv “0.1-5”
MatrixModels “0.4-1”
R6 “2.4.1”
RJDBC “0.2-8”
RSQLite “2.2.1”
Rcpp “1.0.5”
RcppArmadillo “0.9.900.3.0”
RcppEigen “0.3.3.7.0”
SparseM “1.78”
SqlRender “1.6.8”
XML “3.99-0.3”
abind “1.4-5”
askpass “1.1”
assertthat “0.2.1”
backports “1.1.10”
base64enc “0.1-3”
bestglm “0.37.3”
bit “4.0.4”
bit64 “4.0.5”
blob “1.2.1”
brew “1.0-6”
broom “0.7.1”
callr “3.4.4”
car “3.0-10”
carData “3.0-4”
cellranger “1.1.0”
checkmate “2.0.0”
chron “2.3-56”
cli “2.0.2”
clipr “0.7.0”
coda “0.19-4”
colorspace “1.4-1”
commonmark “1.7”
conquer “1.0.2”
corrplot “0.84”
covr “3.5.1”
cowplot “1.1.0”
cpp11 “0.2.2”
crayon “1.3.4”
crosstalk “1.1.0.1”
curl “4.3”
data.table “1.13.0”
dbplyr “1.4.4”
desc “1.2.0”
devtools “2.3.2”
digest “0.6.25”
doParallel “1.0.15”
doRNG “1.8.2”
dplyr “1.0.2”
dplyr.snowflakedb “0.3.0”
ellipsis “0.3.1”
evaluate “0.14”
exactRankTests “0.8-31”
fansi “0.4.1”
farver “2.0.3”
fastmap “1.0.1”
forcats “0.5.0”
foreach “1.5.0”
forestplot “1.10”
fs “1.5.0”
generics “0.0.2”
ggplot2 “3.3.2”
ggpubr “0.4.0”
ggrepel “0.8.2”
ggsci “2.9”
ggsignif “0.6.0”
gh “1.1.0”
git2r “0.27.1”
glmnet “4.0-2”
glue “1.4.2”
googleVis “0.6.6”
gridExtra “2.3”
grpreg “3.3.0”
gsubfn “0.7”
gtable “0.3.0”
haven “2.3.1”
highr “0.8”
hms “0.5.3”
htmltools “0.5.0”
htmlwidgets “1.5.2”
httpuv “1.5.4”
httr “1.4.2”
ini “0.3.1”
isoband “0.2.2”
iterators “1.0.12”
jsonlite “1.7.1”
km.ci “0.5-2”
knitr “1.30”
labeling “0.3”
later “1.1.0.1”
lazyeval “0.2.2”
leaps “3.1”
lifecycle “0.2.0”
lme4 “1.1-23”
lmtest “0.9-38”
lubridate “1.7.9”
magrittr “1.5”
manipulateWidget “0.10.1”
maptools “1.0-2”
markdown “1.1”
matrixStats “0.57.0”
maxstat “0.7-25”
memoise “1.1.0”
mime “0.9”
miniUI “0.1.1.1”
minqa “1.2.4”
mnormt “2.0.2”
modelr “0.1.8”
mplot “1.0.4”
munsell “0.5.0”
mvtnorm “1.1-1”
nloptr “1.2.2.2”
openssl “1.4.3”
openxlsx “4.2.2”
pbkrtest “0.4-8.6”
pillar “1.4.6”
pkgbuild “1.1.0”
pkgconfig “2.0.3”
pkgload “1.1.0”
plogr “0.2.0”
pls “2.7-3”
plyr “1.8.6”
polynom “1.4-0”
praise “1.0.0”
prettyunits “1.1.1”
processx “3.4.4”
progress “1.2.2”
promises “1.1.1”
proto “1.0.0”
ps “1.3.4”
purrr “0.3.4”
quantreg “5.73”
r2d3 “0.2.3”
rJava “0.9-13”
rcmdcheck “1.3.3”
readr “1.4.0”
readxl “1.3.1”
rematch “1.0.1”
rematch2 “2.1.2”
remotes “2.2.0”
reprex “0.3.0”
reshape “0.8.8”
reshape2 “1.4.4”
rex “1.2.0”
rgl “0.100.54”
rio “0.5.16”
rjags “4-10”
rlang “0.4.7”
rmarkdown “2.4”
rngtools “1.5”
roxygen2 “7.1.1”
rprojroot “1.3-2”
rstatix “0.6.0”
rstudioapi “0.11”
rversions “2.0.2”
rvest “0.3.6”
scales “1.1.1”
selectr “0.4-2”
sessioninfo “1.1.1”
shape “1.4.5”
shiny “1.5.0”
shinydashboard “0.7.1”
sourcetools “0.1.7”
sp “1.4-2”
sqldf “0.4-11”
statmod “1.4.34”
stringi “1.5.3”
stringr “1.4.0”
survMisc “0.5.5”
survminer “0.4.8”
sys “3.4”
testthat “2.3.2”
tibble “3.0.3”
tidyr “1.1.2”
tidyselect “1.1.0”
tidyverse “1.3.0”
tinytex “0.26”
tmvnsim “1.0-2”
triebeard “0.3.0”
urltools “1.7.3”
usethis “1.6.3”
utf8 “1.1.4”
vcd “1.4-8”
vctrs “0.3.4”
viridis “0.5.1”
viridisLite “0.3.0”
webshot “0.5.2”
whisker “0.4”
withr “2.3.0”
xfun “0.18”
xml2 “1.3.2”
xopen “1.0.0”
xtable “1.8-4”
xts “0.12.1”
yaml “2.2.1”
zip “2.1.1”
zoo “1.8-8”
MatchIt “3.0.2”
Matching “4.9-3”
RColorBrewer “1.1-2”
littler “0.3.9”
rjson “0.2.20”
KernSmooth “2.23-16”
MASS “7.3-51.5”
Matrix “1.2-18”
base “3.6.3”
boot “1.3-24”
class “7.3-15”
cluster “2.1.0”
codetools “0.2-16”
compiler “3.6.3”
datasets “3.6.3”
foreign “0.8-75”
grDevices “3.6.3”
graphics “3.6.3”
grid “3.6.3”
lattice “0.20-40”
methods “3.6.3”
mgcv “1.8-31”
nlme “3.1-144”
nnet “7.3-12”
parallel “3.6.3”
rpart “4.1-15”
spatial “7.3-11”
splines “3.6.3”
stats “3.6.3”
stats4 “3.6.3”
survival “3.1-8”
tcltk “3.6.3”
tools “3.6.3”
utils “3.6.3”
You can learn more about interacting with the R interpreter in that section of the documentation:
The General Purpose Image includes a single node Spark 2.4.6 instance. The following libraries are installed
activation-1.1.jar
aether-api-1.12.jar
aether-connector-file-1.12.jar
aether-connector-wagon-1.12.jar
aether-impl-1.12.jar
aether-spi-1.12.jar
aether-util-1.12.jar
apacheds-i18n-2.0.0-M15.jar
apacheds-kerberos-codec-2.0.0-M15.jar
api-asn1-api-1.0.0-M20.jar
api-util-1.0.0-M20.jar
asm-5.0.3.jar
asm-analysis-5.0.3.jar
asm-tree-5.0.3.jar
asm-util-5.0.3.jar
avro-1.7.4.jar
aws-java-sdk-core-1.10.6.jar
aws-java-sdk-kms-1.10.6.jar
aws-java-sdk-s3-1.10.6.jar
bcpkix-jdk15on-1.52.jar
bcprov-jdk15on-1.52.jar
cglib-2.2.1-v20090111.jar
commons-beanutils-1.7.0.jar
commons-beanutils-core-1.8.0.jar
commons-cli-1.2.jar
commons-codec-1.6.jar
commons-codec-1.9.jar
commons-collections-3.2.2.jar
commons-compress-1.4.1.jar
commons-configuration-1.6.jar
commons-configuration-1.9.jar
commons-dbcp2-2.0.1.jar
commons-digester-1.8.jar
commons-exec-1.3.jar
commons-httpclient-3.1.jar
commons-io-2.4.jar
commons-io-2.6.jar
commons-lang-2.6.jar
commons-lang3-3.7.jar
commons-logging-1.1.3.jar
commons-logging-1.2.jar
commons-math3-3.1.1.jar
commons-net-3.1.jar
commons-pool2-2.3.jar
curator-client-2.7.1.jar
curator-framework-2.7.1.jar
curator-recipes-2.7.1.jar
gson-2.2.4.jar
gson-2.8.6.jar
gson-extras-0.2.1.jar
guava-16.0.1.jar
hadoop-annotations-2.8.3.jar
hadoop-auth-2.8.3.jar
hadoop-aws-2.8.3.jar
hadoop-common-2.8.3.jar
htrace-core4-4.0.1-incubating.jar
httpclient-4.2.5.jar
httpclient-4.5.2.jar
httpcore-4.2.4.jar
httpcore-4.4.4.jar
jackson-annotations-2.6.0.jar
jackson-core-2.6.5.jar
jackson-core-asl-1.9.13.jar
jackson-databind-2.6.5.jar
jackson-jaxrs-1.8.3.jar
jackson-mapper-asl-1.9.13.jar
jackson-xc-1.8.3.jar
java-xmlbuilder-0.4.jar
jaxb-api-2.2.2.jar
jaxb-impl-2.2.3-1.jar
jcip-annotations-1.0.jar
jdom2-2.0.6.jar
jersey-core-1.9.jar
jersey-json-1.9.jar
jersey-server-1.9.jar
jets3t-0.9.0.jar
jettison-1.1.jar
jetty-6.1.26.jar
jetty-sslengine-6.1.26.jar
jetty-util-6.1.26.jar
jline-0.9.94.jar
jline-2.14.3.jar
joda-time-2.9.4.jar
jsch-0.1.54.jar
json-smart-1.1.1.jar
jsoup-1.8.2.jar
jsp-api-2.1.jar
jsr305-3.0.0.jar
libthrift-0.9.2.jar
log4j-1.2.17.jar
markdown4j-2.2-cj-1.0.jar
maven-aether-provider-3.0.3.jar
maven-artifact-3.0.jar
maven-model-3.0.3.jar
maven-model-builder-3.0.3.jar
maven-plugin-api-3.0.jar
maven-repository-metadata-3.0.3.jar
nimbus-jose-jwt-3.9.jar
paranamer-2.3.jar
parboiled-core-1.1.7.jar
parboiled-java-1.1.7.jar
pegdown-1.6.0.jar
plexus-classworlds-2.4.jar
plexus-component-annotations-1.5.5.jar
plexus-interpolation-1.14.jar
plexus-utils-2.0.7.jar
postgresql-9.4-1201-jdbc41.jar
protobuf-java-2.5.0.jar
sisu-guice-3.0.2-no_aop.jar
sisu-inject-bean-2.2.2.jar
sisu-inject-plexus-2.2.2.jar
slf4j-api-1.7.10.jar
slf4j-log4j12-1.7.10.jar
snappy-java-1.0.4.1.jar
snappy-java-1.1.4.jar
snowflake-jdbc.jar
spark-interpreter-0.8.14.5-zepl-SNAPSHOT.jar
stax-api-1.0-2.jar
wagon-http-1.0.jar
wagon-http-lightweight-1.0.jar
wagon-http-shared-1.0.jar
wagon-provider-api-1.0.jar
xmlenc-0.52.jar
xz-1.0.jar
zeppelin-display-0.8.14.5-zepl-SNAPSHOT.jar
zeppelin-interpreter-0.8.14.5-zepl-SNAPSHOT.jar
zeppelin-jdbc-0.8.14.5-zepl-SNAPSHOT.jar
zeppelin-markdown-0.8.14.5-zepl-SNAPSHOT.jar
zeppelin-python-0.8.14.5-zepl-SNAPSHOT.jar
zookeeper-3.4.6.jar
You can learn more about interacting with the Spark interpreter in that section of the documentation:
Last modified 2yr ago