Create an Alibaba MaxCompute Datasource

1. Navigate to: Resources > Data Sources

2. Select the Alibaba MaxCompute Icon:

Data Source Inputs

• Name (required)

• Description (optional)

• Endpoint (required): URL corresponding to the region MaxCompute is hosted

  • The corresponding values can be found here: Configure Endpoints in in Alibaba Cloud​

• Region (required): Specific region for your MaxCompute project

  • Example: us-west-1

• Project (required): Name of your MaxCompute project

• Credential Type: See Data Source Security​

• AccessKey ID (required - can be entered later): See Configure Authentication​

• AccessKey Secret (required - can be entered later): See Configure Authentication ​

Use Alibaba Max Compute

Read

%python
from odps.df import DataFrame
import pandas as pd
​
# Create a MaxCompute (ODPS) entrance object
o = z.getDatasource("zepl_docs_alibaba_maxcompute")
​
# Get table reference
table = o.get_table('sale_detail')
​
# Create ODPS DataFrame
odps_df = table.to_df()
​
# Convert to Pandas DataFrame
pandas_df = odps_df.to_pandas()
​
z.show(pandas_df)

%datasource.zepl_docs_alibaba_maxcompute
# Uncomment if full table scans are required for this query
# SET odps.sql.allow.fullscan=true;
​
SELECT * FROM sale_detail;

Write

%python
# Create a MaxCompute (ODPS) entrance object
o = z.getDatasource("zepl_docs_alibaba_maxcompute")
​
# Create data to write. Number of values per list must match the schema dtypes: o.get_table('sale_detail').schema
records = [["Samsung", 1234, 1000.00, "2020-01-01", "USA"], ["Apple", 9876, 5000.00, "2020-01-01", "USA"]]
​
# Write to table 'sale_detail', all records at a specific partition for sale_date and region
o.write_table('sale_detail', records, partition='sale_date="2020-01-01", region="USA', create_partition=True)

​Open all examples in Zepl​

Configure Authentication

Generate User Access Key and Secret

1. Login to your Alibaba Cloud console

2. Navigate to Resource and Access Management (RAM)

3. Select User > Then you specific user

4. Select Create Access Key.

5. Download this file and enter the corresponding values in the Zepl Data Source. If you lose this file, you will need to generate new Access Keys for this user.