Creating a process
A process allows you to execute a Python script on Ellipsis Drive using the Information Factory compute environment.
Processes are deployed via a Git repository and executed on server side.
Execution model
To benefit from server side performance optimizations, data must be accessed and written using the Ellipsis Python package. An example script can be found here.
This enables optimized data streaming when the process runs server side instead of client side.
Deployment
A process is defined as a Python script stored in a Git repository.
The repository must include:
the main script
a requirements.txt file in the root directory
To add a process:
1.) Click New → More → New Process
2.) Provide the Git URL and specify the script path inside the repository
Once deployed, the latest version of the Git repository is always used at runtime, ensuring you do not need to re-add your process when you update it.
Parameters
Your script can take free parameters that can be provided whenever the process is run.
These parameters are:
defined when creating the process
provided by the user at execution time
passed to the script as command-line arguments
Each parameter requires:
name
description
example value
Example usage in script:
All parameters are passed as strings and must be parsed accordingly to an appropriate format.
Last updated