Example 2. Data Ingress and Egress using an Ephemeral Volume

This builds upon the previous example. Instead of using data ingress to pull a single raw file from the GitHub repo, we will download the entire repo (as a .zip file). We will unzip the repo with one job and then append to the README file contents with a second job. Finally, we will use data egress to save the modified file from the ephemeral volume to an AWS s3 bucket.

This example will work for you if you edit the egress destination to point at an s3 bucket or other endpoint where you have write access and modify the secret accordingly.

If you add reasonable values to placeholders <your_s3_bucket> and <your_s3_secret> above, you will find a file named README saved on your endpoint with the following content.

Hello World!
(goodbye dear basement)