proposal : spindle : upload log files to object storage and clean up local files #209

Overview#

Spindles write logs to disk during a pipeline run, after the workflow is complete a spindle should upload the logs to object storage and clean up local files.

Why#

Logs files put pressure on the node's disk space and object storage is relatively cheap.

Implementation Plan#

1. Add a transparent clean up step for every workflow
2. Upload log files to object storage and delete local log files
3. Update the UI to read completed workflow logs from object storage