Skip to content
This repository has been archived by the owner on Oct 9, 2023. It is now read-only.

Deletion of data from storage #140

Merged
merged 2 commits into from
Sep 12, 2022
Merged

Conversation

MorpheusXAUT
Copy link
Contributor

TL;DR

Flyte storage has been extended to support deletion of stored data.

Type

  • Bug Fix
  • Feature
  • Plugin

Are all requirements met?

  • Code completed
  • Smoke tested
  • Unit tests added
  • Code documentation added
  • Any pending items have an associated Issue

Complete description

storage.RawStore now also has a new Delete method, removing the referenced data from the underlying store.
CachedRawStore, MemStore and StowStore have been extended to support this new functionality.

This new functionality is required to remove any no longer present ArtifactData in datacatalog while updating artifacts.

Tracking Issue

flyteorg/flyte#2867

Follow-up issue

NA

Nick Müller added 2 commits September 12, 2022 15:22
Added Delete function to RawStore
Implemented deletion for CachedRawStore, MemStore and StowStore

Signed-off-by: Nick Müller <[email protected]>
@codecov
Copy link

codecov bot commented Sep 12, 2022

Codecov Report

Merging #140 (c4efad6) into master (65025fd) will increase coverage by 0.45%.
The diff coverage is 79.41%.

@@            Coverage Diff             @@
##           master     #140      +/-   ##
==========================================
+ Coverage   68.76%   69.21%   +0.45%     
==========================================
  Files          69       69              
  Lines        3419     3450      +31     
==========================================
+ Hits         2351     2388      +37     
+ Misses        909      904       -5     
+ Partials      159      158       -1     
Flag Coverage Δ
unittests 68.13% <77.41%> (+0.54%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
cache/auto_refresh.go 78.51% <ø> (+5.78%) ⬆️
cli/pflags/api/tag.go 77.27% <ø> (ø)
futures/future.go 100.00% <ø> (ø)
profutils/server.go 53.33% <0.00%> (-3.81%) ⬇️
promutils/labeled/stopwatch.go 80.00% <ø> (ø)
promutils/scope.go 88.28% <ø> (ø)
storage/copy_impl.go 80.00% <ø> (ø)
storage/storage.go 100.00% <ø> (ø)
utils/auto_refresh_cache.go 70.00% <ø> (ø)
storage/cached_rawstore.go 80.64% <71.42%> (-1.18%) ⬇️
... and 5 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@EngHabu EngHabu merged commit c43dade into flyteorg:master Sep 12, 2022
@welcome
Copy link

welcome bot commented Sep 12, 2022

Congrats on merging your first pull request! 🎉

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants