feat: add --environment flag to sqlmesh janitor for scoped cleanup#5810
Draft
mday-io wants to merge 1 commit into
Draft
feat: add --environment flag to sqlmesh janitor for scoped cleanup#5810mday-io wants to merge 1 commit into
mday-io wants to merge 1 commit into
Conversation
df7b55c to
00992be
Compare
Signed-off-by: Michael Day <michael.day@cloudkitchens.com> Signed-off-by: mday-io <mdaytn@gmail.com>
00992be to
e3ca817
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Add an
--environment/-eflag tosqlmesh janitorthat scopes cleanup to a single named environment, and fixsqlmesh invalidate <env> --syncto only clean up the named environment rather than all currently-expired environments.New flag:
sqlmesh janitor --environment <name>removes views, schemas, and state records for the named environment only. If the environment is not expired or does not exist, a warning is emitted. Global snapshot expiration and interval compaction are skipped when this flag is set — those operations are cross-environment and cannot be safely scoped to a single one.Bug fix:
sqlmesh invalidate <env> --syncpreviously called_cleanup_environments()with no filter after marking the target environment expired, which caused all other currently-expired environments to be deleted as a side effect. It now scopes the cleanup to the named environment only.Test Plan
--gateway duckdb_persistentwith two environments (dev1,dev2). Invalidatingdev1and runningsqlmesh janitor --environment dev1cleaned updev1while leavingdev2untouched.Checklist
make styleand fixed any issuesmake fast-test)git commit -s) per the DCO