Skip to content

agent storage retention and diagnostic cleanup interval #115

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wolfeaustin wants to merge 1 commit into
base: main
Choose a base branch
from
Draft

agent storage retention and diagnostic cleanup interval #115

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 10 additions & 0 deletions charts/finops-agent/templates/deployment.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -210,6 +210,16 @@ spec:
- name: DIAGNOSTICS_EXPORT_INTERVAL
value: {{ .Values.agent.exportIntervals.diagnostics | quote }}
{{- end }}
{{- with .Values.agent.storageRetention }}
- name: HEARTBEAT_STORAGE_RETENTION
value: {{ .heartbeat | quote }}
- name: DIAGNOSTICS_STORAGE_RETENTION
value: {{ .diagnostics | quote }}
{{- end }}
{{- if .Values.agent.storageCleanupInterval }}
- name: STORAGE_CLEANUP_INTERVAL
value: {{ .Values.agent.storageCleanupInterval | quote }}
{{- end }}

{{- if .Values.agent.cloudability.enabled }}
- name: CLOUDABILITY_CLUSTER_NAME
Expand Down
10 changes: 10 additions & 0 deletions charts/finops-agent/values.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -174,6 +174,9 @@ logLevel: "info"
## @param agent.exportIntervals.networkInsight A duration string of how often network insight data is exported.
## @param agent.exportIntervals.heartbeat A duration string of how often heartbeat data is exported.
## @param agent.exportIntervals.diagnostics A duration string of how often diagnostics data is exported.
## @param agent.storageRetention.heartbeat How long heartbeat objects are retained in federated storage before cleanup. Set to `0` or `0s` to disable.
## @param agent.storageRetention.diagnostics How long diagnostics objects are retained in federated storage before cleanup. Set to `0` or `0s` to disable.
## @param agent.storageCleanupInterval How often the agent scans federated storage for expired heartbeat/diagnostics objects.
## @param agent.nodes.backgroundStatsCollector Allows for node stats to be collected asynchronously to allow for greater scale
## @param agent.nodes.concurrentPollers The number of concurrent node pollers used when collecting node stats. When empty, the agent's built-in default is used.
## @param agent.exporter.emissionInterval A duration string of how often the core agent exporter will emit new data snapshots to the enabled emitters.
Expand Down Expand Up @@ -226,6 +229,13 @@ agent:
networkInsight: 10m
heartbeat: 5m
diagnostics: 10m
# How long heartbeat/diagnostics objects are kept in the federated storage
# bucket before this agent deletes them. These are source objects under
# finops-agent/<cluster>/{heartbeat,diagnostics}/, not aggregator DB retention.
storageRetention:
heartbeat: 7d
diagnostics: 7d
storageCleanupInterval: 1h
exporter:
emissionInterval: 1m
exportLegacyDataModels: true
Expand Down
Loading