Skip to content

Grafana dashboard template and reorganization#5999

Merged
anandbraman merged 1 commit intomainfrom
grafana-configuration
Apr 7, 2026
Merged

Grafana dashboard template and reorganization#5999
anandbraman merged 1 commit intomainfrom
grafana-configuration

Conversation

@anandbraman
Copy link
Copy Markdown
Contributor

@anandbraman anandbraman commented Apr 6, 2026

The current grafana dashboard has hardcoded UID datasources. These have been replaced in favor of a user configured value. Storage usage, memory usage, and throughput added to a general performance section. Added a latency section which includes completion latency, processing latency and step latency.

Closes #4493, closes #5838

Current Panels:
General Performance:

  • Storage Usage
  • Memory Usage
  • Throughput
image

Latency

  • E2E completion latency
  • DBSP Step Latency
  • Processing Latency
image

Connections

  • Input buffer size
  • output buffer size
  • input rate
  • output rate
  • Input rate records
  • output rate records
  • connector errors
image

Advanced

  • Storage Read latency
  • Storage Write Latency
  • Storage Sync Latency
image

Describe Manual Test Plan

Ran Feldera locally and reviewd the grafana config. Confirmed all the values populate even though this isn't reflected in the screenshots

Checklist

  • Unit tests added/updated
  • Integration tests added/updated
  • Documentation updated
  • Changelog updated

Breaking Changes?

Mark if you think the answer is yes for any of these components:

Describe Incompatible Changes

@anandbraman anandbraman requested review from gz and ryzhyk April 6, 2026 18:57
Copy link
Copy Markdown

@mythical-fred mythical-fred left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Use =~ for $pipeline_name filters so multi/All works.

@@ -658,7 +941,7 @@
{
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

pipeline_name is a multi + includeAll variable. Use =~ "$pipeline_name" here so multi-selection and All work.

"includeNullMetadata": false,
"includeNullMetadata": true,
"legendFormat": "__auto",
"range": true,
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same here: use =~ "$pipeline_name" for multi/All support.

@anandbraman anandbraman force-pushed the grafana-configuration branch from 02c36c7 to b2da381 Compare April 6, 2026 20:04
@anandbraman anandbraman self-assigned this Apr 6, 2026
@anandbraman anandbraman enabled auto-merge April 6, 2026 20:07
@anandbraman anandbraman force-pushed the grafana-configuration branch from b2da381 to d21c973 Compare April 6, 2026 20:07
@anandbraman anandbraman added this pull request to the merge queue Apr 6, 2026
Copy link
Copy Markdown

@mythical-fred mythical-fred left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Apr 6, 2026
The current grafana dashboard has hardcoded UID datasources. These have been replaced in favor of a user configured value. Storage usage, memory usage, and throughput added to a general performance section. Added a latency section which includes completion latency, processing latency and step latency

Signed-off-by: Anand Raman <anand.raman@feldera.com>
@anandbraman anandbraman force-pushed the grafana-configuration branch from d21c973 to bcf5242 Compare April 7, 2026 15:11
@anandbraman anandbraman enabled auto-merge April 7, 2026 15:11
@anandbraman anandbraman added this pull request to the merge queue Apr 7, 2026
Merged via the queue into main with commit ad56714 Apr 7, 2026
1 of 2 checks passed
@anandbraman anandbraman deleted the grafana-configuration branch April 7, 2026 17:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Make sure grafana_dashboard.json is up-to-date Example grafana dashboard

3 participants