Agent Foskett Academy • Microsoft Sentinel • Module 5 • Lesson 51

Lesson 51 — Testing, Sharing and Maintaining Sentinel Workbooks

A workbook is only operationally useful when analysts can trust its data, open its evidence and access it with the correct permissions. Learn to validate, publish and maintain your SOC dashboard safely.

Module 5 — Workbooks and Dashboards • Operational readiness
Agent Foskett Microsoft Sentinel workbook testing and operational readiness
What you will learn

Turn your Lesson 50 dashboard into a supportable SOC asset.

✓ Functional and data validation
✓ Role-based access and sharing
✓ Performance and refresh checks
✓ Change control and maintenance

Lesson 51 — From dashboard to dependable SOC tool

In Lesson 50, you built a SOC Operations Dashboard. Now Agent Foskett has a more difficult question: will it still work on Monday morning, for the next analyst, after the data changes?

Testing, controlled sharing and maintenance turn a useful workbook into an operational resource.

Learning objectives

  • Validate workbook data against source records.
  • Test parameters, links and empty-data behaviour.
  • Separate workbook access from data access.
  • Check query performance and refresh expectations.
  • Publish with an owner, change log and rollback plan.
  • Run a practical handover acceptance test.

The operational lifecycle

BUILD → TEST → REVIEW → SHARE ↑ ↓ IMPROVE ← MONITOR ← OPERATE Every change: re-test and record it.

Prepare the lab

  1. Open your SOC Operations Dashboard — Lab workbook from Lesson 50.
  2. Save a separate test copy named SOC Operations Dashboard — Validation.
  3. Record the workspace, resource group, subscription and workbook owner.
  4. Choose a test period with known incidents and a period with few or no events.
  5. Identify a second test account with the intended analyst permissions.

Do not test destructive incident actions or expose production identities in screenshots.

Step 1 — Create a test matrix

TestPass conditionEvidence to capture
KPI totalsOpen, high and unassigned counts reconcileSource query and screenshot
Triage queueLatest incident state shown; row limit disclosedIncident IDs and timestamps
ParametersDate/workspace selections change intended panelsBefore/after results
NavigationLinks open the correct permitted recordTarget incident
Empty dataNo misleading zero or false success messageEmpty-period screenshot
PermissionsAnalyst sees only authorised contentRole and test result
PerformanceLoads within your agreed operational targetMeasured elapsed time

Step 2 — Validate latest incident state

Run a source query independently of the workbook. The latest incident record matters because SecurityIncident may contain multiple versions of the same incident.

Source of truth — open incidents
  1. 1
  2. 2
  3. 3
  4. 4
  5. 5
  6. 6
  7. 7
SecurityIncident
| summarize arg_max(TimeGenerated, *)
    by IncidentNumber
| where Status != "Closed"
| summarize OpenIncidents = count(),
            HighSeverity = countif(Severity == "High")

Compare these values with the dashboard. For multi-workspace reports, include a workspace-aware incident key. The latest row means the latest available in the queried data, not necessarily the current state if ingestion is delayed.

Step 3 — Check duplicate and missing identifiers

Check whether incident updates exist and whether your chosen incident key is populated. Multiple records per incident are expected; blank identifiers warrant investigation.

Inspect incident versioning
  1. 1
  2. 2
  3. 3
  4. 4
  5. 5
  6. 6
  7. 7
SecurityIncident
| summarize Records = count(),
            LatestRecord = max(TimeGenerated)
    by IncidentNumber
| order by Records desc
| take 20

This query is diagnostic. It does not prove data completeness and should not be used as the dashboard’s current-state count.

Step 4 — Test time parameters

  1. Set the workbook to a 24-hour period and note the creation-trend count.
  2. Change to seven days; confirm the trend changes as expected.
  3. Check that the current open-incident count is not unintentionally restricted by the trend parameter.
  4. Change any workspace or severity parameters and inspect every dependent panel.
  5. Reload the workbook and verify defaults.

A control that appears on screen but does not affect its intended query is a defect.

Step 5 — Test navigation and empty states

  • Open an incident from the triage table and verify the identifier.
  • Confirm links work for the analyst role, not only for the author.
  • Choose an empty time window: display No data for selected period rather than implying the environment is safe.
  • Check missing-table and permission-error messages.
  • Confirm row caps and time scopes are labelled.

Step 6 — Verify telemetry freshness

A workbook can render successfully while its underlying data is stale. Display freshness for each required source and investigate unexpected gaps.

Latest observed record per source
  1. 1
  2. 2
  3. 3
  4. 4
  5. 5
  6. 6
  7. 7
  8. 8
  9. 9
  10. 10
  11. 11
union isfuzzy=true
    (SecurityIncident
     | summarize Latest = max(TimeGenerated)
     | extend Source = "SecurityIncident"),
    (SigninLogs
     | summarize Latest = max(TimeGenerated)
     | extend Source = "SigninLogs")
| project Source, Latest,
          MinutesSinceLatest =
              datetime_diff("minute", now(), Latest)

Run each source independently if one is absent. Define freshness thresholds based on connector expectations; a recent timestamp alone does not prove complete ingestion.

Step 7 — Understand workbook permissions

Permission layerWhat to verify
Workbook resourceThe analyst can open the shared workbook resource.
Log Analytics workspaceThe analyst can read the tables queried by the workbook.
Microsoft Sentinel incidentsThe analyst can open incident evidence appropriate to their role.
Connected resourcesCross-workspace or cross-resource queries have the necessary access.
Edit rightsOnly authorised maintainers can change production content.

Workbook access does not automatically grant access to Log Analytics data or incidents. Assign the least-privileged built-in roles that satisfy your environment, and test with a real non-admin account.

Step 8 — Share safely

  1. Confirm the workbook is saved as a shared Azure workbook resource in the intended subscription and resource group.
  2. Open the workbook’s resource and access-control settings.
  3. Grant the analyst access needed to view the workbook and its underlying data, following your organisation’s RBAC model.
  4. Share the workbook resource link with the analyst.
  5. Sign in as the analyst and test the dashboard and incident drill-down.

Do not confuse sharing a link or exported workbook template with granting access to the queried data. Portal controls and role assignments vary by tenant.

Step 9 — Test query performance

Measure representative loads with realistic incident volumes and selected time ranges. Investigate slow panels before increasing automatic refresh frequency.

  • Filter event tables to the required period when semantically appropriate.
  • Keep current-state incident logic separate from historical event trends.
  • Use project to return only fields needed for a visual.
  • Avoid unnecessary repeated expensive queries and oversized detail tables.
  • Check workspace query diagnostics and costs where available.

Do not apply a narrow TimeGenerated filter before latest-state aggregation if it would hide older open incidents.

Step 10 — Check refresh behaviour

  • Document the expected refresh interval and data latency.
  • Check what happens when a workbook remains open for an entire shift.
  • Verify timestamps update when expected.
  • Balance operational needs against query and ingestion cost.
  • Display a visible last-reviewed note, not an unverified “live” label.

Step 11 — Version control and rollback

Release itemExample entry
Workbook nameSOC Operations Dashboard
Version1.0.0
OwnerSOC Operations Lead
EnvironmentValidation / Production
ChangesAdded incident freshness checks
Test statusPassed with analyst account
RollbackRestore last approved workbook definition

Export or otherwise retain the previous approved workbook definition according to your deployment process. Store copies in an access-controlled location and avoid including secrets or sensitive data in source control.

Step 12 — Maintenance runbook

  1. Review broken queries, permission failures and unexpected blank panels.
  2. Check connector status, data freshness and schema changes.
  3. Review query latency and usage cost.
  4. Retest incident links after portal or workbook changes.
  5. Review owner, access, documentation and change history.
  6. After any update, repeat the acceptance tests before production release.

Step 13 — Troubleshooting guide

SymptomLikely checksSafe next action
Workbook opens but panels are blankWorkspace selection, time window, RBAC, source tablesTest source query directly
KPI disagrees with incident listVersioned records, filters, scope, ingestion delayReconcile incident IDs
Analyst sees access deniedWorkbook versus workspace permissionsReview role assignments
Workbook loads slowlyBroad scans, repeated queries, large tablesMeasure and optimise
Link opens wrong incidentIncorrect parameter or identifier mappingVerify with known lab incident
Data appears staleConnector or ingestion delay, refresh settingsCheck source timestamps

Agent Foskett case file — The perfect dashboard nobody could open

Monday, 08:05. The SOC dashboard looked magnificent on the engineer’s screen. Twelve KPI cards, five charts and a reassuringly green status panel.

Then the incoming analyst opened the link.

“Access denied.”

Agent Foskett examined the evidence. The workbook was shared. The workspace was not. The dashboard was not broken — its access design was incomplete.

“Excellent,” he said. “We’ve successfully secured the dashboard from the people who need it.”

The team corrected the permissions, tested with the analyst account and recorded the release. This time the green status meant something.

Hands-on exercise — Production readiness review

  1. Create a validation copy of the Lesson 50 workbook.
  2. Complete the test matrix for KPIs, trends, navigation and empty states.
  3. Independently reconcile open incident totals.
  4. Check freshness for SecurityIncident and one supporting data source.
  5. Measure dashboard load time with two time windows.
  6. Open the workbook with a non-admin analyst account.
  7. Record at least one simulated failure and its resolution.
  8. Produce a release note and rollback reference.

Knowledge check

  1. Why can counting all SecurityIncident rows inflate totals?
  2. Does permission to open a workbook automatically grant access to its workspace?
  3. What should an empty chart say when the selected period has no records?
  4. Why should current backlog counts be tested separately from time-filtered trends?
  5. What evidence would you keep before releasing a workbook update?

Check your answers: incident updates create multiple rows; no; clearly state no data for the selected scope; old open incidents may still need action; preserve test results, approvals, version details and rollback material.

Release checklist

  • ✓ Source totals reconcile with dashboard visuals.
  • ✓ Time parameters and workspace scope are labelled and tested.
  • ✓ Empty states and missing sources are handled honestly.
  • ✓ Incident links lead to the correct evidence.
  • ✓ Analyst permissions work without administrator privileges.
  • ✓ Performance and refresh expectations are documented.
  • ✓ Owner, version, change log and rollback copy exist.
  • ✓ No sensitive production data appears in public material.

Agent Foskett takeaway

A dashboard is not ready because it looks good. It is ready when the next analyst can trust it, use it and recover it when something changes.

The logs already knew. This time, so did the change record.

Lesson 51 complete — Module 5 operational readiness!
You can now test, share and maintain a Microsoft Sentinel workbook with evidence-based validation, least-privilege access and controlled change management.
Sentinel Academy Home

Related Agent Foskett learning

Review the dashboard and workbook skills behind this lesson.