Agent Foskett Academy • Microsoft Sentinel • Module 5 • Lesson 46

Lesson 46 — Designing an Operational Microsoft Sentinel Workbook

Module 4 taught us to investigate incidents.

Now we build the operational views that help analysts spot patterns, understand activity and decide where to look next.

Module 5 — Workbooks and Dashboards begins here.
Agent Foskett Microsoft Sentinel operational workbook design
What you will learn

Plan a workbook that serves a real SOC need.

✓ Define operational questions
✓ Choose metrics and visuals
✓ Design KQL drill-downs
✓ Check data quality and access

Learning objectives

  • Explain how an operational workbook differs from an incident investigation.
  • Define the audience and decisions a workbook should support.
  • Choose appropriate telemetry, measures, time ranges and visualisations.
  • Design useful filters and drill-down paths.
  • Consider query performance, access and data quality.
  • Sketch a workbook specification before building it.

Why this is not Lesson 8 again

Lesson 8 introduced Sentinel workbooks and dashboards. Module 5 moves from knowing the feature to designing useful operational reporting.

Our goal is not a page full of attractive charts. It is a page that helps the SOC make better decisions.

The Agent Foskett question

Before adding any chart, ask: WHO will use this workbook? WHAT decision must they make? WHICH evidence supports that decision? WHAT action follows an unusual result?

What a workbook does

Microsoft Sentinel workbooks provide interactive visualisations and reporting over relevant data sources. They can combine text, queries, parameters and visual elements to support monitoring, analysis and investigation.

A workbook is a view of data, not a replacement for detection rules, incident management or raw-event validation.

Pick the audience first

  • SOC analyst: recent suspicious activity, drill-down links and investigation pivots.
  • SOC lead: queue trends, coverage and operational bottlenecks.
  • Detection engineer: rule quality, noise and data availability.
  • Management: carefully defined, high-level measures with limitations explained.

Start with decisions, not visuals

QuestionUseful measurePossible display
Are failed sign-ins increasing?Failures by hourTime-series chart
Which accounts have repeated failures?Failures by accountRanked table
Where should an analyst investigate?Source IP, account, application and timeDetailed table
Is data arriving?Latest event timestamp by sourceStatus table or text

An operational workbook blueprint

WORKBOOK: Identity activity overview [Time range] [Account] [Application] 1. Overview: failed / successful sign-ins 2. Trend: sign-ins over time 3. Focus: accounts with repeated failures 4. Investigation: underlying event rows 5. Notes: definitions, limitations, next steps

Define each metric precisely

“Failed sign-ins” is not enough. Specify the table, result conditions, time window, grouping and whether counts represent events or unique users.

An attractive metric without a definition can mislead the person relying on it.

Choose the right visual

DisplayBest used for
Time-series chartChange over time
Bar chartComparing categories or top contributors
TableDetailed entities, evidence and drill-down
Number / KPIA clearly defined summary value
Text / guidanceInterpretation and next investigation steps

Build a simple data foundation

Identity trend — failed sign-ins by hour
  1. 1
  2. 2
  3. 3
  4. 4
  5. 5
  6. 6
  7. 7
  8. 8
SigninLogs
| where TimeGenerated > ago(24h)
| where ResultType != "0"
| summarize FailedSignIns = count()
    by bin(TimeGenerated, 1h)
| order by TimeGenerated asc

This example counts sign-in records with nonzero ResultType values, grouped hourly. Confirm the meaning of result codes and the source table for your environment before publishing it as a business metric.

Build the drill-down

Investigation table — repeated failures by account
  1. 1
  2. 2
  3. 3
  4. 4
  5. 5
  6. 6
  7. 7
  8. 8
  9. 9
  10. 10
  11. 11
SigninLogs
| where TimeGenerated > ago(24h)
| where ResultType != "0"
| summarize Failures = count(),
            SourceIPs = dcount(IPAddress),
            LastSeen = max(TimeGenerated)
    by UserPrincipalName
| where Failures >= 5
| order by Failures desc

The threshold of five is an illustrative reporting filter, not a Microsoft-recommended detection threshold. A ranked table should lead analysts to relevant detail, not imply every row is malicious.

Use parameters carefully

Time-range, account, device, application or workspace parameters can make one workbook useful across many investigations.

Choose sensible defaults and label filters clearly. Ensure the query logic respects the selected parameter and handles empty selections safely.

Time windows matter

A one-hour incident triage view and a 30-day trend view answer different questions. Make the selected period visible, and avoid comparing periods without accounting for different durations or ingestion delays.

Avoid confusing data coverage with zero activity

A blank chart might mean no events, no permissions, a missing connector, a query error or delayed ingestion. Show data freshness and document source dependencies where possible.

Plan for data access

Workbook readers need appropriate access to the workbook and the underlying data. Validate the experience with a representative analyst account rather than assuming the creator’s permissions match everyone else’s.

Think about performance

  • Filter by time as early as possible.
  • Summarise before visualising large event sets.
  • Limit unnecessarily wide or high-cardinality result tables.
  • Avoid repeating expensive queries across multiple visuals.
  • Test the workbook with realistic data volumes and time ranges.

Do not turn dashboards into detections

A chart showing a spike is an investigation lead, not proof of compromise. If the behaviour requires timely automated detection, consider a properly tested analytics rule rather than relying on someone to notice a workbook.

A useful operational layout

TOP: Time range and important filters ROW 1: Defined KPIs and data freshness ROW 2: Trends and comparisons ROW 3: Ranked entities requiring attention BOTTOM: Evidence tables, definitions, investigation guidance

Workbook design review

CheckQuestion
PurposeCan the user name the decision this view supports?
DefinitionsAre all counts and filters explained?
CoverageAre required connectors and tables present?
FreshnessCan users tell whether the data is current?
PerformanceDo queries remain responsive at realistic scale?
AccessCan intended readers see the underlying data?
ActionCan analysts drill down and investigate?

Agent Foskett exercise

Your SOC lead wants a workbook that helps analysts notice repeated identity failures and identify the accounts worth investigating.

  1. Write the primary decision the workbook should support.
  2. Choose three measures and define them precisely.
  3. Pick a visual for each measure and explain why.
  4. Run the two example KQL queries in a suitable environment.
  5. Describe one useful parameter and one data-quality warning.
  6. Sketch a drill-down from the trend chart to an individual account.
  7. Explain what evidence would be needed before calling an account compromised.

Common mistakes

  • Adding charts before defining the investigation question.
  • Presenting counts without definitions or time ranges.
  • Using a pie chart when a time-series trend is needed.
  • Hiding data gaps and permission limitations.
  • Building expensive queries that nobody can use.
  • Treating a dashboard anomaly as a confirmed attack.

Agent Foskett takeaway

A good workbook does not merely display what happened. It helps the analyst decide what to investigate next.

The logs already knew. The dashboard still needs to ask the right questions.

Lesson summary
Design a Microsoft Sentinel workbook around the decisions analysts need to make, with clearly defined metrics, targeted KQL, appropriate visualisations and honest data-quality context.
Sentinel Academy Home

Related Agent Foskett learning

Connect operational reporting to the evidence-first investigation workflow.