Impact on alerts
Overview
Maintenance Windows in ToBeAlert have a significant impact on how alerts are processed, displayed, and managed. Understanding these effects is crucial for effectively using maintenance windows to maintain a clean alert environment.
Alert suppression mechanism
How alerts are suppressed
When a maintenance window is active, ToBeAlert uses the following process to determine which alerts should be suppressed:
- New incoming alerts are checked against active maintenance window parameters
- If an alert matches all specified criteria, it is marked as suppressed
- Suppressed alerts will be stored in the system and assigned the 'Maintenance Window' status based on the maintenance window's settings configured.
Matching Criteria
An alert is suppressed when it matches ALL of the specified maintenance window's parameters:
- Resource matches the window's resource (if specified)
- Event type matches the window's event (if specified)
- Environment matches the window's environment
- Alert creation time falls within the window's time range
- Other specified parameters (group, service, tags, etc.) match
Visual representation
Alert display
Suppressed alerts are handled differently in the UI:
- They do not appear in the default alert views
- They can be viewed in the built-in Events in maintenance mode view
- They are visually marked as suppressed when visible
- They are included in counts but segregated from active alerts
Maintenance windows indicators
The system provides visual indicators of active maintenance windows:
- Maintenance windows status indicators in the dashboard
- Timeline representation of scheduled maintenance windows
Alert lifecycle during maintenance windows
New alerts
New alerts that occur during an active maintenance windows:
- Are captured and stored in the system
- Are marked as suppressed
- Do not trigger notifications
- Are not displayed in the main alert views
- Can be viewed in the suppressed alerts view
Existing alerts
Alerts that existed before the maintenance window started:
- Remain in their current state
- Are not automatically suppressed
- Continue to be displayed in alert views
- May still require action
Recovery after maintenance windows
What happens when a maintenance window ends
When a maintenance window period ends:
- New alerts are no longer suppressed
- Previously suppressed alerts remain suppressed
- The system does not automatically "catch up" on suppressed notifications
- Suppressed alerts can be reviewed and acted upon as needed
Maintenance windows vs. alert actions
Difference from other alert states
It's important to understand how suppression differs from other alert states:
| Action | Effect on Alert | Notifications | Visibility |
|---|---|---|---|
| Suppress (Maintenance Window) | Marked as suppressed | Not sent | Hidden by default |
| Acknowledge | Marked as acknowledged | Not sent for updates | Visible |
| Shelve | Marked as shelved | Not sent for updates | Visible but segregated |
| Close | Marked as closed | Not sent for updates | Visible in closed view |
Reporting and analytics
Maintenance windows metrics
ToBeAlert provides metrics and reports on maintenance windows effectiveness:
- Number of alerts suppressed during each maintenance window
- Types of suppressed alerts
- Duration of maintenance windows
- Comparison of alert volume with and without maintenance windows
Compliance and audit
For compliance and audit purposes, the system maintains:
- Complete records of all suppressed alerts
- Maintenance windows creation and modification history
- User actions related to maintenance windows
- Timestamps for all maintenance windows-related activities
Best practices
For effectively managing the impact of maintenance windows on alerts:
- Review suppressed alerts after maintenance to ensure no critical issues were missed
- Be specific with maintenance window parameters to avoid over-suppression
- Document the purpose of each maintenance window for future reference
- Coordinate maintenance windows with team members to ensure awareness
- Use maintenance windows judiciously to maintain the integrity of your alert system