Oracle OSDMC
Infrastructure Health
Switch Persona
SM
Sarah Mitchell
System Architect · Governance Policies
12 Policies Active
› Policies

Governance Policies

Governance Policies
12 active policies govern SLA thresholds, escalation rules, and automated remediation across all personas.

Active Policies

12 Active
PolicyApplies ToThresholdActionStatus
SLA Breach WarningAll WOs<5 breaches/qtrAlert + EscalateActive
Auto-Rollback TriggerSoftware Upgrades>80% failure rateAuto-rollbackActive
Route Failover PolicyNetwork Routes>25ms latencyAuto-rerouteActive
Escalation TimeoutAll Incidents30 min unresolvedNotify L3Active
Maintenance WindowBatch Upgrades02:00–04:00 AMRestrict executionActive
Inventory Sync PolicyDevice InventoryWeeklyAuto-refreshUnder Review
Oracle OSDMC
Work Order Admin
Search work orders…
3
Switch Persona
IS
Issac Mehta
IT Administrator · Software Upgrades & Rollback
2 Pending Approval 1 Failed WO
Home

Dashboard — Work Order Overview

Flow › › › › › › ›
Scheduled Maintenance Window
3 NF-SBC devices running v8.4.0 are overdue for upgrade. WO-2025-4820 failed last night — AI identified a dependency fix. Rollback success rate this week: 98%.
Active WOs
7
3 running · 4 scheduled
Completion Rate
94%
Up 12pts this month
Avg Upgrade Time
8 min
Down from 22 min last week
Rollback Success
98%
2 of 46 needed rollback

Recent Work Orders

1 Failed
WO IDTypeDevicesStatusProgressCreatedETA
WO-2025-4820 Software Upgrade20 NF-SBC Failed
AI rollback ready
 Apr 22Rollback
WO-2025-4818 Software Upgrade8 P-CSCF Completed
Apr 21Done
WO-2025-4815 Config Change4 P-GW Running
Apr 23~14 min
WO-2025-4812 Software Upgrade12 NF-SBC Scheduled
Apr 2304:00 AM
WO-2025-4810 Rollback3 NF-SBC Completed
Apr 22Done · 4 min

AI Recommendations

Dependency gap on 3 devices — pre-load fix before WO-4820 retry. AI fix plan ready.
Schedule NF-SBC batch — optimal window: tonight 02:00–04:00 AM. 0 conflicting WOs.
Version compliance check — 17 of 20 devices are at v8.4.1. AI suggests batch upgrade to v8.5.0.

Recent Notifications

WO-2025-4820 failed on NF-SBC-04
2:13 AM
WO-2025-4818 completed (8 devices)
Yesterday
AI rollback: WO-4810 restored in 4 min
Yesterday
Oracle OSDMC
Work Order Admin
Search work orders…
3
Switch Persona
IS
Issac Mehta
IT Administrator · Software Upgrades & Rollback
New Work Order
› Create Work Order

Step 1 — Select Work Order Template

Flow › › › › › › ›
AI Work Order Recommendation
AI suggests grouping 3 NF-SBC devices into a single coordinated WO. Estimated completion: 4h 20min. Risk score: Low (12%).
Software Upgrade
Batch device firmware update
AI Recommended

Pre-loaded MOP · Auto-rollback · Batch execution across all selected devices

NF-SBC P-CSCF P-GW
Selected
Rollback
Revert to previous version

Instant snapshot-based rollback with AI root cause identification

Any Device AI-guided
Config Change
Push configuration update

CLI-free config deployment with live progress tracking and diff view

P-GW Border Router

Work Order Details

Oracle OSDMC
Work Order Admin
Search work orders…
3
Switch Persona
IS
Issac Mehta
IT Administrator · Software Upgrades & Rollback
AI Auto-selected 20 Devices
› › Device Selection

Step 2 — AI Device Selection

Flow › › › › › › ›
AI Device Pre-screening Complete
14 of 17 devices passed pre-flight checks. 3 flagged: NF-SBC-02 (low disk), NF-SBC-07 (config drift), NF-SBC-11 (pending reboot).
Total Scanned
127
Real-time ping · all reachable
AI-Selected
20
Require upgrade to v8.5.0
Dep Check
17
Passed all dependency checks
Needs Review
3
Version mismatch detected
3 Devices Flagged — Version Mismatch
NF-SBC-002 (v8.4.0), NF-SBC-004 (v8.3.9), NF-SBC-011 (v8.3.8) have incompatible base versions. AI recommends a pre-upgrade patch before batch execution. Apply AI fix →

AI-Selected Devices (20 of 127)

17 Ready 3 Flagged
Device IDHostnameCurrent Ver.AI StatusRiskDependencyLocation
NF-SBC-001nfsbc-east-01v8.4.1ValidatedLowPassEast · Rack-A
NF-SBC-002nfsbc-east-02v8.4.0MismatchMedReviewEast · Rack-A
NF-SBC-003nfsbc-east-03v8.4.1ValidatedLowPassEast · Rack-B
NF-SBC-004nfsbc-east-04v8.3.9High RiskHighFailEast · Rack-B
NF-SBC-005nfsbc-east-05v8.4.1ValidatedLowPassEast · Rack-C
NF-SBC-006nfsbc-east-06v8.4.1ValidatedLowPassWest · Rack-A
+ 14 more devices selected · all validated by AI
AI scanned all 127 devices in real-time · Inventory auto-refreshed · 0 manual checks required

Version Distribution

v8.4.1 (target-ready)17 devices
v8.4.0 (minor gap)2 devices
v8.3.9 or lower1 device

Dependency Status

libnfsbc-core.so.8.5
Present
nfsbc-config-v850
Present
libnfsbc-audio.so.8.5 (missing on 3 devices)
Gap
Oracle OSDMC
Work Order Admin
Search work orders…
3
Switch Persona
IS
Issac Mehta
IT Administrator · Software Upgrades & Rollback
Configuring Upgrade
› › Configure

Step 3 — Configure Upgrade Settings

Flow › › › › › › ›
AI Configuration Validation
AI pre-validated upgrade parameters against v8.5.0 release notes. 2 compatibility warnings detected — review before proceeding.

Upgrade Configuration

AI auto-filled
Enable auto-commit on successful upgrade
System will automatically commit all device changes without manual confirmation
AI-powered stakeholder notifications
Alert Devika, Sarah, and Adam at key milestones automatically
Pre-upgrade dependency validation
AI will check all dependency packages before execution begins

Maintenance Window

AI Window Recommendation
02:00–04:00 AM has 0 conflicting WOs, lowest traffic volume (12% of peak), and highest historical upgrade success rate (99.1%) based on 14 prior upgrades.

MOP Steps Preview

18 Steps · AI-loaded
1. Pre-upgrade health check
Auto · 30s
2. Create rollback snapshot
Auto · 1 min
3. Dependency validation
Auto · 45s
4. Download firmware package
Auto · 2 min
5–16. Staged deployment & validation (12 steps)
Batch auto
17. Post-upgrade verification
Auto
18. Auto-commit + stakeholder notify
Auto · Instant

Execution Estimate

Batch Est. Time
~10 min
vs 700 min sequential mode
Devices in Batch
20
17 ready · 3 need pre-patch
MOP Steps
18
All pre-validated by AI
Rollback Armed
Ready
Snapshot pre-armed · 20 devices
Auto-commit Rollback armed AI monitoring
Oracle OSDMC
Work Order Admin
1
Switch Persona
IS
Issac Mehta
IT Administrator · Software Upgrades & Rollback
Running · 13 of 20 Done
› WO-2025-4821 › Execution

WO-2025-4821 — Batch Upgrade · 20 NF-SBC Devices

Flow › › › › › › ›
Live Upgrade In Progress — Do Not Navigate Away
Upgrade executing on 14 devices. AI monitoring latency, rollback triggers and step completion in real time. Auto-rollback armed.
Completed
13
of 20 devices upgraded
In Progress
5
Parallel batch running
Queued
2
Await current batch slot
ETA Complete
~4 min
On schedule · no anomalies

Overall Batch Progress

AI-controlled batch
65% Complete 13 / 20 devices
NF-SBC-001 → 004 (4 devices)
Done · 6 min
NF-SBC-005 → 013 (9 devices)
Done · 8 min
NF-SBC-014 → 018 (5 upgrading)
~3 min left

Device Status — Live

NF-SBC-001
v8.5.0 · Done · 5m 42s
Upgraded
NF-SBC-002
v8.5.0 · Done · 6m 18s
Upgraded
NF-SBC-003
v8.5.0 · Done · 5m 55s
Upgraded
NF-SBC-014
Step 11 of 18 · AI-guided
Running
NF-SBC-015
Step 9 of 18 · AI-guided
Running
NF-SBC-019
Queued · ~4 min
Queued
NF-SBC-020
Queued · ~4 min
Queued

AI Execution Log — Live

02:14:22 [AI-BATCH] Parallel exec: 5 active · dep check: PASS
02:14:28 [INFO] NF-SBC-014 pkg push complete · validating…
02:14:30 [AI] Step 11 complete · no anomalies detected
02:14:35 [INFO] NF-SBC-015 step 9 · throughput OK
02:14:38 [INFO] NF-SBC-014 step 12 starting…
02:14:40 [AI] Latency spike 38ms on NF-SBC-015 · transient · no action
02:14:42 [INFO] Latency normalized 12ms · continuing
02:14:44 [AI] All 5 running devices nominal · ETA 4 min

Notifications Sent

Devika notified Sarah notified Adam — pending
Auto-notify on completion & any failure
Oracle OSDMC
Work Order Admin
5
Switch Persona
IS
Issac Mehta
IT Administrator · Software Upgrades & Rollback
3 Devices Failed AI Rollback Active
› WO-2025-4820 › AI Rollback

AI Auto-Rollback — WO-2025-4820

Flow › › › › › › ›
Upgrade Failure — 3 Devices · AI Rollback Initiated
NF-SBC-02, NF-SBC-04, NF-SBC-11 encountered fatal errors at step 4. Rollback initiated automatically. Estimated completion: 8 min.

Rollback Progress

In Progress
67%
2 of 3 devices restored
NF-SBC-02 restored → v8.4.1
02:14 · 2m
NF-SBC-04 restored → v8.4.1
02:15 · 2m
NF-SBC-11 restoring… AI in control
~45s
Issac notified Devika notified Sarah notified

AI Root Cause Analysis

AI
Missing Dependency
libnfsbc-audio.so.8.5 was absent on NF-SBC-02, 04, 11. Root cause: stale device inventory (last synced Jan 15). Confidence: 94%.
Error Pattern Match
This exact failure was seen on 2 previous WOs (WO-4790, WO-4801). AI has pre-loaded a permanent fix plan to prevent recurrence.
AI Fix Plan Ready
1. Refresh inventory sync (live ping). 2. Pre-install missing package on flagged devices. 3. Re-run upgrade with updated dep check. Estimated retry time: 8 min.

Rollback vs Manual

AI Rollback Time
4 min
Fully automated · no CLI
Devices Rolled Back
3
of 20 affected · others retained
Devices Stable
17
Upgrade retained successfully
SLA Impact
None
0ms user-visible degradation
Rollback success rate98%
98% auto-resolved by AI
Detection time38 seconds
38 seconds · AI root-cause scan
02:13:58 [AI] Log scan complete · root cause: dep mismatch · conf 94%
02:14:01 [AI-ROLLBACK] Restoring NF-SBC-02 from snapshot…
02:14:48 [AI-ROLLBACK] NF-SBC-02 restored · health check PASS
Oracle OSDMC
Work Order Admin
Switch Persona
IS
Issac Mehta
IT Administrator · Software Upgrades & Rollback
Upgrade Complete
› WO-2025-4821 › Completion

WO-2025-4821 — Upgrade Complete

Flow › › › › › › ›
Upgrade Complete — 11 of 14 Devices Successful
3 devices auto-rolled back to v8.4.0. Remaining 11 now running v8.5.0. No service impact detected.
Upgrade Successfully Completed
All 20 NF-SBC devices upgraded to v8.5.0 · Auto-committed · Stakeholders notified
20 Devices Upgraded 8 min Total Time 0 Manual Actions

Execution Summary

Total Duration
8 min
12 min under estimate
Devices Upgraded
20 / 20
100% batch success
Version
v8.5.0
All NF-SBC at target version
Post-upgrade Latency
11ms
SLA target: <25ms
StageDurationStatus
Pre-checks & snapshot1m 45sAuto
Batch firmware push5m 12sAuto
Post-upgrade validation48sAuto
Auto-commit5sAI
Stakeholder notificationsInstantAI

Notifications Sent

Devika Kumar — WO-4821 complete, all devices at v8.5.0
Now
Sarah Mitchell — 20 NF-SBC upgraded, network health nominal
Now
Adam (Admin) — WO-4821 closed, SLA impact: none
Now

All Devices — v8.5.0

100% Success
NF-SBC-001 — 005
v8.5.0 · East Rack A/B
Verified
NF-SBC-006 — 010
v8.5.0 · West Rack A
Verified
NF-SBC-011 — 015
v8.5.0 · North Rack
Verified
NF-SBC-016 — 020
v8.5.0 · South Rack
Verified
Auto-Committed
System auto-committed all 20 device upgrades at 02:22:14 AM. Rollback window: 72 hours. Audit log saved.
Oracle OSDMC
Work Order Admin
Search work orders…
Switch Persona
IS
Issac Mehta
IT Administrator · Software Upgrades & Rollback
46 WOs · Last 90 Days
› Upgrade History

Upgrade History & Audit Log

Flow › › › › › › ›
AI Upgrade Trend Insight
Rollback rate improved from 18% to 6% over last 90 days. AI recommends scheduling v8.5.1 maintenance window in 14 days.
Total WOs
46
This quarter · all types
Success Rate
94.8%
Up 8pts vs last quarter
Avg Duration
8.3 min
Trending down week-on-week
AI Rollbacks
6
All resolved auto · 0 manual

Work Order History

WO IDTypeTarget VersionDevicesStatusDurationDateRollback?Actions
WO-2025-4821SW Upgradev8.4.1 → v8.5.020 NF-SBCCompleted8 minApr 23No
WO-2025-4820SW Upgradev8.4.1 → v8.5.020 NF-SBCRolled Back12 minApr 22AI Auto
WO-2025-4818SW Upgradev8.3.0 → v8.4.18 P-CSCFCompleted7 minApr 21No
WO-2025-4812Config ChangeConfig v3.1.44 P-GWCompleted5 minApr 19No
WO-2025-4800SW Upgradev8.2.5 → v8.4.015 NF-SBCCompleted10 minApr 15No
Oracle OSDMC
Work Order Admin
Search work orders…
Switch Persona
IS
Issac Mehta
IT Administrator · Device Inventory
127 Devices Tracked
› Device Inventory

Device Inventory

Device Inventory — AI Auto-Synced
127 devices tracked across all racks. Inventory refreshes automatically every 6 hours; last sync 22 minutes ago.
TOTAL DEVICES
127
Across 3 racks · 2 sites
UP TO DATE
108
On target version
NEEDS UPGRADE
17
2+ versions behind
FLAGGED
2
Dependency gaps

All Devices

127 total
Device IDTypeVersionLocationLast UpgradedStatus
NF-SBC-001Session Borderv8.4.1East · Rack-ATodayCurrent
NF-SBC-007Session Borderv8.3.1East · Rack-B45 days agoBehind
P-CSCF-01SIP Proxyv8.4.1West · Rack-ATodayCurrent
P-GW-01Gatewayv3.1.4East · Rack-CTodayCurrent
P-CSCF-03SIP Proxyv8.3.1West · Rack-B92 days agoCritical
+ 122 more devices ·
Oracle OSDMC
Work Order Admin
Search work orders…
Switch Persona
IS
Issac Mehta
IT Administrator · Version Compliance
3 Non-Compliant
› Compliance

Version Compliance

3 Devices Non-Compliant
3 devices are 2+ major versions behind policy and require a security patch. AI has pre-staged upgrade plans for all 3.
COMPLIANCE RATE
97.6%
124 of 127 devices
NON-COMPLIANT
3
Security patch needed
AVG DAYS TO PATCH
4.2
Down from 12 last qtr

Version Distribution

v8.4.1 (target)108 devices
v8.4.0 (minor gap)16 devices
v8.3.x or lower3 devices

Non-Compliant Devices

DeviceVersionDays Overdue
NF-SBC-007v8.3.145
NF-SBC-011v8.3.838
P-CSCF-03v8.3.192
Oracle OSDMC
Work Order Admin
Search work orders…
Switch Persona
IS
Issac Mehta
IT Administrator · AI Insights
2 New Insights
› AI Insights

AI Insights

2 New AI Insights
AI has surfaced 2 new patterns from analyzing 46 work orders this quarter. Review below.

Pattern Insights

AI-generated
Dependency gaps cause 60% of failures
3 of last 5 failed upgrades traced to stale device inventory data. Devices last synced >14 days ago fail 4x more often.
Batch upgrades outperform sequential
Grouped batch upgrades complete 3.2x faster than one-at-a-time execution, with equal rollback safety (98% success rate either way).

Trend Summary

Rollback Rate6% (was 18%)
Avg Upgrade Time8 min (was 22 min)
AI Auto-fix Adoption82% of eligible WOs
Based on 46 work orders analyzed over the last 90 days.
Oracle OSDMC
Work Order Admin
Search work orders…
Switch Persona
IS
Issac Mehta
IT Administrator · Reports
8 Reports Available
› Reports

Reports

Reports Center
Generate, schedule, or download reports covering work orders, compliance, and upgrade performance.

Available Reports

8 reports
ReportPeriodLast GeneratedFormat
Upgrade SummaryQ2 2025TodayPDF
Compliance ReportQ2 2025TodayPDF
Rollback AnalysisLast 90 daysYesterdayCSV
Device Inventory ExportCurrent2 days agoCSV
SLA PerformanceQ2 20253 days agoPDF
Oracle OSDMC
NOC Console
Search work orders…
5
Switch Persona
DK
Devika Kumar
NOC Specialist · Shift Lead · Night Shift 00:00–08:00
3 Critical 5 Pending Review 24 Completed Today
Home

NOC Dashboard — Live Work Order Monitor

Flow › › › › ›
NOC Alert: Critical WO Requires Attention
WO-2025-4820 upgrade failed — AI rollback 67% complete. 3 devices offline. SLA breach risk in 22 min.
Active WOs
7
2 critical · 3 normal · 2 scheduled
Completion Rate
94%
+4pts vs last 7 days
Avg MTTR
10 min
Improving · SLA target 30 min
SLA Breaches
4
This quarter · target <5

Work Order Queue

1 Failed 2 Running
WO IDTypeAssignedDevicesStatusProgressETAAction
WO-4820SW UpgradeIssac/Devika20 NF-SBCFailed
Rollback 4m
WO-4815Config ChangeDevika4 P-GWRunning
~14 min
WO-4809Route UpdateRick/Devika6 EdgeCompleted
Done
WO-4812SW UpgradeIssac/Devika12 NF-SBCScheduled
04:00 AM
WO-4819RollbackDevika3 NF-SBCPending Review
Awaiting

AI Quick Insights

AI
WO-4820 rollback 67% done · NF-SBC-11 remaining
Live
WO-4812 scheduled 04:00 AM · pre-check recommended
In 1.5h
No SLA breaches active · system healthy
Now

Team Notifications

Issac — WO-4820 failed, AI rollback active
02:13
Sarah — WO-4818 complete, all devices v8.4.1
Yesterday
AI rollback WO-4810 finished in 4 min
Yesterday
Oracle OSDMC
NOC Console
3
Switch Persona
DK
Devika Kumar
NOC Specialist · Work Order Execution
WO-4820 Rollback ActiveWO-4815 Running
› WO-2025-4815

WO-2025-4815 — Config Change · P-GW Nodes

Flow › › › › ›
AI Work Order Analysis
WO-2025-4820 has 3 failed steps across 3 devices. AI identified root cause: dependency mismatch on libssl 1.1.4. Patch available.

Work Order Details

Device Status

P-GW-01
Config patched · v3.1.4 · Verified
Done
P-GW-02
Config patched · v3.1.4 · Verified
Done
P-GW-03
Step 6 · Uploading patch · AI-guided
Running
P-GW-04
Queued · ~8 min
Queued
2 of 4 complete · 55% overall

Live Execution Log

AI Monitoring
02:52:41 [INFO] Connecting to P-GW-03 (10.48.1.3)…
02:52:42 [INFO] SSH session established · authenticating…
02:52:43 [INFO] Uploading config patch v3.1.4…
02:52:45 [INFO] Config applied · running validation…
02:52:46 [WARN] Minor latency spike 38ms · monitoring…
02:52:48 [INFO] Latency normalized 12ms · proceeding…
02:52:50 [AI] No anomalies · latency transient · safe to continue
02:52:52 [INFO] Step 6 in progress · monitoring P-GW-03…
Oracle OSDMC
NOC Console
2
Switch Persona
DK
Devika Kumar
NOC Specialist · Work Order Execution
WO-4820 Rollback ActiveWO-4815 Running
› › Steps

WO-4815 — Execution Steps · P-GW Config Change

Flow › › › › ›
Step 6 of 11 Running — P-GW-03 Latency Spike Settled
A brief latency spike (38ms) on P-GW-03 at 02:52:46 settled to 12ms within 2 seconds. AI is monitoring the patch push and will continue unless a threshold is crossed. Auto-rollback stays armed at the 80% threshold.

Execution Steps — All Devices

5 of 11 steps completeStarted 02:44:42Last update 02:52:52All times 24-hour
  1. Completed
    1. Pre-check validation
    All 4 P-GW devices: connectivity, version, health
    Took 28s
    Finished at 02:45:10
  2. Completed
    2. Backup current config
    Snapshot created on all devices
    Took 52s
    Finished at 02:46:02
  3. Completed
    3. Isolate from live traffic
    Graceful traffic drain, 0 dropped calls
    Took 43s
    Finished at 02:46:45
  4. Completed
    4. Push config patch to P-GW-01
    v3.1.4 applied, QoS rules enabled
    Took 1m 26s
    Finished at 02:48:11
  5. Completed
    5. Validate P-GW-01 & P-GW-02
    Latency 12ms, 0% loss, VoLTE active
    Took 1m 19s
    Finished at 02:49:30
  6. In progress
    6. Push config patch to P-GW-03
    Latency back to normal, AI is monitoring
    Started 02:52:41About 80s left
    Running 11s
    Expected ~02:54:11
  7. Pending
    7. Validate P-GW-03 connectivity
    Not started
  8. Pending
    8. Push config patch to P-GW-04
    Not started
  9. Pending
    9. Validate all 4 devices
    Not started
  10. Pending
    10. Restore traffic routing
    Not started
  11. Pending
    11. Auto-commit and notify stakeholders AI
    Not started

Live Metrics — P-GW-03

CPU38%
Latency12ms
Packet Loss0%
AI Verdict
Latency spike at 02:52:46 was transient (38ms → 12ms in 2s). Matches known config-push pattern from 8 prior WOs. Safe to continue.

Auto-Notifications

Rick — Step 4 complete, P-GW-01 patched
Sent
Issac — WO progress: 5 of 11 steps done
Sent
Sarah — On completion (auto)
Pending
Oracle OSDMC
NOC Console
5
Switch Persona
DK
Devika Kumar
NOC Specialist · Work Order Execution
WO-4820 Rollback ActiveWO-4815 Running
› WO-4820 › AI Failure Triage

AI Failure Triage — WO-2025-4820

Flow › › › › ›
3 Devices Failed — AI Triage In Progress
NF-SBC-02, NF-SBC-04, NF-SBC-11 failed at Step 4. AI correlating logs and isolating root cause. Rollback 67% complete.

Error Summary

NF-SBC-02
Missing dep · Step 7 fail
Rollback
NF-SBC-04
Version mismatch · Step 7
Restored
NF-SBC-11
Dep conflict · Step 7
Restoring
17 other devices All Succeeded

AI Root Cause

AI
Missing Package
libnfsbc-audio.so.8.5 absent on 3 devices. Stale inventory (last sync: Jan 15). Confidence: 94%.
Pattern Detected
Same failure on WO-4790 & WO-4801. AI has prepared a permanent fix to prevent recurrence.

AI Fix Plan

Ready
1. Refresh inventory (live ping)
Auto
2. Install missing package on 3 devices
Auto
3. Re-run upgrade (dep check first)
Auto
4. Update inventory schedule (weekly)
Permanent fix

AI-Analysed Log — Key Entries

02:13:47 [ERROR] NF-SBC-02: pkg push failed — libnfsbc-audio.so.8.5 NOT FOUND
02:13:47 [ERROR] NF-SBC-04: version incompatibility at step 7
02:13:58 [AI-SCAN] Root cause identified: missing dependency · confidence 94%
02:14:01 [AI-ROLLBACK] Initiating snapshot restore on 3 devices…
02:14:48 [AI-ROLLBACK] NF-SBC-02 restored to v8.4.1 · health check PASS
Oracle OSDMC
NOC Console
5
Switch Persona
DK
Devika Kumar
NOC Specialist · Work Order Execution
WO-4820 Rollback ActiveWO-4815 Running
› WO-4820 › Escalate

Escalate Issue — WO-2025-4820

Flow › › › › ›
Escalation Active — Awaiting L3 Engineer Response
Incident escalated to L3 Network Engineering. SLA breach in 8 min. AI has pre-staged rollback config and notified on-call team.

Escalation Form

AI_Triage_WO4820.pdf Auto-attached

Escalation History

WO-4790 — Escalated to Issac · resolved in 22 min
Apr 15
WO-4801 — Escalated to Issac · AI resolved before response
Apr 19
8 of 10 escalations resolved by AI before manual action
Last 30d

Stakeholder Availability

IS
Issac Mehta
IT Admin · Online
Available
SM
Sarah Mitchell
Architect · On-call
On-call
AD
Adam (Admin)
Admin · Away
Away
Oracle OSDMC
NOC Console
Switch Persona
DK
Devika Kumar
NOC Specialist · Work Order Execution
WO-4820 Rollback ActiveWO-4815 Running
› WO-4815 › Complete

WO-2025-4815 — Successfully Closed

Flow › › › › ›
Work Order Resolved — Rollback Successful
All 3 failed devices rolled back to v8.4.0. No active service impact. Post-mortem report auto-generated.
Config Change Complete
4 P-GW nodes patched to v3.1.4 · VoLTE QoS active · All stakeholders notified
11 Steps · AI-guided 14 min total 0 escalations

Closure Summary

Execution Time
14 min
6 min under estimate
Devices Patched
4 / 4
All P-GW nodes completed
Post-patch Latency
14ms
VoLTE traffic nominal
SLA Impact
None
0 dropped calls during patch
Auto-Committed by AI
All P-GW config changes committed. Rollback window: 48h. Audit entry saved automatically.

Notifications Sent

Rick — Route config active, call flows updated
Now
Sarah — P-GW patched, network health: nominal
Now
Adam — WO-4815 closed, SLA impact: none
Now
Oracle OSDMC
NOC Console
Switch Persona
DK
Devika Kumar
NOC Specialist · AI Assistant
AI Co-pilot Online
› AI Co-pilot

AI Co-pilot

AI Co-pilot Ready
Ask about any work order, device, or incident. AI has context on all active WOs and historical patterns.

AI Co-pilot Chat

Context: WO-4820, WO-4815
Why did WO-4820 fail and is it safe to retry?
WO-4820 failed because libnfsbc-audio.so.8.5 was missing on 3 devices due to stale inventory data (last synced Jan 15). The AI fix plan refreshes the inventory, installs the missing package, then re-runs the upgrade with a dependency check first. Yes, it's safe to retry once the fix plan completes — confidence is 94%, based on 2 identical prior incidents (WO-4790, WO-4801) that both resolved cleanly this way.
What's the current SLA risk across my shift?
One active risk: WO-4820's rollback needs to finish within 22 minutes to stay inside SLA. Rollback is 67% complete and on pace. No other WOs in your queue are at risk right now.

Suggested Prompts

Recent AI Insights

Pattern detected: 3 of last 5 failures traced to stale device inventory. Suggest weekly auto-sync.
Trend: Escalation rate down 18% this month vs last — AI auto-fix adoption up.
Oracle OSDMC
NOC Console
Switch Persona
DK
Devika Kumar
NOC Specialist · Performance Analytics
Live Data · Last 30 Days
› Analytics

NOC Performance Analytics

NOC Performance Analytics
Incident response times improved 22% this month. AI-assisted triage now resolves 71% of failures without manual escalation.
AVG RESPONSE TIME
3.2 min
Down 22% this month
AI AUTO-RESOLVED
71%
Of all failures this month
ESCALATION RATE
8%
Down 18% vs last month
INCIDENTS HANDLED
146
Last 30 days

Incidents by Type — Last 30 Days

Incident TypeCountAvg MTTRAI Resolved
Software Upgrade Failure524.1 min78%
Config Change Failure342.8 min82%
Route Degradation283.5 min65%
Dependency Conflict212.2 min90%
Manual Escalation1118 minN/A

Team Performance

Devika Kumar52 WOs · 3.1 min avg
Team Average40 WOs · 3.8 min avg
AI co-pilot usage correlates with 30% faster resolution — teams using suggested fix plans resolve incidents in 2.4 min vs 3.9 min average.
Oracle OSDMC
Route Manager
Search work orders…
2
Switch Persona
RK
Rick Navarro
Network Administrator · Route Manager & Traffic Engineering
2 Anomalies Detected 1 Degraded Route
Home

Route Manager — Network Topology Overview

Flow › › › › ›
Route Anomaly Detected — SLA at Risk
MPLS-TRUNK-07 showing 12% packet loss, 98ms RTT. AI has identified 2 alternate paths with sub-10ms latency.
Total Routes
34
33 healthy · 1 degraded
Degraded Routes
1
MPLS-07 · fiber issue · rerouting
Network Avg Latency
14ms
SLA limit: 25ms
AI CRQ Ready
1
Auto-generated for MPLS-07

Route Table

1 Degraded
Route IDPathTypeLatencyPacket LossStatusAI FlagAction
MPLS-TRUNK-07EAST-GW → CORE-A → WEST-GWMPLS98ms12%DegradedFix Ready
BGP-CORE-01CORE-A → BGP-PEER-1BGP8ms0%Healthy—
MPLS-TRUNK-09EAST-GW → CORE-B → WEST-GWMPLS14ms0%OptimalAlt Path
ISIS-CORE-04NORTH-HUB → CORE-A → SOUTH-GWIS-IS18ms0%Healthy—
OSPF-RING-02EDGE-01 → CORE-A → EDGE-02OSPF21ms0.2%MonitorWatching

AI Recommendations

MPLS-07 degraded — reroute to MPLS-09 recommended. CRQ auto-generated.
OSPF-RING-02 latency trending up 3ms/hour. Monitor or pre-schedule reroute.
28 routes healthy · no SLA risk · next scheduled check in 30s

Recent Changes

CRQ-2025-082 — MPLS-04 rerouted, AI-executed
Apr 22
CRQ-2025-079 — BGP-CORE-03 path updated
Apr 20
CRQ-2025-078 — AI auto-rerouted during SLA risk
Apr 19
Oracle OSDMC
Route Manager
2
Switch Persona
RK
Rick Navarro
Network Administrator · Route Manager & Traffic Engineering
2 Anomalies Detected1 Degraded Route
› MPLS-TRUNK-07

MPLS-TRUNK-07 — Degraded Route Detail

Flow › › › › ›
SLA Breach Risk — Latency 98ms · SLA Max: 25ms
MPLS-TRUNK-07 degraded. AI recommends immediate failover to PATH-ALT-03 (8ms RTT, 0% loss). Change request can be auto-generated.
Current Latency
98ms
SLA breach · target <25ms
Packet Loss
12%
Fiber degradation detected
24h Uptime
94.2%
Below 99% SLA threshold
AI Confidence
96%
MPLS-09 reroute recommended

Current Path — Degraded

EAST-GW-01
→
CORE-A (98ms)
→
MPLS-07 [X]
→
WEST-GW-02
12% Packet Loss on MPLS-07 Link
Congestion at CORE-A. Detected at 01:47 AM. AI root cause: fiber link degradation, traffic spike in east cluster.

AI Suggested Path

Optimal
EAST-GW-01
→
CORE-B (14ms)
→
MPLS-09 [OK]
→
WEST-GW-02
14ms · 0% Loss · SLA Safe
MPLS-09 via CORE-B. No conflicts. Capacity headroom: 68%. Same endpoint pair — 0 disruption to VoLTE calls during switch.

Latency History — Last 24h (MPLS-TRUNK-07)

00:0006:0012:0018:0001:47 → NOW
Oracle OSDMC
Route Manager
2
Switch Persona
RK
Rick Navarro
Network Administrator · Route Manager & Traffic Engineering
2 Anomalies Detected1 Degraded Route
› › AI Suggestion

AI Path Optimisation — MPLS-TRUNK-07

Flow › › › › ›
AI Path Recommendation Ready
AI analysed 6 candidate paths. Top pick: PATH-ALT-03 — 8ms RTT, 99.98% reliability, 0 congested hops.
CURRENT PATH — DEGRADED
EAST-GW-01
→
CORE-A
→
MPLS-07
→
WEST-GW-02
Latency
98ms
Pkt Loss
12%
AI RECOMMENDED PATH
EAST-GW-01
→
CORE-B
→
MPLS-09
→
WEST-GW-02
Latency
14ms
Pkt Loss
0%
ALT PATH — OPTION B
EAST-GW-01
→
CORE-C
→
MPLS-11
→
WEST-GW-02
Latency
22ms
Pkt Loss
0.1%

AI Analysis — Why MPLS-09 is Best

No call disruption
Same endpoints — VoLTE sessions survive intact
68% capacity headroom
Will absorb full MPLS-07 traffic without congestion
Historical reliability
MPLS-09 has 99.98% uptime last 90 days
AI confidence in recommendation
96%
Oracle OSDMC
Route Manager
2
Switch Persona
RK
Rick Navarro
Network Administrator · Route Manager & Traffic Engineering
2 Anomalies Detected1 Degraded Route
› Change Request

Change Request — CRQ-2025-083 (AI Auto-generated)

Flow › › › › ›
AI Change Request Pre-populated
CR-2025-881 auto-generated from AI path analysis. Risk score: Low (8%). Est. approval time: 4 hours.

Change Request Details

AI auto-filled
Devika Issac Sarah Adam

Path Change Summary

From (current)
EAST-GW-01
→
CORE-A
→
MPLS-07 [X]
→
WEST-GW-02
To (AI recommended)
EAST-GW-01
→
CORE-B
→
MPLS-09 [OK]
→
WEST-GW-02
Current Latency
98ms
MPLS-07 degraded
Target Latency
14ms
Via MPLS-09 reroute
Packet Loss
12%
Will resolve to 0% on switch
Switch Duration
~55s
Zero call disruption · same endpoints

Time Saved by AI

Manual CRQ creation ~8 hours
AI auto-generation < 5 min
98% time reduction
Oracle OSDMC
Route Manager
1
Switch Persona
RK
Rick Navarro
Network Administrator · Route Manager & Traffic Engineering
2 Anomalies Detected1 Degraded Route
› CRQ-2025-083 › Approval

CRQ-2025-083 — Approval & Execution

Flow › › › › ›
Change Approval In Progress — Awaiting 2 Approvers
CR-2025-881 pending sign-off from Network Architecture and Change Advisory Board. AI compliance pre-check: Passed.

Approval Status

RK
Rick Navarro
Network Admin · Initiator
Pending
SM
Sarah Mitchell
System Architect · Approver 2
Approved
1 Approval Remaining — Rick
Sarah approved 2 min ago

Execution Plan

1. Traffic analysis snapshot
Auto · 5s
2. Pre-configure MPLS-09 headroom
Auto · 10s
3. Graceful traffic drain from MPLS-07
Auto · 20s
4. Redirect traffic → MPLS-09
Auto · 5s
5. AI verify new path metrics
Auto · 15s
6. Auto-commit + notify stakeholders
Auto · instant

Live Route Metrics — Awaiting Execution

MPLS-07 Latency
98ms
SLA breach · degrading
MPLS-09 Latency
14ms
Stable · ready to absorb traffic
MPLS-09 Capacity
68%
32% headroom · safe to switch
Est. Switch Time
~55s
AI-automated · no downtime
Oracle OSDMC
Route Manager
Switch Persona
RK
Rick Navarro
Network Administrator · Route Manager & Traffic Engineering
2 Anomalies Detected1 Degraded Route
› CRQ-2025-083 › Committed

CRQ-2025-083 — Route Successfully Committed

Flow › › › › ›
Route Change Committed — Traffic Restored
MPLS-TRUNK-07 rerouted to PATH-ALT-03. Latency: 7ms. Packet loss: 0%. SLA compliance restored.
Route Change Committed
MPLS-07 → MPLS-09 reroute complete · 55 seconds total · 0 dropped calls
Latency: 14ms Loss: 0% SLA: Met

Route Execution Log

Traffic snapshot taken · 5s
02:31:02
MPLS-09 headroom confirmed · 68%
02:31:12
Traffic drained from MPLS-07 · 0 drops
02:31:32
Traffic redirected → MPLS-09
02:31:37
AI verified: 14ms · 0% loss · SLA met
02:31:52
Auto-committed · all stakeholders notified
02:31:57

Post-Switch Metrics

New Latency
14ms
SLA restored · <25ms target
Packet Loss
0%
Eliminated on reroute
Switch Duration
55s
0 dropped calls · seamless
MPLS-09 Utilisation
74%
26% remaining headroom
SLA Compliance Restored
All traffic now meeting 25ms SLA threshold. MPLS-07 flagged for repair. Auto-revert scheduled on fiber restoration.

Notifications Sent

Devika — MPLS-07 rerouted, SLA restored
Now
Sarah — Latency 14ms, infrastructure healthy
Now
Issac — Network routing updated, SLA met
Now
Adam — CRQ-083 complete, no SLA breach
Now
Oracle OSDMC
Route Manager
Switch Persona
RK
Rick Navarro
Network Administrator · Topology View
34 Routes Monitored
› Topology

Network Topology

Network Topology — Live View
34 routes monitored across 12 nodes. 1 route degraded (MPLS-TRUNK-07) — AI rerouting active via MPLS-09.
TOTAL NODES
12
All reachable
HEALTHY ROUTES
33
of 34 total
DEGRADED
1
MPLS-TRUNK-07
AVG LATENCY
14ms
Network-wide

Topology Map — Core Network

Live
EAST
GW-01
→
CORE-A
98ms
✕
MPLS
07
→
WEST
GW-02
Healthy Degraded Rerouting

All Network Nodes

NodeTypeConnectionsStatusLatency
EAST-GW-01Gateway4Healthy8ms
CORE-ACore Router6Degraded98ms
CORE-BCore Router6Healthy9ms
WEST-GW-02Gateway4Healthy7ms
MPLS-09Transport3Healthy14ms
Oracle OSDMC
Route Manager
Switch Persona
RK
Rick Navarro
Network Administrator · Anomaly Detection
1 Active Anomaly
› Anomalies

Network Anomaly Detection

1 Active Anomaly Detected
AI continuously scans all 34 routes for latency spikes, packet loss, and traffic pattern deviations. 1 anomaly currently requires attention.
ACTIVE ANOMALIES
1
MPLS-TRUNK-07
RESOLVED THIS WEEK
7
All auto-resolved
AI DETECTION RATE
96%
Before SLA impact

Detected Anomalies

1 Active
Route / NodeAnomaly TypeDetectedConfidenceStatus
MPLS-TRUNK-07 Packet loss spike (12%) 01:47 AM 96% Active
OSPF-RING-02 Latency drift (+3ms/wk) Yesterday 87% Monitoring
BGP-CORE-03 Route flap (resolved) 2 days ago 99% Resolved
ISIS-CORE-04 Traffic burst (resolved) 3 days ago 91% Resolved
Oracle OSDMC
Infrastructure Health
Search work orders…
2
Switch Persona
SM
Sarah Mitchell
System Architect · Infrastructure Oversight & SLA Governance
Network: Nominal 1 Anomaly Last refresh: 30s ago
Home

Infrastructure Health Dashboard

AI Infrastructure Health Summary
Overall health score: 94/100. 2 nodes flagged for proactive maintenance. No SLA risk predicted in next 72 hours.
Network Uptime
99.2%
SLA target: 99% · on track
SLA Compliance
96%
Exceeding 99% SLA target
Avg MTTR
10 min
SLA target: <30 min · met
SLA Breaches
4
Q2 YTD · target <5 / qtr

System Component Health

Live
ComponentTypeCountHealthLatencyUptimeLast UpgradedStatus
NF-SBCSession Border20
11ms99.8%Today · AIHealthy
P-CSCFSIP Proxy8
9ms100%Apr 21Healthy
P-GWGateway4
14ms99.9%Today · AIHealthy
MPLS-07Transport1
98ms94.2%—Rerouting
BGP CoreRouting3
8ms99.97%Apr 20Healthy

AI Proactive Alerts

MPLS-07 fiber degradation · AI rerouting now via MPLS-09 · ETA: 2 min
Now
NF-SBC upgrade WO-4821 complete · all 20 at v8.5.0 · SLA impact: none
02:22
Quarterly SLA on track: 99.2% uptime · target 99%
Today

SLA Status — Live

99.2%
Network Uptime — Q2 2025
Voice calls99.5%
Data throughput98.9%
Network latencySLA Met

Recent Work Orders

WO-4821 — NF-SBC batch upgrade · 8 min
Today
CRQ-083 — MPLS-07 reroute · 55s
Now
WO-4815 — P-GW config patch · 14 min
Today
Oracle OSDMC
Infrastructure Health
1
Switch Persona
SM
Sarah Mitchell
System Architect · Infrastructure Oversight & SLA Governance
Network: Nominal1 Anomaly
› SLA Compliance

SLA Compliance Report — Q2 2025

Q2 2025
Q1 2025
Q4 2024
Full Year
SLA Compliance: 99.94% — Above Target
All service tiers meeting SLA targets this quarter. AI predicts continued compliance for 30 days. 0 active SLA breaches.
Q1 2025 — Baseline Metrics
WO Completion
65%
Q1 2025 performance
Avg MTTR
120 min
Q1 2025 · manual workflow
SLA Breaches/Qtr
23
Q1 2025 · 23 incidents/qtr
User Satisfaction
3.1/5
Q1 2025 user score
Q2 2025 — Current Performance
WO Completion
94%
+29%
MTTR
10 min
−91%
SLA Breaches/Qtr
4
−82%
User Satisfaction
4.7/5
+52%

SLA Metrics — Detailed

AI auto-tracked
SLA MetricTargetQ1 2025Q2 2025ImprovementStatus
WO Completion Rate≥ 90%65%94%+29ppAchieved
Mean Time to Resolution≤ 30 min120 min10 min–91%Achieved
Rollback Success Rate≥ 90%55%98%+43ppAchieved
SLA Breach Incidents / Qtr≤ 5234–82%Achieved
Avg Downtime / Upgrade≤ 15 min45 min8 min–82%Achieved
User Satisfaction Score≥ 4.0/53.14.7+52%Achieved
Network Uptime≥ 99%97.4%99.2%+1.8ppAchieved
Oracle OSDMC
Infrastructure Health
1
Switch Persona
SM
Sarah Mitchell
System Architect · Infrastructure Oversight & SLA Governance
Network: Nominal1 Anomaly
› AI Predictions

AI Predictive Intelligence — Next 30 Days

AI Predictive Maintenance Alerts
2 nodes flagged for proactive maintenance within 30 days. Scheduling now prevents 94% chance of unplanned outage.
Predicted SLA
99.4%
AI forecast · next 30 days
Devices at Risk
3
Flagged for pre-emptive WO
Routes to Monitor
2
Degradation risk in 7 days
AI Actions Ready
4
Pre-staged · one-click execute

Device Risk Predictions

AI
NF-SBC-007 — Upgrade Recommended
CPU trending: 78% avg (threshold 80%). Historical: 3 similar devices failed at this pattern. Predicted failure: 14–18 days.
High Risk
NF-SBC-013 — Disk Utilisation
Log storage at 91%. Last purge: 28 days ago. Predicted overflow: 7–10 days.
Medium
P-CSCF-03 — Version Drift
Running v8.3.1 · 2 major versions behind · security patch needed.
Medium

Route Risk Predictions

AI
MPLS-TRUNK-04 — Predicted Congestion
Traffic growth: 4.2% per week on this path. Predicted SLA breach in 12–15 days without intervention. AI recommends capacity expansion or pre-emptive reroute plan.
12 days
OSPF-RING-02 — Latency Drift
Latency increasing 3ms/week. Currently 21ms. Will breach 25ms SLA in 18–21 days if unchecked.
18 days

AI Recommended Pre-emptive Actions

Recommended ActionTargetRisk If IgnoredEffortWindowAction
Schedule upgrade WONF-SBC-007High — predicted failureAuto (AI)Next 7 days
Log purge & disk cleanNF-SBC-013Overflow riskAuto (AI)Next 5 days
Capacity expansion planMPLS-04SLA breach in 12dRick reviewNext 10 days
Security patch deployP-CSCF-03Security riskAuto (AI)Next 14 days
Oracle OSDMC
Infrastructure Health
1
Switch Persona
SM
Sarah Mitchell
System Architect · Infrastructure Oversight & SLA Governance
Network: Nominal1 Anomaly
› WO Impact View

Work Order Impact on Infrastructure & SLA

AI Work Order Impact Analysis
AI-assisted WOs show 40% faster resolution and 62% fewer rollbacks vs manual processes this quarter.
WOs This Quarter
46
46 WOs this quarter · AI-managed
Avg Impact Duration
8 min
Per WO · network impact window
SLA Events
4
WO-linked · 1 minor · 3 none
AI Interventions
38
Auto-resolved · 0 escalated

Work Order × SLA Impact Matrix

AI tracked
WO IDTypeExecutorStartDurationDevicesSLA ImpactResolutionRollback?
WO-4821SW UpgradeIssac + AI02:00 AM8 min20 NF-SBCNoneAI autoNo
CRQ-083Route ChangeRick + AI02:31 AM55sMPLS-07NoneAI autoNo
WO-4815Config ChangeDevika + AI02:45 AM14 min4 P-GWNoneAI autoNo
WO-4820SW Upgrade (fail)Issac + AI01:55 AM12 min3 NF-SBCMinor · 38msAI rollbackAI Auto
WO-4818SW UpgradeIssac + AIApr 217 min8 P-CSCFNoneAI autoNo

SLA Uptime vs WO Activity — April 2025

Apr 15Apr 17Apr 19Apr 20Apr 21Apr 22Apr 23 (today)
Uptime ≥99%
Minor impact
WO active, no impact
Oracle OSDMC
Infrastructure Health
Switch Persona
SM
Sarah Mitchell
System Architect · Infrastructure Oversight & SLA Governance
Network: Nominal 1 Anomaly
› Notification Settings

Notification & Alert Preferences

AI Notification Optimisation
AI recommends enabling Predictive Failure Alerts — 3 potential incidents in next 7 days that current rules would miss.

Alert Channels

In-App Notifications
Real-time banner alerts in OSDMC
Email Notifications
s.mitchell@verizon.com
SMS / Text Alerts
Critical only · +1-555-0183
AI Proactive Summaries
Daily digest at 08:00 AM

Alert Thresholds

AI Notification Rules

AI
AI Proactive Alerts
Get alerted before SLA breaches happen
Auto-Rollback Completion Alerts
Notify when AI completes a rollback
Predictive Risk Warnings
7-day advance notice of predicted failures
Route Anomaly Alerts
Alert when AI detects route degradation
Weekly Health Summary
AI-generated every Monday 09:00

Team Notifications

Receive alerts from other team members' activities
Issac — WO Completions
Upgrade & rollback events
Devika — Critical Failures
P1/P2 incidents only
Rick — Route Changes
SLA-impacting changes only