1. NFV Infrastructure Maintenance Automation by OPNFV Doctor

2. Doctor: Fault Notification → Maintenance
Allow APP owner to get VM’s fault and maintenance
notifications from the Cloud Infra

3. Doctor Maintenance Benefits
Fast
Minimize maintenance sequence (pre-steps)
Safe
Handshake between APP Manager and Infra
Flexible
Further steps and policies can be in place

4. Doctor Maintenance PoC: What’s in?
Nova
Tag-notification, versioned (object) notification
service.update notification (disable nova-compute)
Ceilometer/Aodh
Event transformer, Event Alarm
Horizon – instances - Show server tags
Sample Admin Tool
Sample App Manager and Web server (Active-Standby)

5. Doctor Maintenance PoC
App Manager
Floating IP
Nova
Ceilometer/Aodh
VM1
VM2
Compute1
Compute2
Compute3
Admin Tool

6. Doctor Maintenance Sequence
Admin Tool
Nova
Ceilometer/Aodh
App Manager
1. Disable Compute Host
2. “Service Disabled” Message
3. Mark VMs “going_to_maintenance”
7. “VM Update” Message
(“allow_migration” tag)
8. Migrate VM
Perform Further Maintenance Steps
4. “VM Update” Message
(“going_to_maintenance” tag)
6. Tag “allow_migration” on the VM
5. Switch Active
and Standby node

7. Doctor Profiler Total time cost: 472(ms)
==============================================================================>
|Monitor|Inspector |Controller|Notifier|Evaluator |
| | |? |? |? |
| | | | | | | | | |
link down: | | | | | | | | |
raw failure: | | | | | | | |
found affected:? | | | | | | |
set VM error: | | | | | |
marked host down: | | | | |
notified VM error:? | | | |
transformed event:? | | |
evaluated event:? | |
fired alarm:? |
received alarm:472

8. Doctor: How to Setup Infra as an Admin
Nova/Neutron
Make sure Nova/Neutron sends out Notification
Ceilometer/Aodh
Enable Event Transformer
Congress
Set Correlation Rules

9. Doctor: How to Setup Alarm as an User
Nova/Neutron
Create Resource (VM, Port, ...)
Aodh
Create Event Alarm with Resource-ID
OR Create Event Alarm with HOT

10. Doctor: Alarm Example { --- snip --- u'reason_data': {
u'type': u'event',
u'event': {
u'event_type': u'instance.update',
u'traits': [
[u'display_name', 1, u'server1'],
[u'uuid', 1, u'6bf4f683-7a17-44df-a2eb-aaf3c38e6e90'],
[u'service', 1, u'nova-api:controller'],
[u'availability_zone', 1, u'default'],
[u'tenant_id', 1, u'1f5ebf625b95479abc98e3ae85dd3871'],
[u'tags', 1, u"[u'active', u'no_migration', u'retirement', u'retirement2', u'retiremet']"],
[u'display_description', 1, u'server1'],
[u'state', 1, u'active'],
[u'power_state', 1, u'running'],
[u'request_id', 1, u'req-0856f167-07b6-4bf6-9b7e-af0122da4963'],
[u'user_id', 1, u'111c2c5f88cc44eca4e35b16f996932a'],
[u'project_id', 1, u'1f5ebf625b95479abc98e3ae85dd3871'],
[u'metadata', 1, u"{u'metering.stack': u'b890d2db-c9b2-47e5-b6ff-d0136c05eb7b'}"] ],
}}}