1. Using Instant Messaging and Short Message Service for Emergency Text Communications Wonsang Song Jong Yul Kim Henning Schulzrinne Dept. of Computer Science Columbia University Piotr Boni Michael Armstrong Verizon Network and Technology July 2009

2. Agenda General OverviewGeneral Overview –Background –Next Generation 9-1-1 (NG 9-1-1) Technical OverviewTechnical Overview –Prototype Architecture Instant Messaging (IM)Instant Messaging (IM) Short Messaging Service (SMS)Short Messaging Service (SMS) ConclusionConclusion

3. Background Text communications is ubiquitous in the US.Text communications is ubiquitous in the US. –71 million IM users in 2007 Source: comScore –263 million mobile telephone service subscribers 601 billion SMS messages in 2008 (SMS is up 954% from 2005) Source: CTIA – The Wireless Association; FCC. But it is limited in emergency use.But it is limited in emergency use. –Anonymous crime tips in Boston and New York –Text alerts on university campuses Text communications have advantages in emergency situation.Text communications have advantages in emergency situation. –When voice calls are not possible –For speech/hearing impaired

4. Project goals Research methods to integrate IM and SMS into the NG9-1-1 architectureResearch methods to integrate IM and SMS into the NG9-1-1 architecture Investigate ways to maintain a “live session” with the call taker when using IM or SMSInvestigate ways to maintain a “live session” with the call taker when using IM or SMS Verify the approach on a working prototypeVerify the approach on a working prototype

5. NG9-1-1 architecture Emergency Services IP Network (ESInet) Network used by emergency caller to ask for help Examples: PSTN, VoIP, Cellular (SMS), IM Role 1. Determine location of caller 2. Route call to ESInet 3. Protocol conversion 9-1-1 Call Origination Network PSAP SIP Proxy ACD Call Takers Conference Server Emergency Services IP Network (ESInet) Emergency Services Routing Proxy (ESRP) Location-to-Service Translation (LoST) Server IP PSAP A …... PSAP SIP Proxy ACD Call Takers IP PSAP Z … SIP-based network of IP PSAPs managed by the emergency authorities

6. Adding IM to NG9-1-1 9-1-1 IM Network SMS Network (Cellular network) PSAP SIP Proxy ACD Call Takers Conference Server Emergency Services IP Network (ESInet) Emergency Services Routing Proxy (ESRP) Location-to-Service Translation (LoST) Server IP PSAP A …... PSAP SIP Proxy ACD Call Takers IP PSAP Z … Telematics Network VoIP Network PSTN Network

7. Adding IM to NG9-1-1 (1) Problem: Most IM providers use proprietary protocols.Problem: Most IM providers use proprietary protocols. –AOL, Yahoo!, Microsoft Fortunately, providers already use standard protocols such as SIP or XMPP to interconnect IM services.Fortunately, providers already use standard protocols such as SIP or XMPP to interconnect IM services. –Yahoo! and Microsoft use SIP. –AOL and Google use XMPP. Prototype uses SIP MESSAGE method to add IM to NG9-1-1.Prototype uses SIP MESSAGE method to add IM to NG9-1-1.

8. IM client SIP CommunicatorSIP Communicator –Open source, Java-based, VoIP and IM client with SIP presence –Multi-protocol instant messenger SIP, XMPP/Jabber (Google talk), AIM/ICQ, MSN Messenger, Yahoo! Messenger, Bonjour, IRC, RSSSIP, XMPP/Jabber (Google talk), AIM/ICQ, MSN Messenger, Yahoo! Messenger, Bonjour, IRC, RSS –Uses JAIN SIP stack –Based on the OSGi architecture and using the Apache Felix implementation SOS Button Location Button

9. message header fields header fields request line MESSAGE urn:service:sos SIP/2.0 From: ;tag=e778529 To: Route: Geolocation: cid:caller@verizon.com ;inserted-by="caller@verizon.com" Content-Length: 1123 -------------------------- Content-Type: text/plain Help me.. -------------------------- Content-ID: Content-Type: application/pidf+xml US NY New York Amsterdam Ave 1214 10027 Manual PIDF-LO SIP MESSAGE from sender’s UA

10. IM message flow IM Network IM Client PSAP SIP Proxy ACD Call Takers Conference Server Emergency Services IP Network (ESInet) Emergency Services Routing Proxy (ESRP) Location-to-Service Translation (LoST) Server IP PSAP A …... PSAP SIP Proxy ACD Call Takers IP PSAP Z … LoST Server LoST SIP “Burglary!” LoST SIP SIP Proxy Location LLDP-MEDManual Entry

11. Adding IM to NG9-1-1 (2) Problem: Every message from the same ‘session’ should go to the same call taker.Problem: Every message from the same ‘session’ should go to the same call taker. Prototype keeps record of user’s address and destination to deliver messages consistently to one call taker.Prototype keeps record of user’s address and destination to deliver messages consistently to one call taker.

12. Session-keeping mechanisms IM Network SOS IM Client PSAP SIP Proxy ACD Call Takers Conference Server Emergency Services IP Network (ESInet) Emergency Services Routing Proxy (ESRP) Location-to-Service Translation (LoST) Server IP PSAP A …... PSAP SIP Proxy ACD Call Takers IP PSAP Z … LoST Server “Burglary!” - Associate logical session to UI. - Use the initial ESRP URI while chat window is open. - Create logical session and keep using it until call taker closes it. - Create soft state. - Ignore other routing policies such as LoST. - Close the logical session explicitly when conversation is over. SIP Proxy

13. Adding SMS to NG9-1-1 9-1-1 PSAP SIP Proxy ACD Call Takers Conference Server Emergency Services IP Network (ESInet) Emergency Services Routing Proxy (ESRP) Location-to-Service Translation (LoST) Server IP PSAP A …... PSAP SIP Proxy ACD Call Takers IP PSAP Z … Telematics Network VoIP Network PSTN Network SMS Network (Cellular network) IM Network

14. Adding SMS to NG9-1-1 (1) Problem: Location information must be included in emergency messages.Problem: Location information must be included in emergency messages. Location is configured using assisted GPS on cell phones.Location is configured using assisted GPS on cell phones. –This is an example of an endpoint-centric solution. Location is included in the SMS message.Location is included in the SMS message. 26/160 To: 911 Text: Someone in my house. Please send help ASAP. [+40.9625 -73.5684]

15. Adding SMS to NG9-1-1 (2) Problem: SMS and SIP are different protocols.Problem: SMS and SIP are different protocols. Prototype uses SMS gateway to convert SMS to SIP.Prototype uses SMS gateway to convert SMS to SIP.

16. SMS gateway Step1: extract phone number, message, and location Step2: query LoST to resolve the ESRP URI Step3: compose a SIP MESSAGE request (SIP From header: sip: phone number @ IP address of the SMS gateway)

17. SMS GW SMS message flow PSAP SIP Proxy ACD Call Takers Conference Server Emergency Services IP Network (ESInet) Emergency Services Routing Proxy (ESRP) Location-to-Service Translation (LoST) Server IP PSAP A …... PSAP SIP Proxy ACD Call Takers IP PSAP Z … SIP LoST SIP SMSC SMPP Gateway Cellular phone LoST Server “Burglary!” Service Proxy Sybase 365 Location SMS LoST SMS

18. Adding SMS to NG9-1-1 (3) Problem: Every message from the same ‘session’ should go to the same call taker.Problem: Every message from the same ‘session’ should go to the same call taker. Prototype keeps record of the user’s phone number and the destination URL to deliver messages consistently to one call taker.Prototype keeps record of the user’s phone number and the destination URL to deliver messages consistently to one call taker. Call taker has control over the session. The session is released by the call taker.Call taker has control over the session. The session is released by the call taker.

19. SMS GW SMSC SMPP Gateway Session-keeping mechanisms PSAP SIP Proxy ACD Call Takers Conference Server Emergency Services IP Network (ESInet) Emergency Services Routing Proxy (ESRP) Location-to-Service Translation (LoST) Server IP PSAP A …... PSAP SIP Proxy ACD Call Takers IP PSAP Z … Cellular phone LoST Server “Burglary!” - Create soft state - Messages from same sender are routed to the same ESRP - Create logical session and keep using it until call taker closes it. - Create soft state - Ignore other routing policies such as LoST - Close the logical session explicitly when conversation finishes Service Proxy Sybase 365

20. Conclusion IM and SMS communications can be integrated into an IP PSAP using SIP.IM and SMS communications can be integrated into an IP PSAP using SIP. Location can be configured and delivered with the message.Location can be configured and delivered with the message. Messages can be delivered consistently to the same call taker as if it were a “session”.Messages can be delivered consistently to the same call taker as if it were a “session”. –Mechanism within ESInet is the same for IM and SMS. Prototype software developedPrototype software developed –SIP Communicator – modified open source, Java-based VoIP/IM client –Service Proxy a.k.a. HTTP-SIP Gateway as part of the SMS GW functionality –Stateful components in the emergency network

21. Thank you!

22. Backup slides…

23. Two approaches for location Endpoint-centric Solution Location is configured by the endpoint.Location is configured by the endpoint. –A-GPS Location is inserted by the endpoint.Location is inserted by the endpoint. –SMS application We are using this solution.We are using this solution. Network-centric Solution Location is configured by the network.Location is configured by the network. –Mobile Positioning Center (MPC) –Position Determining Equipment (PDE) Location is inserted by the network.Location is inserted by the network. –SMS Gateway

24. Service Proxy a.k.a. HTTP-SIP GW Web application running on Apache Tomcat serverWeb application running on Apache Tomcat server –Jointly developed using Java Servlet API SIP client runs in parallel within the web application.SIP client runs in parallel within the web application. –Developed using JAIN SIP stack FeaturesFeatures –Converts from HTTP to SIP and vice versa –Queries LoST in order to forward message to an appropriate ESRP –Keeps record of phone numbers and destination ESRP for a limited time to maintain session

25. Wireless network message flow

26. How can we start today? IM Network IM Client PSAP SIP Proxy ACD Call Taker Emergency Services IP Network (ESInet) LoST Server IP PSAP Call Taker LoST Server “Burglary!” LLDP-MEDManual Entry TelephoneALI Controller Today’s PSAP IM Call Taker IM Client; preferably SIP-based Verizon dedicated, secure IM server(s) 911 voice calls IM-SIP/SMS-SIP Gateway … Text Message + Location … - Potential SIP conversion point FiOS ONT Box

27. Next steps Propose solutions to standards organizationsPropose solutions to standards organizations Work on sending multimedia messages (MMS) to an IP PSAPWork on sending multimedia messages (MMS) to an IP PSAP Explore how commercial IM networks can be integrated into Emergency NetworkExplore how commercial IM networks can be integrated into Emergency Network –Build or re-use an IM gateway for proprietary protocols