1. Assessing the role of data analytics to deliver innovative spectrum management Tony Harris IEng FIET Regional Director TCI International, Inc. CTO Spectrum Management th September 2018
Company Confidential

2. Data Analytics applied to spectrum management
Data analytics refers to qualitative and quantitative techniques and processes used to enhance productivity and business gain. Data is extracted and categorized to identify and analyse behavioural data and patterns, and techniques vary according to organizational requirements.
What does this mean for spectrum management?
Enhancing productivity and business gain - Increased spectrum efficiency through optimised allocations and assignments and interference-free usage
Working the spectrum harder – it’s a finite resource not to be wasted – sharing and reuse – TV and other white spaces, dynamic spectrum access – obviously with no interference
Identify and analyse behavioural data and patterns in spectrum assignment, licensing and usage for regulators to better know their spectrum users and observe changing trends as input to spectrum planning
Spectrum data analytics driving spectrum efficiency
Company Confidential
August 11, 2019

3. Eyes and ears of spectrum management
Current spectrum monitoring data analysis informs evidence-based spectrum management
Spectrum assignment and spectrum sharing - based on business usage patterns
Spectrum pricing - based on measured congestion levels using channel occupancy data – input to pricing algorithm
Spectrum hoarding – band audits show lack of use – “use it or lose it”
Spectrum quality for auctions, awards - baseline frequency band audits using frequency band occupancy and signal level data – is the spectrum clean?
Spectrum control – processing monitoring data, automatic interference alarms
Spectrum compliance – Automatic Violation Detection (AVD) to determine non-compliance and unlicensed use
Spectrum compliance – real-time, searchable spectrum monitoring and geolocation database, recording and replaying spectrum activity to find signals of interest and interferers and their locations
Eyes and ears of spectrum management
Company Confidential
August 11, 2019

4. Spectrum monitoring database – Ofcom example Web Server screen shots

5. Differing patterns of usage analysed

6. Interference Resolution – Pushbutton DF/Metrics
The Pushbutton DF/Metrics screen consists of seven major display sections. Includes: DF/Metrics Setup, Spectrogram, RX Setup, Polar Histogram, Measurement Results, Tuning Aid, and Map
Company Confidential
August 11, 2019

7. Interference Resolution – Homing DF and Fix
Homing DF and Fix module allowing the quick and efficient “drive down” of the interference source
Company Confidential
August 11, 2019

8. Field Strength Mapping
The Field Strength Mapping feature is used to measure and display field strength across frequencies over a geographical area. This feature can only be used with a mobile station.
Company Confidential
August 11, 2019

9. Hybrid Geolocation
The Hybrid Geolocation allows the operator to perform geolocation measurements using Angle of Arrival (AOA), Time Difference of Arrival (TDOA), or a combination of both AOA and TDOA.
Company Confidential
August 11, 2019

10. Spectrum interference alarms by SMS and email
The Alarm screen allows the operator to create “masks” of the frequency range to be displayed on screen. Masks can be created by the user or by importing an AVD license (*.lic) file. Any frequency that breaks this mask and has DF data will be marked as an offending signal and will thus trigger an alarm.
Company Confidential
August 11, 2019

11. Non-compliant and illegal transmissions – Automatic Violation Detection (AVD)
Automatic Violation Detection (AVD) determines whether a particular transmission is in violation of allowed tolerances of assigned center frequency and bandwidth, as specified in the National Frequency Plan table. AVD can be performed on a single-frequency or on a range of frequencies.
Company Confidential
August 11, 2019

12. Non-compliant and illegal transmissions – Automatic Violation Detection (AVD) Results
The AVD Results Screen shows the results of the frequencies tested and specifies whether they are: Compliant, Non-Compliant, Not Found or Unlicensed. For non-compliant results, the user can determine whether frequency or bandwidth deviation (or both) is being violated and it’s occupancy indication.
Company Confidential
August 11, 2019

13. Automating the COMINT process
Realtime spectrum monitoring database analysis COMINT (Communications Intelligence) example
Realtime RF
Frequency / Bandwidth
Search Live RF or Previous Detections Database
Search / Filter by:
Frequency / Bandwidth
Direction
Modulation
Signal Type
Geolocation
Angle of Arrival (Direction)
Modulation
Signal Type
Location
Detection Database
Signals of Interest
Automated Tasking
Collect
View
Listen
Analyze
Geolocate
Report
Automating the COMINT process
TCI PROPRIETARY
August 11, 2019

14. Automating the COMINT process
Example GUI
Dashboard
Map (LOBs & Geo-Locations)
Spectrogram (Live & Past)
Search Pane
List View
Automating the COMINT process
TCI PROPRIETARY
August 11, 2019

15. With Lookback Collection, never miss a signal
Go back in time and collect signals of interest…
Extracts IQ data from wideband recorder
Can extract while recording in progress
Initiate automatically or manually from List View, Map View or Spectrogram
Wideband Recorder
IQ Extract
IQ File
Signal Analysis
With Lookback Collection, never miss a signal
TCI PROPRIETARY
August 11, 2019

16. Find it fast… with Integrated Signal Analysis
Auto Modulation Classifier
Right-click an Intercept and click Classify to run the automated modulation classifier.
Automatically determines modulation parameters:
Modulation (Analog FM, AM, AM-DSBSC, LSB, SSB, , CW / pure carrier, BPSK, QPSK, pi/4-DQPSK, 8PSK, 16PSK, binary FSK, MSK, 3FSK, 4FSK, 8FSK, 16QAM, 32QAM, v.29, OOK, 4PAM, Manual Morse, Machine Morse, Noise)*
Symbol Rate
Frequency Deviation
*Additional Modulation types available with export approval
Smart Recording
Automatically record signals of interest based on modulation criteria
Integrated Signal Analysis Simplifies the Search / Collection Process
TCI PROPRIETARY
August 11, 2019

17. Universal Signal Detection
Creating New Signal Detectors on-the-fly
Operators can instantly create and add new signal detectors to Blackbird
No programming required
Detectors based on:
Signal Modulation criteria (modulation type, symbol rate, deviation, etc.)
Frequency plan (range or list)
Bandwidth criteria
Supports import of legacy USD detectors from E3238s Blackbird
Automatic signal training with USD modulation recognition
Extensible Signal Detection with USD
TCI PROPRIETARY
August 11, 2019

18. User can define multiple areas of interest
Realtime spectrum monitoring database analysis Searching by Geographic Area of Interest
Stretch circle around area of interest with middle mouse button, then click Set Area of Interest to add area of interest to the current search criteria
User can define multiple areas of interest
TCI PROPRIETARY
August 11, 2019

19. Reported Drone Incidents in US
Drones – A New Threat
Explosion in sales of drones
Corresponding rise in Reported Drone Incidents
Wide range of threats:
Negligent hobbyist
Protestors
Terrorist
Foreign Intelligence
Reported Drone Incidents in US
ISIS Weaponized Drone
*DHS, Risk Assessment of Non-Traditional Aviation Tech, May 2016
TCI Proprietary
August 11, 2019

20. Detecting Drones in RF Spectrum
Spektrum DX5e Controller
DJI Phantom 3 Controller and Video
Video Signal
Detecting Spectral Signature in RF Spectrum
TCI Proprietary
August 11, 2019

21. Detection in Real World – Not so Easy!
Chaotic RF Environment (JFK Airport) - Can you see the Drone?
TCI Proprietary
August 11, 2019

22. Advanced Detection Technology
Advanced data analysis
TCI Proprietary
August 11, 2019

23. System Operation
System scans RF environment looking for RF signature of drone and/or controller
When drone/controller detected, get visual and audio alert
Remote alerts via & instant text message
Drone/controller location tracked on map
Locating the controller (operator) allows safe and effective interdiction
TCI Proprietary
August 11, 2019

24. Typical Spectrum Management System Database
Spectrum management data can be analysed for KPIs, management reporting and trend analysis
Company Confidential
August 11, 2019

25. Spectrum management system databases
Modern spectrum management systems/databases hold much information about spectrum users, frequencies, licences, fees, interference complaints, etc.
Management reports and dashboards automatically produced
KPIs, applications pending, licences issued, fees collected
Trend analysis to mine the data
Frequency bands becoming congested
Frequency bands under-utilised and empty
Effectiveness of pricing mechanisms
Customer/licensee analysis
Spectrum information system- NFAT, Spectrum trading database
TV white spaces database/dynamic spectrum access
Innovative spectrum management
Company Confidential
August 11, 2019

26. More Transmitters = More Licenses = More Data
Spectrum Utilization
PAST
PRESENT/ FUTURE
In the past, there were a moderate number of high power transmitters and some growth in lower power transmitters.
Current and future = extreme growth in the number of both, but very large growth in low power transmitters.
Today & the future = higher density of lower power transmitters
Company Confidential
August 11, 2019

27. Spectrum Management “Big Data”
Canada Example
Traditional Spectrum Management & Monitoring
A few large transmitters
Spectrum allocated in large blocks on a medium to long term basis
Large-scale, regional spectrum monitoring systems identify spectrum that could be reallocated during the next award/auction
This is a developing idea that could enable us to transition from mostly hardware to software focus to address a developing “Big Data” issue in Spectrum Management
Revenues that are lumpy to revenues that are more stable
7-10 year horizon
The left panel model is currently serviced by our Scorpio & Spectrum Management software
The panel on the right is a big data problem – data coming into the regulator from hundreds of sensors in real-time
NexGen spectrum management: manage spectrum occupancy in real-time
Company Confidential
August 11, 2019

28. Spectrum Management “Big Data”
Canada Example
NexGen Spectrum Management
Spectrum regulators wish to allocate currently unused spectrum to address immediate demand, automatically and in real-time
New, low-cost monitoring technologies at the “block level”
This is a developing idea that could enable us to transition from mostly hardware to software focus to address a developing “Big Data” issue in Spectrum Management
Revenues that are lumpy to revenues that are more stable
7-10 year horizon
The left panel model is currently serviced by our Scorpio & Spectrum Management software
The panel on the right is a big data problem – data coming into the regulator from hundreds of sensors in real-time
NexGen spectrum management will monitor and manage spectrum occupancy in real-time
Company Confidential
August 11, 2019

29. Example of a Compact Spectrum Monitoring System
Spectrum monitoring sensor
Key Features
ITU-Compliant Monitoring
Time Difference of Arrival (TDOA) Geolocation
Highest Performance: Fewer Systems Required for Same Coverage
Low Size, Weight & Power: Flexible Deployments, Minimized Infrastructure
Low capital and running cost
Enter notes / script here
High Performance ITU-Compliant Monitoring & TDOA geolocation
Company Confidential
August 11, 2019

30. Example “Spectrum Surveyor” Module – Database Driven
The increasing complexity of signals, and the increasingly crowding of the RF spectrum has prompted the ITU to develop recommendations for Hybrid AOA / TDOA Networks as the best solution to address the new monitoring challenges.
Enabling regulators to make more effective decisions, faster
Company Confidential
August 11, 2019

31. Example “Spectrum Surveyor” Module
The increasing complexity of signals, and the increasingly crowding of the RF spectrum has prompted the ITU to develop recommendations for Hybrid AOA / TDOA Networks as the best solution to address the new monitoring challenges.
Enhanced visualization tools: Spectrum Occupancy in 2D
Company Confidential
August 11, 2019

32. Example “Spectrum Surveyor” Module
Enhanced visualization tools: Spectrum Occupancy Data
Company Confidential
August 11, 2019

33. Example “Spectrum Surveyor” Module
Enhanced visualization tools: Spectrum Occupancy in 3D (points)
Company Confidential
August 11, 2019

34. Example “Spectrum Surveyor” Module
Enhanced visualization tools: Spectrum Occupancy in 3D (surface)
Company Confidential
August 11, 2019

35. Looking ahead - challenges
Spectrum usage information is only as good as the data provided by the monitoring nodes, requiring very dense networks in urban/suburban areas and mobile systems driving the rural areas, particularly for SHF/EHF bands required for 5G, IOT, Smart Cities/Islands initiatives
Data reduction, fusion, analysis of huge volumes of data into occupancy, coverage and geolocation blocks – cloud computing solution – big data analytics
Developing intuitive mapping tools to visualise current and historical spectrum usage, showing coverage areas, interference areas, unused frequencies – work in progress
Applying AI (artificial intelligence) and ML (machine learning) techniques to learn the spectrum environment
Automated intelligent interference and geolocation alerts
Automated spectrum reports and maps of unused and under-used frequency bands
Interfaces to automated frequency assignment systems
Innovative spectrum management
Company Confidential
August 11, 2019

36. Thank you Merci Obrigado
August 11, 2019