1. Anke Consten (14 October 2016,Ljubljana)
ESSnet pilot AIS data
Anke Consten (14 October 2016,Ljubljana)

2. Overview Introduction Deliverables ESSnet pilot AIS data
Results obtained so far
To do
(Legal) issues
Discussion/Questions

3. 1. Introduction

4. Participants

5. ESSnet Big data programme
Overall objective ESSnet Big Data programme prepare the ESS for integration of big data sources into the production of official statistics. The programme has to focus on running pilot projects exploring the potential of selected big data sources for producing or contributing to the production of official statistics. Aim of these pilots is to undertake concrete action in the domain of big data and obtain hands-on experience in the use of big data for official statistics

6. Objective AIS data
Investigate whether real-time measurement data of ship positions (measured by the so-called AIS-system) can be used: 1) to improve the quality and internal comparability of existing statistics and 2) for new statistical products relevant for the ESS.

7. AIS data
The Automatic Identification System (AIS) is an automatic tracking system used on ships for identifying and locating vessels bij electronically exchanging data with other nearby ships, AIS base stations, and satellites. Contributes to the - safety of navigation - traffic management
International voyaging ships with gross tonnage (GT) of 300 or more tons, and all the passenger ships regardless of size transmit Automatic Identification Signal (AIS) every 2 – 10 sec their position.
Terrestrial Stations, Cost Guards and Satellites receive AIS data. AIS data has the same structure worldwide.

8. AIS data FIELD DESCRIPTION TIMESTAMP
Time of ship position detection / reception (in UTC)
MMSI
Ship's MMSI number sent with the AIS notification
Lat
Latitude of the ship position (in decimal degrees)
Lon
Longitude of the ship position (in decimal degrees)
"Speed over ground"
Speed over ground (in knots)
"Course over ground"
Course over ground (in degrees)
Heading
True heading (in degrees (0-359))
"IMO number"
Ship's IMO number sent with the AIS notification
Shipname
Ship's vessel name sent with the AIS notification
Callsign
Ship's Callsign sent with the AIS notification
"Type of ship"
Ship type
Draught
Maximum Present Static Draught (in meters)
Destination

9. 2. Deliverables ESSnet pilot AIS

10. Deliverables AIS data access (at European level) Data Handling
Methodology and Techniques
build a reference frame of ships in European water (based on AIS-data)
find out how data from maritime statistics can be linked to AIS-data
check whether information improves the quality of current national and European statistical outputs
calculate the number of ships at certain coordinates
visualise the results to analyse variations in time
Phase 2 (July 2017 till May 2018)
Estimate emissions
Access to and analysing AIS data from EMSA
New Statistical output

11. 3. Results obtained so far

12. Data access European Maritime Safety Agency (EMSA) Dirkzwager
Special price only for 6 months historical data. Too costly afterwards
Kystverket
Sharing data from other European countries goes beyond their authorization
JRC
They will share their knowledge about saving, processing and analysing AIS data, but can’t share the AIS data itself
Hellenic Coast Guard
Sharing data from other European countries goes beyond their authorization
Marine Traffic
Under investigation
European Maritime Safety Agency (EMSA)
Under investigation: long way to obtain but free data

13. Result data access
For this pilot we got raw AIS data on European level from Dirkzwager. (October 2015 till April 2016)  Does not include satellite data

14. Data handling: programming language and environment

15. First insights into the quality of AIS data (coverage)

16. First insights into the quality of AIS data (following a ship)

17. First results of the traffic analyses

18. First idea about using AIS data for current statistical outputs
Making table F (port visits) for the maritime statistics for all major ports from 1 source using 1 methodology

19. 4. To do

20. To do in near future Further analyse data:
Compare data Dirkzwager with own national AIS data
Ask Dirkzwager for more background information (metadata)
Contact Eurostat and JRC about their results on the quality of AIS data
Make a quality framework
Optimize and check algorithm for traffic analyses
Brainstorm session about improving current statistics by
using AIS data

21. 5. (Legal) Issues

22. Getting free data at European level for the future
EMSA is reconsidering their release policy, so it has not been possible yet to secure data from them. Still explorating (other) possibillities…
We suggest that EuroStat tries to obtain the EMSA data and not one specific Statistical Office!

23. 6. Discussion/Questions