1. Agenda item #7
SoE data flows

2. WISE SoE data flows River water quality Lake water quality
[WG DIS ]
River water quality
+ biology
Lake water quality
+ biology
Groundwater quality
Water quantity *
Quick list of the data flows: this are the traditional WISE SoE data flows.
Water Quality – in rivers, lakes and groundwater, including nutrients & hazardous substances.
These have been running since around 2000.
Biology data is also reported here (except groundwater for obvious reasons).
Water Quantity – including water use (abstraction and returns per sector of economic activity)
WISE-SoE dataflow since 2009
Emissions to water – including point sources, but also diffuse sources
WISE-SoE dataflow since 2008 (test reporting)
Emissions to water *

3. WISE SoE data flows
Content review of the WISE SoE data flows against upcoming WFD reporting in 2016
Data specifications review
Technical review of QA/QC of data flows to develop more efficient processes between EEA and Member Countries, including feedback mechanisms
As was present in the Freshwater EIONET workshop in June,
there will be a content review of the WISE SoE data flows
to try and harmonise the content against the
next 2016 water framework directive reporting.
There have been substantial change to the WFD Guidance documents,
so – as happened in 2010 – there will need to be adjustments in the WISE SoE dataflow
so that the two reporting obligation can complement each other.
Also for the WFD reporting, the Commission is putting a major emphasis
on improving the quality of data deliveries
and reducing the time from reporting to dissemination and availability of data for compliance assessment.
Again requires automation, but it also requires a major shift on the way
we take data quality issues – namely what needs to be done at member state level
and what can be done at European leven during data processing.

4. WISE SoE data flows
Content review of the WISE SoE data flows against upcoming WFD reporting in 2016
Data specifications review
Technical review of QA/QC of data flows to develop more efficient processes between EEA and Member Countries, including feedback mechanisms
As was present in the Freshwater EIONET workshop in June,
there will be a content review of the WISE SoE data flows
to try and harmonise the content against the
next 2016 water framework directive reporting.
There have been substantial change to the WFD Guidance documents,
so – as happened in 2010 – there will need to be adjustments in the WISE SoE dataflow
so that the two reporting obligation can complement each other.
Also for the WFD reporting, the Commission is putting a major emphasis
on improving the quality of data deliveries
and reducing the time from reporting to dissemination and availability of data for compliance assessment.
Again requires automation, but it also requires a major shift on the way
we take data quality issues – namely what needs to be done at member state level
and what can be done at European leven during data processing.

5. Prioritisation of the data collection (determinands) according to EEA products & requirements (assessments, indicators, reports, maps…)
Step
Criteria
Value
Decision 1 
Priority Substance according to relevant Directive ?
Yes
Must No
Go to #2 2 
Required for current EEA products (indicators, assessments, reports, etc.) ?
Go to #3 3 
Required for future planned assessments (i.e. complementing WFD with relevant time series) ?
Go to #4 4 
Frequently monitored and reported information ?
Go to #5
Go to #6 5 
Information that can be derived from other reliable data sources currently available to the EEA ?
Won't 6 
Useful and usable ancillary information for current EEA products, including QC of other "Must" parameters ?
Should
Go to #7 7
Useful and usable ancillary information for planned EEA products ?
Could
As was present in the Freshwater EIONET workshop in June,
there will be a content review of the WISE SoE data flows
to try and harmonise the content against the
next 2016 water framework directive reporting.
There have been substantial change to the WFD Guidance documents,
so – as happened in 2010 – there will need to be adjustments in the WISE SoE dataflow
so that the two reporting obligation can complement each other.
Also for the WFD reporting, the Commission is putting a major emphasis
on improving the quality of data deliveries
and reducing the time from reporting to dissemination and availability of data for compliance assessment.
Again requires automation, but it also requires a major shift on the way
we take data quality issues – namely what needs to be done at member state level
and what can be done at European leven during data processing.

6. Pollution from oxygen consuming substances
Example:
Pollution from oxygen consuming substances
Determinant
#Countries
Proposal
Existing EEA products
Ammonium Total 18
must
CSI19, WISE maps
Ammonium 27
BOD5 28
BOD7 5
CODCr 23
should
CSI19
CODMn 14
Total Organic Carbon (TOC) 25
Dissolved Organic Carbon (DOC) 12
won’t
Dissolved Oxygen 31
could
Oxygen saturation 26
Non-ionised Ammonia 9
Invertebrate EQR_G

7. Content review followed an adapted approach…
Water quantity
Content review followed an adapted approach… #
In SoE?
In another data source?
Needed by EEA?
Decision
Criteria a 1
Must
Because it is needed. b
Won't
Because it is not needed. Also applies for variables that can be derived. c1
If there is an agreement between the EEA and the other institution. c2
Should
If the spatial and/or temporal resolution of the other data source is not adequate. c3
If the other data source can be used. d1
If, and only if, there is an agreement between the EEA and e.g. Eurostat, DG ENV. d2
Because it's not needed. e1
If, and only if, there is an agreement between the EEA and the other institution. e2
Could e3 f1 f2
Won´t g h
(additional line…for completeness sake…) Because it is not needed.

8. Water quantity i a a a b b c c c c1 c c2 c3 d d d1 d d2 e e e1 e e2 e3
1. Start with the current WISE SoE Water Quantity
data collection
2. Check against Eurostat JQ-IW or REQ
{and do the same for the 2016 WFD}
data collection
3. Check against EEA
end-products
data requirements
Future
WISE SoE
Water Quantity
Future
“prefilling” of
JQ or WFD a a a b b c c c c1 c c2 c3 d d d1 d d2 e e e1 e
Regional Environmental Questionnaire (REQ) e2 e3 f f1 f f2
Water quantity g g e e e i f f f f g g h h h i i

9. WISE SoE data flows
Content review of the WISE SoE data flows against upcoming WFD reporting in 2016
Data model review
Technical review of QA/QC of data flows to develop more efficient processes between EEA and Member Countries, including feedback mechanisms
As was present in the Freshwater EIONET workshop in June,
there will be a content review of the WISE SoE data flows
to try and harmonise the content against the
next 2016 water framework directive reporting.
There have been substantial change to the WFD Guidance documents,
so – as happened in 2010 – there will need to be adjustments in the WISE SoE dataflow
so that the two reporting obligation can complement each other.
Also for the WFD reporting, the Commission is putting a major emphasis
on improving the quality of data deliveries
and reducing the time from reporting to dissemination and availability of data for compliance assessment.
Again requires automation, but it also requires a major shift on the way
we take data quality issues – namely what needs to be done at member state level
and what can be done at European leven during data processing.

10. Concepts & vocabularies
WFD
Rivers
+ biology
Standardise,
document and reuse:
Concepts & vocabularies
Data models
Code lists
Spatial units
Processes
Formats
Services
Floods
Lakes
+ biology
Groundwater
BWD
Water Quantity
UWWTD
Emissions
DWD

11. WISE SoE data flows Data model review
Consolidation of the determinant code lists
Unique common code list of determinands for SoE data flows (EIONET workshop )
As was present in the Freshwater EIONET workshop in June,
there will be a content review of the WISE SoE data flows
to try and harmonise the content against the
next 2016 water framework directive reporting.
There have been substantial change to the WFD Guidance documents,
so – as happened in 2010 – there will need to be adjustments in the WISE SoE dataflow
so that the two reporting obligation can complement each other.
Also for the WFD reporting, the Commission is putting a major emphasis
on improving the quality of data deliveries
and reducing the time from reporting to dissemination and availability of data for compliance assessment.
Again requires automation, but it also requires a major shift on the way
we take data quality issues – namely what needs to be done at member state level
and what can be done at European leven during data processing.
Harmonization with (and for) the WFD Annexes 8b-j, 8p
(in progress)

12. Common code lists?
Consolidated code list for EIONET review ( )
Consolidated code list also with/for WFD Annexes 8b-j, 8p ?
Quick list of the data flows: this are the traditional WISE SoE data flows.
Water Quality – in rivers, lakes and groundwater, including nutrients & hazardous substances.
These have been running since around 2000.
Biology data is also reported here (except groundwater for obvious reasons).
Water Quantity – including water use (abstraction and returns per sector of economic activity)
WISE-SoE dataflow since 2009
Emissions to water – including point sources, but also diffuse sources
WISE-SoE dataflow since 2008 (test reporting)

13. Common code lists: current status
Consolidated list for EIONET review
Harmonisation of/with WFD annexes
Rivers
nutrients
completed
in progress
hazardousSubst
completed
in progress
biology
completed
Lakes
nutrients
completed
in progress
hazardousSubst
completed
in progress
biology
completed
Quick list of the data flows: this are the traditional WISE SoE data flows.
Water Quality – in rivers, lakes and groundwater, including nutrients & hazardous substances.
These have been running since around 2000.
Biology data is also reported here (except groundwater for obvious reasons).
Water Quantity – including water use (abstraction and returns per sector of economic activity)
WISE-SoE dataflow since 2009
Emissions to water – including point sources, but also diffuse sources
WISE-SoE dataflow since 2008 (test reporting)
Groundwater
nutrients
completed
verified
hazardousSubst
completed
verified
Emissions
pointSources
completed
completed
diffuseSources
completed
completed

14. WISE SoE data flows Data model review
Consolidation of the determinant code lists
Consolidation of the overall structure
As was present in the Freshwater EIONET workshop in June,
there will be a content review of the WISE SoE data flows
to try and harmonise the content against the
next 2016 water framework directive reporting.
There have been substantial change to the WFD Guidance documents,
so – as happened in 2010 – there will need to be adjustments in the WISE SoE dataflow
so that the two reporting obligation can complement each other.
Also for the WFD reporting, the Commission is putting a major emphasis
on improving the quality of data deliveries
and reducing the time from reporting to dissemination and availability of data for compliance assessment.
Again requires automation, but it also requires a major shift on the way
we take data quality issues – namely what needs to be done at member state level
and what can be done at European leven during data processing.

15. “On-update”? Spatial data Ongoing discussion…
The ActionType enumeration is used to specify the action that a receiving system should take when processing the content […]:
Append
Data or metadata is an incremental update for an existing data/metadata set or the provision of new data or documentation (attribute values) formerly absent. If any of the supplied data or metadata is already present, it will not replace that data or metadata. This corresponds to the “Update” value found in version 1.0 of the SDMX Technical Standards.
Replace
Data/metadata is to be replaced, and may also include additional data/metadata to be appended.
Delete
Data/Metadata is to be deleted.
Information
Data and metadata are for information purposes.
[SDMX 2.0]

16. Emissions Minor changes to the data structure
One table dropped (on spatial data)
One metadata table added (on procedures)
Changes are proposed to the current code lists (maintaining backward compatibility):
for point sources (
for diffuse sources (
Emissions to water – including point sources, but also diffuse sources
WISE-SoE dataflow since 2008 (test reporting)

17. To be merged? To be removed? To be added?
Metadata on the procedures and emission sources category schema

18. Water quantity Water Quantity is a “hybrid data flow” Data structures
Water quantity part:
Two options open for discussion with EIONET:
n Data cubes (as before) ?
or normalised tables (as in Emissions)?
Time series + monitoring sites: will follow the same approach as the water quality data flows.
Emissions to water – including point sources, but also diffuse sources
WISE-SoE dataflow since 2008 (test reporting)

19. WISE SoE data flows Remove inconsistencies Water quality
Harmonised data model
Single reporting flow for water quality ?
Rivers
+ biology
Lakes
+ biology
Groundwater
Water quantity
Emissions

20. Time series

21. Time series

22. WISE SoE data flows Water quality Spatial data
Spatial data (or ancillary data related to the sampled unit) repeatedly reported.
Water quantity
Emissions

23. WISE SoE data flows Water quality Spatial data
Time-series reporting (annual).
Spatial data reporting (“on-update”).
Water quantity
Emissions

24. Spatial data in SoE Groundwater

25. Spatial data in SoE rivers and lakes

26. From WFD ?

27. WISE SoE data flows Spatial data WFD 2016 Spatial data
Monitoring Sites
Rivers
Lakes
Groundwater
SUs
RBDs

28. WISE SoE data flows Spatial data Needs to be in place to collect:
data from countries not reporting under WFD
EIONET sites not used in WFD monitoring & reporting
hydrographic features that are not WFD WaterBodies (e.g. very small lakes)
Monitoring Sites
Rivers
Lakes
Groundwater
SUs
RBDs

29. INSPIRE Environmental Monitoring Facilities
Rivers
Lakes GW
TCM WQ
Monitoring sites
INSPIRE Environmental Monitoring Facilities
 [ Project]
Characterisation of the
spatial unit
Nutrients
ISO 19156:2011 Observations and Measurements 
Hazardous substances
Biology
Pressures

30. result Why not use ISO 19156 O&M ? when where what how …why
Observation +
phenomenonTime
WaterBody
PropertyType
Result
ObservationProcess
MonitoringSite
+result
+observedProperty
+procedure
+featureOfInterest
+sampledFeature
what
how
…why

31. Why not use ISO 19156 O&M just yet?
The conceptual model is adequate, but the encoding is more complex than needed in this specific reporting context.
Should be used, in a “INSPIREd” reporting, but…
Technical review of QA/QC of data flows to develop more efficient processes between EEA and Member Countries, including feedback mechanisms
As was present in the Freshwater EIONET workshop in June,
there will be a content review of the WISE SoE data flows
to try and harmonise the content against the
next 2016 water framework directive reporting.
There have been substantial change to the WFD Guidance documents,
so – as happened in 2010 – there will need to be adjustments in the WISE SoE dataflow
so that the two reporting obligation can complement each other.
Also for the WFD reporting, the Commission is putting a major emphasis
on improving the quality of data deliveries
and reducing the time from reporting to dissemination and availability of data for compliance assessment.
Again requires automation, but it also requires a major shift on the way
we take data quality issues – namely what needs to be done at member state level
and what can be done at European leven during data processing.

32. Questions? Agenda item #7a - SoE