1. per-ove.kjensli@met.no met.no Nov.2010
Met.no Organisation January Dataflow and QC System Kvalobs Project 2010
met.no Nov.2010

2. met.no -2011
Per-Ove
Knut
Paul
Børge
Vegard

3. Dataflow and QC-system at met.no
Station
Realtime data
ComObs
AutoObs
NORCOM
Realtime
Forecast
SYNOP
KVALOBSDB
Near realtime
eKlima.no
wsKlima.no
yr.no
KDVHDB

4. Dataflow and QC-system at met.no
Station
Realtime data
ComObs
AutoObs
NORCOM
Realtime
Forecast
DIANA
MODELS
Deviation and message processing
KRODB
KVALOBSDB
QC1/QC2
HQC
DIANA
Near realtime
eKlima.no
wsKlima.no
yr.no
Nonrealtime
data
Station QC0
Registration
KLIMADB
KDVHDB

5. Kvalitetsstatistikk for september 2009

6. Kvalitetsstatistikk for september 2009
No flags at aggregated values

7. Kvalitetsstatistikk for september 2009
Noise in checks or metadata

8. Kvalitetsstatistikk for september 2009
Do not treat several sensors and levels at one station

9. Kvalitetsstatistikk september 2009

10. Kvalitetsstatistikk september 2009
Less noise

11. Kvalitetsstatistikk september 2009
Less noise
HQC -
to be stable

12. Kvalitetsstatistikk september 2009
Less noise
HQC - more functionality
HQC -
to be stable

13. Kvalitetsstatistikk september 2009
Less noise
To be automated by QC2
HQC - more functionality
HQC -
to be stable

14. Dataflow and QC-system at met.no
Station
Realtime data
ComObs
AutoObs
NORCOM
Realtime
Forecast
KVALOBSDB
Near realtime
eKlima.no
wsKlima.no
yr.no
KDVHDB

15. Kvalobs Project 2010 Enhanced metadata tables and content KVALOBSDB
KDVHDB
NORCOM
Near realtime
eKlima.no
wsKlima.no
yr.no
Realtime
Forecast
Deviation and message processing
KRODB
ComObs
AutoObs
Complete
Test enviroment
Some new Quality flags
Bugfix
BUFR encoder and decoder
QC2 in operation
Enhanced QC1 to reduce noise
Enhanced HQC on Qt4
Enhanced dataflow to DB
QAbase handles complex stations
( n sensors, m levels )
Aggregating diurnal values
Kvalobs on Lucid
Installation packages
Quality flags on aggregated values

16. Possible activities from 2011…
QC2 modules (spatial, statistical,…)
Include radar information in QC2?
QC1 enhancements
Cooperation with SMHI

18. Climate Services
Quality of climate data - Development of QC2-tools, and support QC1 and HQC

19. Station and QC Services
Maintain and develop the met-stations
Metadata system (STINFOSYS)
Dataflow from stations to met.no
Quality of observations. Realtime QC, QC1, QC2 and HQC
Deviation processing (KRODB)

20. Climate Data Warehouse (KDVHDB)
Observations in separate tables depending on measurement frequency:
Minute data (tipping bucket)
Hourly data(AWS)
3-12 hourly data (MWS)
Diurnal data (Precipitation)
Statistical tabels:
- Updated from observations by event triggers in real time
Diurnal values (main parameters are produced in Kvalobs)
Monthly values
Extreme values