Presentation is loading. Please wait.

Presentation is loading. Please wait.

FINESTION-2003-2006 a complete dataset of routine air ion measurements 2003 – 2006 in co-operation with: Urmas Hõrrak, Kaupo Komsaare,

Published byKatrina Sims Modified over 8 years ago

Similar presentations

Presentation on theme: "FINESTION-2003-2006 a complete dataset of routine air ion measurements 2003 – 2006 in co-operation with: Urmas Hõrrak, Kaupo Komsaare,"— Presentation transcript:

1 FINESTION-2003-2006 a complete dataset of routine air ion measurements 2003 – 2006 Hannes.Tammet@ut.ee in co-operation with: Urmas Hõrrak, Kaupo Komsaare, Pasi P. Aalto, Petri Keronen, and Sander Mirme Pühajärve 2007

2 What is included? TahkuseHyytiäläTartu InstrumentTahkuse AISBSMA1BSMA2 From23.07.200320.03.200302.04.2004 To31.12.2006 Meteo T, T ground, p, RH, wind, W/m 2 T, T grad, p, RH, UV, wind, prec, W/m 2, visibility T, p, RH, wind, prec, lux, W/m 2 ChemistryNO x,SO 2,O 3 Dose rate Mobility0.00065–2.740.036–2.74 Size0.5–65 nm0.5–6.5 nm Neutral aerosols are not presented in the distribution version of the dataset

3 Amount of data 283 164 diurnal records, mostly 24×6 = 144 measurements per day (some variables 48 or 24 measurements per day). Total about 40×10 6 values ( inlc. less than 10% of missing codes ). Unzipped file 146 958 411 bytes, about 3.8 bytes per value, Zipped file 52 megabytes, about 1.4 bytes per value. Format: DD (DataDiurna) diary.

4 Preprocessing of data BSMA (single-channel scanning) data:  The records with BSMA noise index ≥ 50 were deleted as unreliable (about 15% of measurements was lost in Hyytiälä and 16% in Tartu).  The measurements made with a period of 15 min were converted to the 10-minute period using interpolation by means of the DD data manager.  The values of RH% recorded by BSMA were corrected so that the nighttime maximums do not exceed 100%.  The fraction concentrations were converted to the values of distribution functions dn / d(log d) and dn / d(log Z) assigned to the centers of the fractions in the logarithmic scale of diameter or mobility.  The indices of technical diagnostics were replaced with the integral parameters: cluster ion concentration (Z > 0.56 cm 2 V −1 s −1 ), intermediate ion concentration (Z = 0.032 − 0.56 cm 2 V −1 s −1 ), cluster ion average mobility and air polar conductivity.

5 Tahkuse AIS (multichannel instrument) data:  The physically unbelievable measurements were marked as missing.  The records with too many missing measurements were deleted.  The measurements recorded every 5 minutes were converted to the time step of 10 minutes.  If a missing value was located between known values then the gap was filled using a sophisticated interpolation method.  The data was complemented with the integral parameters: cluster ion (Z > 0.56 cm 2 V −1 s −1 ), intermediate ion (Z = 0.032 − 0.56 cm 2 V −1 s −1 ), and large ion (Z = 0.0006 − 0.032 cm 2 V −1 s −1 ) concentrations; cluster ion average mobility and air polar conductivity.  The data was transformed to the dn / d(log d) and dn / d(log Z) values so that a decade is logarithmically uniformly divided into 8 fractions. Thus the first 16 fractions are just the same as in the BSMA measurements. The mobility was converted to the particle size considering the measurements of air pressure and temperature.

6 Included quantities Symbol Quantity T:CAir temperature near the station Tg:CGround temperature near the station Tgr:K/mGradient of temperature Tc:CChimney temperature near the station RH%Relative humidity P:mbAir pressure near the station Wind:m/sWind velocity at standard height Wmax:m/sWind 5-minute maximum at standard height Wind:degWind direction Prec:mm/hPrecipitation intensity Illum:luxSolar illuminance Rad:W/m2Total insolation sun+sky UVB:W/m2UV radiation 310-320 nm Vis:kmVisibility DR:uSv/hGamma radiation dose rate NOx:ug/m3Concentration of NOx (1 ppb is converted to 191 ug/cm3) SO2:ug/m3Concentration of SO2 (1 ppb is converted to 2.66 ug/cm3) O3:ug/m3Concentration of O3 (1 ppb is converted to 2.0 ug/cm3)

7 SymbolUnit Quantity B-noisecm-3BSMA noise index RC+cm-3Tahkuse index of spectra roughness for positive clusters RN+cm-3Tahkuse index of spectra roughness for positive nanoparticles RP+cm-3Tahkuse index of spectra roughness for positive particles RC-cm-3Tahkuse index of spectra roughness for negative clusters RN-cm-3Tahkuse index of spectra roughness for negative nanoparticles RP-cm-3Tahkuse index of spectra roughness for negative particles NC+:cm-31/cm3Concentration of positive cluster ions (Z > 0.5 cm2/Vs) NC-:cm-31/cm3Concentration of negative cluster ions (Z > 0.5 cm2/Vs) NN+:cm-31/cm3Concentration of positive nanometer ions (Z = 0.03-0.5 cm2/Vs) NN-:cm-31/cm3Concentration of negative nanometer ions (Z = 0.03-0.5 cm2/Vs) NP+:cm-31/cm3Concentration of positive particle ions (Z = 0.0003-0.03 cm2/Vs) NP-:cm-31/cm3Concentration of negative particle ions (Z = 0.0003-0.03 cm2/Vs) ZC+cmcm2/VsAverage mobility of positive cluster ions (Z > 0.5 cm2/Vs) ZC-cmcm2/VsAverage mobility of negative cluster ions (Z > 0.5 cm2/Vs) L+:fS/mfS/mPositive conductivity of air L-:fS/mfS/mNegative conductivity of air

8 z+01cm-3 dN/d(log Z) of positive ions at Z = 2.74 cm2/Vs z+02cm-3 dN/d(log Z) of positive ions at Z = 2.05 cm2/Vs z+03cm-3 dN/d(log Z) of positive ions at Z = 1.54 cm2/Vs z+04cm-3 dN/d(log Z) of positive ions at Z = 1.15 cm2/Vs z+05cm-3 dN/d(log Z) of positive ions at Z = 0.87 cm2/Vs z+06cm-3 dN/d(log Z) of positive ions at Z = 0.65 cm2/Vs z+07cm-3 dN/d(log Z) of positive ions at Z = 0.487 cm2/Vs z+08cm-3 dN/d(log Z) of positive ions at Z = 0.365 cm2/Vs z+09cm-3 dN/d(log Z) of positive ions at Z = 0.274 cm2/Vs z+10cm-3 dN/d(log Z) of positive ions at Z = 0.205 cm2/Vs z+11cm-3 dN/d(log Z) of positive ions at Z = 0.164 cm2/Vs z+12cm-3 dN/d(log Z) of positive ions at Z = 0.115 cm2/Vs z+13cm-3 dN/d(log Z) of positive ions at Z = 0.0866 cm2/Vs z+14cm-3 dN/d(log Z) of positive ions at Z = 0.0649 cm2/Vs z+15cm-3 dN/d(log Z) of positive ions at Z = 0.0487 cm2/Vs z+16cm-3 dN/d(log Z) of positive ions at Z = 0.0365 cm2/Vs z+17cm-3 dN/d(log Z) of positive ions at Z = 0.0274 cm2/Vs z+18cm-3 dN/d(log Z) of positive ions at Z = 0.0205 cm2/Vs z+19cm-3 dN/d(log Z) of positive ions at Z = 0.0154 cm2/Vs z+20cm-3 dN/d(log Z) of positive ions at Z = 0.0115 cm2/Vs z+21cm-3 dN/d(log Z) of positive ions at Z = 0.0087 cm2/Vs z+22cm-3 dN/d(log Z) of positive ions at Z = 0.0065 cm2/Vs z+23cm-3 dN/d(log Z) of positive ions at Z = 0.00487 cm2/Vs z+24cm-3 dN/d(log Z) of positive ions at Z = 0.00365 cm2/Vs z+25cm-3 dN/d(log Z) of positive ions at Z = 0.00274 cm2/Vs z+26cm-3 dN/d(log Z) of positive ions at Z = 0.00205 cm2/Vs z+27cm-3 dN/d(log Z) of positive ions at Z = 0.00154 cm2/Vs z+28cm-3 dN/d(log Z) of positive ions at Z = 0.00115 cm2/Vs z+29cm-3 dN/d(log Z) of positive ions at Z = 0.00087 cm2/Vs z+30cm-3 dN/d(log Z) of positive ions at Z = 0.00065 cm2/Vs

9 d+01cm-3 dN/d(log D) of positive ions at D = 0.49 nm d+02cm-3 dN/d(log D) of positive ions at D = 0.65 nm d+03cm-3 dN/d(log D) of positive ions at D = 0.87 nm d+04cm-3 dN/d(log D) of positive ions at D = 1.15 nm d+05cm-3 dN/d(log D) of positive ions at D = 1.54 nm d+06cm-3 dN/d(log D) of positive ions at D = 2.05 nm d+07cm-3 dN/d(log D) of positive ions at D = 2.74 nm d+08cm-3 dN/d(log D) of positive ions at D = 3.65 nm d+09cm-3 dN/d(log D) of positive ions at D = 4.87 nm d+10cm-3 dN/d(log D) of positive ions at D = 6.49 nm d+11cm-3 dN/d(log D) of positive ions at D = 8.66 nm d+12cm-3 dN/d(log D) of positive ions at D = 11.6 nm d+13cm-3 dN/d(log D) of positive ions at D = 15.4 nm d+14cm-3 dN/d(log D) of positive ions at D = 20.5 nm d+15cm-3 dN/d(log D) of positive ions at D = 27.4 nm d+16cm-3 dN/d(log D) of positive ions at D = 36.5 nm d+17cm-3 dN/d(log D) of positive ions at D = 48.7 nm d+18cm-3 dN/d(log D) of positive ions at D = 65.0 nm

10 STATISTICS

11 StationQuantityDaysMinAveMaxSigma HyytNC+:cm-3129827737.91788225.3 HyytNC-:cm-31298-481721.32383239.8 HyytNN+:cm-31285-86916.4103247.1 HyytNN-:cm-31285-80421.5604693.9 HyytZC+cm12980.851.4452.040.139 HyytZC-cm12980.941.6382.240.155 TartuNC+:cm-3750-143397.11618175.6 TartuNC-:cm-3750-164303.44317160.3 TartuNN+:cm-3745-99730.1193388.9 TartuNN-:cm-3745-88036.97421121 TartuZC+cm7500.021.4342.590.086 TartuZC-cm7500.121.5813.60.122 TahkNC+:cm-311030436.41200161.2 TahkNC-:cm-311000370.31200153.7 TahkNN+:cm-31103-30114.41199117.1 TahkNN-:cm-31102-3098.51199136.1 TahkNP+:cm-3110201371.58982819 TahkNP-:cm-3110301389.88984830.6 TahkZC+cm11000.61.4192.10.081 TahkZC-cm 10940.61.5632.080.113

12 StationQuantityDaysMinAveMaxSigma Hyytd-011298-15651293.94952568.7 Hyytd-021298-77201974.96060603.4 Hyytd-031298-7411730.710912813.3 Hyytd-041298-1085707.74857628.8 Hyytd-051298-118693.46824182.6 Hyytd-061298-81637.011016193.0 Hyytd-071298-237637.411344207.3 Hyytd-081298-316028.07784157.8 Hyytd-091298-450419.87560157.7 Hyytd-101298-556815.610200282.7 Tartud-01750-384580.95936280.7 Tartud-02750-72640.16296305.4 Tartud-03750-640693.57192375.1 Tartud-04750-672424.99240328.5 Tartud-05750-1248135.512776209.7 Tartud-06750-124046.916576202.5 Tartud-07750-364041.414312198.3 Tartud-08750-390443.39536191.1 Tartud-09750-680050.37360259.2 Tartud-10750-800051.014272475.6

13 StationQuantityDaysMinAveMaxSigma Tahkd-011100-563507.72372230.0 Tahkd-021100-531929.23592382.2 Tahkd-031100-448888.53512404.0 Tahkd-041100-900395.83919279.4 Tahkd-051103-416187.210461289.1 Tahkd-061102-679149.32812188.4 Tahkd-071102-50376.42501121.0 Tahkd-081102-84098.32489158.6 Tahkd-091102-792152.23082246.5 Tahkd-101102-852223.03741371.1 Tahkd-111103-991318.513703576.1 Tahkd-121103-894423.010357431.1 Tahkd-131103-827650.311369501.1 Tahkd-141103-962995.113466677.6 Tahkd-151103-9551464.819793978.2 Tahkd-161103-9512286.7184591426.4 Tahkd-171103-8453111.7286792021.9 Tahkd-18110303893.4403202866.8

14 Average size distribution of negative ions

15

16 How to use? Empty folders

17 delimiter (tab) how many headerlines tolerable percent of errors time pattern base year time shift from UT, s (Helsinki winter time) variable name in table quantity name in diary station time regime code of a missing value factor table/diary

18 Double- click Result

19

20 delimiter (tab) how many headerlines tolerable percent of errors time pattern base year time shift (s) (Helsinki winter time) variable name in table quantity name in diary station time regime missing code factor table/diary

21 Why DataDiurna? A rectangular table can be conveniently processed and analyzed with common software like MS Excel ( if the number of rows < 65536). Different quantities are often saved with different time steps and many cells in a tectangular table will be empty. If a table holds a large complex dataset then it is composed mostly of the missing value codes like –999. An alternative is a set of different tables joined into a database. Common database systems, e.g. MS Access, are optimized for the business applications. The time structure and the specifity of environmental measurements is not sufficiently exploited in these systems. Another alternative is the diary format well known in hand-written measurement records. This alternative is applied in DataDiurna, which is optimized for managing of environmental measurements. An additional advantage: the rules of DataDiurna force the user to include minimum explanations into the dataset, e.g. the data cannot be saved without indicating how much the time is shifted from UT.

22 A source table NB: DataDiurna is not a replacement for Excel 1) to manage large data: choose DataDiurna, 2) to analyze the tables: choose Statistica, Excel, etc. A source table Common diary An outlet table

23 Excerpt from a diary: 20041110,Tartu.m,Rad:W/m2,hm,2,2,2,2,2,2,7,20,28,32, 39,33,18,8,2,2,2,2,2,2,2,2,2,2 20041110,Tartu.m,Wind:m/s,hm,3.8,3.8,3.9,4.4,4.9,4.9,4.4,2.4,1.8,1.8,2.5,2.1,2,1.9,0.7,1.7,2,1.5,2,1,1.2,1.1,1.3,1.1 20041111,Hyyt,L+:fS/m,m10,9.6,9.1,8.7,8.9,9.1,9.4,10.2,9.8,9.6,10.3,10.9,11.4,11.6,12.2,12.5,11.8,11.9,12.2,12.7,12.5,12.1,11.9,11.3,11,11.6,11.5,11.3,1 0.9,11.2,11.5,11.5,11.3,11,10.7,11.1,11.5,11.1,11,,,,10.1,10.1,10,9.9,10.1,10.2,10.2,10,10.3,10.8,11.4,11.2,11.1,11.4,11.4,11.3,11.2,11.7,12,11.5,12.2,12.9,12.7,12.9,13.1,13.1,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, 20041111,Hyyt,Rad:W/m2,m30,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,3,5,4,7,15,24,23,24,28,15,10,3,1,0,0,0,0,0,0, -1,0,0,0,0,0,0,-1,-1,0,0,0,0,0 Date Station Quantity Time regime Here are missing data

24 DataDiurna is omnivorous: The time stamp and the numbers can be written as you data provider likes, e.g. following data rows, where the time stamp is highlighted, are considered equal Time 13:25 Date 21.05.2005 23.1,-17,?,1.6e-19,2783597+003 2005-05-21 13:25:00,23.1,-17,x,1.60-19,0.2783597e3 DOY=141.559, measurements: +23.10 -17 -999 278.3597 20050521132500) 23.1;-17;-999;2,783,597e-4 The time is automatically converted into UT when importing a source table to the diary and to any time zone when exporting an output table from the diary. The rows of the source table may be non-uniformly distributed in time: DataDiurna can interpolate and average the data during the import and export. The code of missing value may be individual for every variable and may be numerical (e.g. –999) or non-numerical (e.g. ?). etc... etc... etc.......... Warning: The data manager DD2007T.exe is still a beta-version.

25 The basic version of the dataset FINESTION-2003-2006 was composed from a large number of source tables with different time steps from 10 minutes to 1 hour

26 The working version of the dataset FINESTION-2003-2006 is located in the computer of the user Thus: Every user can create extended personal version of the dataset importing additional private data

27 How to get? The DataDiurna data manager is free for unlimited distribution. The dataset ATMEL2007A is free for unlimited distribution. Both they can be retrieved from the page: http://ael.physic.ut.ee/tammet/dd/ The dataset FINESTION-2003-2006 is free but available only for our research group. It is not published in Internet today. Thus: Ask the memory stick or the CD with the dataset and copy the folder DD into your own computer. NB: You should have 200 MB free on your hard disk.

28 Thank you for choosing DataDiurna.....hard to learn but easy to use when managing large complex datasets like FINESTION-2003-2006

Download ppt "FINESTION-2003-2006 a complete dataset of routine air ion measurements 2003 – 2006 in co-operation with: Urmas Hõrrak, Kaupo Komsaare,"

Similar presentations

Engineering Documents Manager – EDM

Engineering Documents Manager – EDM
Using the SmartPLS Software

Using the SmartPLS Software
Microscale structure of air ion spatial and temporal distribution: some problems Hyytiälä 20060315

Microscale structure of air ion spatial and temporal distribution: some problems Hyytiälä
The installation process is started by double-clicking on the USB-Key file ‘install.xls’

The installation process is started by double-clicking on the USB-Key file ‘install.xls’
Programming Types of Testing.

Programming Types of Testing.
Heat Index Note: Be sure you have already selected your time and station before choosing this product. Click on AWN Reports Click on Heat Index.

Heat Index Note: Be sure you have already selected your time and station before choosing this product. Click on AWN Reports Click on Heat Index.
Operational Quality Control in Helsinki Testbed Mesoscale Atmospheric Network Workshop University of Helsinki, 13 February 2007 Hannu Lahtela & Heikki.

Operational Quality Control in Helsinki Testbed Mesoscale Atmospheric Network Workshop University of Helsinki, 13 February 2007 Hannu Lahtela & Heikki.
Wind Chill Note: Be sure you have already selected your time and station before choosing this product. Click on AWN Reports Click on Wind Chill.

Wind Chill Note: Be sure you have already selected your time and station before choosing this product. Click on AWN Reports Click on Wind Chill.
1 External Sorting for Query Processing Yanlei Diao UMass Amherst Feb 27, 2007 Slides Courtesy of R. Ramakrishnan and J. Gehrke.

1 External Sorting for Query Processing Yanlei Diao UMass Amherst Feb 27, 2007 Slides Courtesy of R. Ramakrishnan and J. Gehrke.
Format Scandisk Defragmentation Antivirus Compression Software

Format Scandisk Defragmentation Antivirus Compression Software
Managing Your Own Data (…if you have to) Kathryn A. Carson, Sc.M. Senior Research Associate Department of Epidemiology Johns Hopkins Bloomberg School of.

Managing Your Own Data (…if you have to) Kathryn A. Carson, Sc.M. Senior Research Associate Department of Epidemiology Johns Hopkins Bloomberg School of.
Lecture 4 Advanced Topics. OVERVIEW Importing Data Data Analysis Add-In Solver Macros.

Lecture 4 Advanced Topics. OVERVIEW Importing Data Data Analysis Add-In Solver Macros.
Managing Business Data Lecture 8. Summary of Previous Lecture File Systems  Purpose and Limitations Database systems  Definition, advantages over file.

Managing Business Data Lecture 8. Summary of Previous Lecture File Systems  Purpose and Limitations Database systems  Definition, advantages over file.
Coding for Excel Analysis Optional Exercise Map Your Hazards! Module, Unit 2 Map Your Hazards! Combining Natural Hazards with Societal Issues.

Coding for Excel Analysis Optional Exercise Map Your Hazards! Module, Unit 2 Map Your Hazards! Combining Natural Hazards with Societal Issues.
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 10 Database Performance Tuning and Query Optimization.

Database Systems: Design, Implementation, and Management Eighth Edition Chapter 10 Database Performance Tuning and Query Optimization.
Objectives Describe the advantages of spreadsheets List several applications for spreadsheets Explain the underlying principles of electronic spreadsheet.

Objectives Describe the advantages of spreadsheets List several applications for spreadsheets Explain the underlying principles of electronic spreadsheet.
1 © Prentice Hall, 2002 Physical Database Design Dr. Bijoy Bordoloi.

1 © Prentice Hall, 2002 Physical Database Design Dr. Bijoy Bordoloi.
Microprocessor-based systems Curse 7 Memory hierarchies.

Microprocessor-based systems Curse 7 Memory hierarchies.
Rescue of retrospective aerosol measurements: a challenge for Estonian Environmental Observatory Rescue of retrospective aerosol measurements: a challenge.

Rescue of retrospective aerosol measurements: a challenge for Estonian Environmental Observatory Rescue of retrospective aerosol measurements: a challenge.
A Joint Dataset of Fair-Weather Atmospheric Electricity Hannes Tammet Institute of Physics, University of Tartu, 18 Ülikooli St., Tartu, 50090, Estonia.

A Joint Dataset of Fair-Weather Atmospheric Electricity Hannes Tammet Institute of Physics, University of Tartu, 18 Ülikooli St., Tartu, 50090, Estonia.

Similar presentations

Ads by Google