G 08-17-2007 W. Yan 1 Multi-Model Fusion for Robust Time-Series Forecasting Weizhong Yan Industrial Artificial Intelligence Lab GE Global Research Center.

Slides:



Advertisements
Similar presentations
GECCO 2013 Industrial Competition Computer Engineering Lab, School of Electrical and IT Engineering Farzad Noorian.
Advertisements

Ridiculously Simple Time Series Forecasting We will review the following techniques: Simple extrapolation (the naïve model). Moving average model Weighted.
Eco 5385 Predictive Analytics For Economists Spring 2014 Professor Tom Fomby Director, Richard B. Johnson Center for Economic Studies Department of Economics.
Random Forest Predrag Radenković 3237/10
Part II – TIME SERIES ANALYSIS C3 Exponential Smoothing Methods © Angel A. Juan & Carles Serrat - UPC 2007/2008.
Statistical Classification Rong Jin. Classification Problems X Input Y Output ? Given input X={x 1, x 2, …, x m } Predict the class label y  Y Y = {-1,1},
Forecasting using Non Linear Techniques in Time Series Analysis – Michel Camilleri – September FORECASTING USING NON-LINEAR TECHNIQUES IN TIME SERIES.
A novel supervised feature extraction and classification framework for land cover recognition of the off-land scenario Yan Cui
T T18-03 Exponential Smoothing Forecast Purpose Allows the analyst to create and analyze the "Exponential Smoothing Average" forecast. The MAD.
Dr. Yukun Bao School of Management, HUST Business Forecasting: Experiments and Case Studies.
RBF Neural Networks x x1 Examples inside circles 1 and 2 are of class +, examples outside both circles are of class – What NN does.
Instance based learning K-Nearest Neighbor Locally weighted regression Radial basis functions.
Exercise 7.1 a. Find and report the four seasonal factors for quarter 1, 2, 3 and 4 sn1 = 1.191, sn2 = 1.521, sn3 = 0.804, sn4 = b. What is the.
Chapter 3 Forecasting McGraw-Hill/Irwin
1 Ensembles of Nearest Neighbor Forecasts Dragomir Yankov, Eamonn Keogh Dept. of Computer Science & Eng. University of California Riverside Dennis DeCoste.
Short-Term Load Forecasting In Electricity Market N. M. Pindoriya Ph. D. Student (EE) Acknowledge: Dr. S. N. Singh ( EE ) Dr. S. K. Singh ( IIM-L )
Forecasting McGraw-Hill/Irwin Copyright © 2012 by The McGraw-Hill Companies, Inc. All rights reserved.
Memory-Based Learning Instance-Based Learning K-Nearest Neighbor.
CS Instance Based Learning1 Instance Based Learning.
T T18-09 Line Plot (by Observation) Purpose Allows the analyst to visually analyze up to 5 time series plots on a single graph data samples by.
FLANN Fast Library for Approximate Nearest Neighbors
Radial-Basis Function Networks
© The Catholic University of America Dept of Biomedical Engineering ENGR 104: Lecture 2 Statistical Analysis Using Matlab Lecturers: Dr. Binh Tran.
Using Neural Networks in Database Mining Tino Jimenez CS157B MW 9-10:15 February 19, 2009.
Machine Learning Seminar: Support Vector Regression Presented by: Heng Ji 10/08/03.
Event Detection using Customer Care Calls 04/17/2013 IEEE INFOCOM 2013 Yi-Chao Chen 1, Gene Moo Lee 1, Nick Duffield 2, Lili Qiu 1, Jia Wang 2 The University.
RBF TWO-STAGE LEARNING NETWORKS: EXPLOITATION OF SUPERVISED DATA IN THE SELECTION OF HIDDEN UNIT PARAMETERS An application to SAR data classification.
Automated Construction of Parameterized Motions Lucas Kovar Michael Gleicher University of Wisconsin-Madison.
Holt’s exponential smoothing
Time Series Analysis and Forecasting
Applications of Neural Networks in Time-Series Analysis Adam Maus Computer Science Department Mentor: Doctor Sprott Physics Department.
1 Combining GLM and data mining techniques Greg Taylor Taylor Fry Consulting Actuaries University of Melbourne University of New South Wales Casualty Actuarial.
Time-Series Forecasting Overview Moving Averages Exponential Smoothing Seasonality.
Manipulations interpolation/extrapolation line intersections points in polygon line and polygon intersections union/intersection of polygon areas buffering.
K. Kolomvatsos 1, C. Anagnostopoulos 2, and S. Hadjiefthymiades 1 An Efficient Environmental Monitoring System adopting Data Fusion, Prediction & Fuzzy.
Signature Verification By Mayura Worlikar COSC 5010.
PRESENCE BASED ADAPTIVE CONTROL FOR INDOOR BUILDING LIGHTING
Time Series Analysis and Forecasting. Introduction to Time Series Analysis A time-series is a set of observations on a quantitative variable collected.
Example of prediction quality for the first (10 min) and last (3 h) prediction horizon element for the same sequence of WF Danilo power production events.
Energy-Efficient Signal Processing and Communication Algorithms for Scalable Distributed Fusion.
Online Evolutionary Collaborative Filtering RECSYS 2010 Intelligent Database Systems Lab. School of Computer Science & Engineering Seoul National University.
Multi-view Traffic Sign Detection, Recognition and 3D Localisation Radu Timofte, Karel Zimmermann, and Luc Van Gool.
About the Capability of Some Parallel Program Metric Prediction Using Neural Network Approach Vera Yu. Goritskaya Nina N. Popova
Motion Segmentation CAGD&CG Seminar Wanqiang Shen
LOAD FORECASTING. - ELECTRICAL LOAD FORECASTING IS THE ESTIMATION FOR FUTURE LOAD BY AN INDUSTRY OR UTILITY COMPANY - IT HAS MANY APPLICATIONS INCLUDING.
Managerial Decision Modeling 6 th edition Cliff T. Ragsdale.
1 A latent information function to extend domain attributes to improve the accuracy of small-data-set forecasting Reporter : Zhao-Wei Luo Che-Jung Chang,Der-Chiang.
Demand Management and Forecasting Chapter 11 Portions Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin.
Chapter 11 – With Woodruff Modications Demand Management and Forecasting Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
T T18-02 Weighted Moving Average Forecast Purpose Allows the analyst to create and analyze the "Weighted Moving Average" forecast for up to 5.
Predicting Future. Two Approaches to Predition n Extrapolation: Use past experiences for predicting future. One looks for patterns over time. n Predictive.
RAJEEV GANDHI COLLEGE OF MANAGEMENT STUDIES
Table 1. Advantages and Disadvantages of Traditional DM/ML Methods
Supervised Time Series Pattern Discovery through Local Importance
Fast Preprocessing for Robust Face Sketch Synthesis
Saliency detection Donghun Yeo CV Lab..
A Time Series Representation Framework Based on Learned Patterns
MLP Based Feedback System for Gas Valve Control in a Madison Symmetric Torus Andrew Seltzman Dec 14, 2010.
Cheng-Ming Huang, Wen-Hung Liao Department of Computer Science
Post Processing.
Lithography Diagnostics Based on Empirical Modeling
Eco 6380 Predictive Analytics For Economists Spring 2016
An Improved Neural Network Algorithm for Classifying the Transmission Line Faults Slavko Vasilic Dr Mladen Kezunovic Texas A&M University.
Center for Big Data Analysis
Department of Electrical Engineering
K. Kolomvatsos1, C. Anagnostopoulos2, and S. Hadjiefthymiades1
Deep Learning for Plant Stress Phenotyping: Trends and Future Perspectives  Asheesh Kumar Singh, Baskar Ganapathysubramanian, Soumik Sarkar, Arti Singh 
Distributed Edge Computing
Forecasting - Introduction
Memory-Based Learning Instance-Based Learning K-Nearest Neighbor
Presentation transcript:

g W. Yan 1 Multi-Model Fusion for Robust Time-Series Forecasting Weizhong Yan Industrial Artificial Intelligence Lab GE Global Research Center Niskayuna, NY 12309

g W. Yan 2 Outline 1.Problem Description Datasets Challenges and modeling strategies 2.Our Approach 3.The Results 4.Final Remarks

g W. Yan 3 Dataset characteristics Time series with seasonality, trend, and outlier Non-stationary

g W. Yan 4 Challenges and modeling strategies A model-building strategy that can automatically identify features (i.e., trend, seasonality, etc) of time series and arrives in a forecast model with robust & accurate performance for a large number of time series A large number of time series with different features. Manual, ad-hoc modeling strategies are not working

g W. Yan 5 Our Approach(1) - Preprocessing Outliers Feature identification Feature treatment automatically Trend

g W. Yan 6 Our Approach(2) - Modeling Generalized Regression NN

g W. Yan 7 It’s a variation of “nearest neighbor” approach Forecast for an input is a weighted average of the outputs in the training examples. The closer an input to the training example, the larger the weight of its corresponding output. Advantages 1.It’s a universal approximator 2.It’s fast in training (one-pass learning) 3.It’s good for sparse data Disadvantages 1.It requires large amount of online computation 2.It almost does not have any extrapolation capability (forecast is bounded by min & max of the observations) Our Approach(3) - Why GRNN?

g W. Yan 8 Results(1)

g W. Yan 9 Results(2)

g W. Yan 10 Results(3)

g W. Yan 11 Results(4)

g W. Yan 12 Results(5)

g W. Yan 13 Results(6)

g W. Yan 14 Final remarks  Developing a robust time series forecasting model is a challenging task.  Developing an automatic model building process that can be reliably applied to a large number of time series with varying features is even more challenging.  When the number of historical data points is small, fusion of multiple simple models seems to work better than a single complex model does Future work  Using more GRNNs  Optimally determining the tunable parameter, spread, for GRNNs  …

g W. Yan 15 Thank you