Presentation is loading. Please wait.

Presentation is loading. Please wait.

Constructing Data Mining Applications based on Web Services Composition Ali Shaikh Ali and Omer Rana

Published byDebra Reeves Modified over 8 years ago

Similar presentations

Presentation on theme: "Constructing Data Mining Applications based on Web Services Composition Ali Shaikh Ali and Omer Rana"— Presentation transcript:

1 Constructing Data Mining Applications based on Web Services Composition Ali Shaikh Ali and Omer Rana Ali.shaikhali@cs.cf.ac.ukAli.shaikhali@cs.cf.ac.uk, o.f.rana@cs.cardiff.ac.uko.f.rana@cs.cardiff.ac.uk Cardiff University http://www.cs.cf.ac.uk/ Welsh eScience Center http://www.wesc.ac.uk/

2 Welsh e-Science CentreAli Shaikh Ali Agenda… Software Demo Apps Objectives Q?

3 Welsh e-Science CentreAli Shaikh Ali Objectives Use of Web Services composition – with distributed services Wrap third party services (Mathematica, GNUPlot) WEKA Service template Triana Workflow Services provided by third parties WSDL interfaces (avoid use of specialist languages – unless really necessary) SOAP-based message exchange Access to local and remote data sets Support for data streaming

4 Welsh e-Science CentreAli Shaikh Ali Origin: Gravitational Wave data analysis (GEO-LIGO efforts)

5 Welsh e-Science CentreAli Shaikh Ali http://www.GridLab.org/ GAT GAP Interface Gridlab Services JXTAServe P2PS WServe JXTA Sockets Web Services OGSA + Services

6 Welsh e-Science CentreAli Shaikh Ali Software trianacode.org  An open source Problem Solving Environment developed at Cardiff  Triana includes a large library of pre-written analysis tools and the ability for users to easily integrate their own tools.  Supports discovery of Web Services based on syntax (hardwired UDDI registries) www.cs.waikato.ac.nz/ml/weka/  Collection of machine learning algorithms  Contains tools for  data pre-processing,  classification, regression,  clustering,  association rules  Accepts ARFF (Attribute-Relation File Format) file format -- an ASCII text file that describes a list of instances sharing a set of attributes. Related work: Grid WEKA (University College Dublin)

7 Welsh e-Science CentreAli Shaikh Ali WEKA Algorithms Classifiers Algorithms Bayes (8, eg. Naïve Bayes) Functions (12, eg. Neural Networks) Lazy (5) Meta (23, eg. Bagging, Multiclass Classifer) Trees (10, eg. ID3) Rules (10, eg. Conjunctive Rule) Misc (3) Clustering Algorithms (5, e.g. K-means) Association Rules (2, e.g Apriori) Data Processing Filters Attribute Selection Attribute Evaluator (12, eg. Principle Components) Attribute Search (8, eg. Genetic Algorithm)

8 Welsh e-Science CentreAli Shaikh Ali Provenance Issues EU FP6 Provenance project (2004—2006) IBM Hursley (lead), SZTAKI, Southampton University, DLR/German Aerospace, UPC http://www.gridprovenance.org/ EPSRC Provenance (2004—2007) University of Southampton (lead) http://www.pasoa.org/

9 Welsh e-Science CentreAli Shaikh Ali DEMO

10 Welsh e-Science CentreAli Shaikh Ali Inside the Data Mining Toolbox Deals with Dataset files e.g. load datasets, converts dataset formats Deals with data that need manipulation Visualize data

11 Welsh e-Science CentreAli Shaikh Ali Adding new Classifier Service Classifier Template This Web service implements a complete list of classifiers, i.e. trees, rules, functions etc. Operations classifyInstance() classifyRemoteInstance() getClassifiers( ) getOptions() Input: DataHandler dataset String classifierName String options String attributeName output: String result Input: null output: String listOfClassifiers Input: String classifierName output: String listOfApplicableOptions Input: String datasetURL String classifierName String options String attributeName output: String result → → → →

12 Welsh e-Science CentreAli Shaikh Ali Adding new Services … 2 1. Build your classifier must implement the 4 required methods 2. Place it in the classifier’s lib. 3. Done!

13 Welsh e-Science CentreAli Shaikh Ali Where can you find us? UDDI Browser An open-source project that provides a friendly user interface allowing users to browse and manipulate content in UDDI registries. It is written in Java using the Swing libraries. Currently the browser only supports version 2.0 UDDI registries. Cardiff UDDI: Inquiry: http://agents-comsc.grid.cf.ac.uk:8334/juddi/inquiry Publish: http://agents-comsc.grid.cf.ac.uk:8334/juddi/inquiry

14 Welsh e-Science CentreAli Shaikh Ali Download Triana available at: http://www.trianacode.org/ http://www.gridlab.org/ Data Mining Toolbox at: http://users.cs.cf.ac.uk/Ali.Shaikhali/dipso/

15 Welsh e-Science CentreAli Shaikh Ali Questions Who is part of the user community? elicit requirements What is different with reference to e-Science? additional capability provided by the Grid additional types of requirements What additional benefit does it provide? Ability to undertake multiple runs (what-if scenarios) Need to embed algorithms within some other program -- rather than have a stand-alone tool Can Web Services try to address this concern? Which algorithm in what context?

Download ppt "Constructing Data Mining Applications based on Web Services Composition Ali Shaikh Ali and Omer Rana"

Similar presentations

TSpaces Services Suite: Automating the Development and Management of Web Services Presenter: Kevin McCurley IBM Almaden Research Center Contact: Marcus.

TSpaces Services Suite: Automating the Development and Management of Web Services Presenter: Kevin McCurley IBM Almaden Research Center Contact: Marcus.
Florida International University COP 4770 Introduction of Weka.

Florida International University COP 4770 Introduction of Weka.
Web Service Ahmed Gamal Ahmed Nile University Bioinformatics Group

Web Service Ahmed Gamal Ahmed Nile University Bioinformatics Group
Weka & Rapid Miner Tutorial By Chibuike Muoh. WEKA:: Introduction A collection of open source ML algorithms – pre-processing – classifiers – clustering.

Weka & Rapid Miner Tutorial By Chibuike Muoh. WEKA:: Introduction A collection of open source ML algorithms – pre-processing – classifiers – clustering.
1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.

1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.
Distributed components

Distributed components
WEKA Evaluation of WEKA Waikato Environment for Knowledge Analysis Presented By: Manoj Wartikar & Sameer Sagade.

WEKA Evaluation of WEKA Waikato Environment for Knowledge Analysis Presented By: Manoj Wartikar & Sameer Sagade.
Department of Computer Science, University of Waikato, New Zealand Eibe Frank WEKA: A Machine Learning Toolkit The Explorer Classification and Regression.

Department of Computer Science, University of Waikato, New Zealand Eibe Frank WEKA: A Machine Learning Toolkit The Explorer Classification and Regression.
March 25, 2004Columbia University1 Machine Learning with Weka Lokesh S. Shrestha.

March 25, 2004Columbia University1 Machine Learning with Weka Lokesh S. Shrestha.
Workshop on Cyber Infrastructure in Combustion Science April 19-20, 2006 Subrata Bhattacharjee and Christopher Paolini Mechanical.

Workshop on Cyber Infrastructure in Combustion Science April 19-20, 2006 Subrata Bhattacharjee and Christopher Paolini Mechanical.
An Extended Introduction to WEKA. Data Mining Process.

An Extended Introduction to WEKA. Data Mining Process.
Introduction to WEKA Aaron 2/13/2009. Contents Introduction to weka Download and install weka Basic use of weka Weka API Survey.

Introduction to WEKA Aaron 2/13/2009. Contents Introduction to weka Download and install weka Basic use of weka Weka API Survey.
Programming Scientific and Distributed Workflow with Triana Services Matthew Shields, GGF10 Workflow Workshop, 9th March.

Programming Scientific and Distributed Workflow with Triana Services Matthew Shields, GGF10 Workflow Workshop, 9th March.
Web Service Implementation Maitreya, Kishore, Jeff.

Web Service Implementation Maitreya, Kishore, Jeff.
(C) 2013 Logrus International Practical Visualization of ITS 2.0 Categories for Real World Localization Process Part of the Multilingual Web-LT Program.

(C) 2013 Logrus International Practical Visualization of ITS 2.0 Categories for Real World Localization Process Part of the Multilingual Web-LT Program.
An Exercise in Machine Learning

An Exercise in Machine Learning
 The Weka The Weka is an well known bird of New Zealand..  W(aikato) E(nvironment) for K(nowlegde) A(nalysis)  Developed by the University of Waikato.

 The Weka The Weka is an well known bird of New Zealand..  W(aikato) E(nvironment) for K(nowlegde) A(nalysis)  Developed by the University of Waikato.
Comparing the Parallel Automatic Composition of Inductive Applications with Stacking Methods Hidenao Abe & Takahira Yamaguchi Shizuoka University, JAPAN.

Comparing the Parallel Automatic Composition of Inductive Applications with Stacking Methods Hidenao Abe & Takahira Yamaguchi Shizuoka University, JAPAN.
T-110.5140 Network Application Frameworks and XML Web Services and WSDL 02.04.2007 Sasu Tarkoma Based on slides by Pekka Nikander.

T Network Application Frameworks and XML Web Services and WSDL Sasu Tarkoma Based on slides by Pekka Nikander.
WEKA and Machine Learning Algorithms. Algorithm Types Classification (supervised) Given -> A set of classified examples “instances” Produce -> A way of.

WEKA and Machine Learning Algorithms. Algorithm Types Classification (supervised) Given -> A set of classified examples “instances” Produce -> A way of.

Similar presentations

Ads by Google