High Performance Analytics (HPA) in NetWeaver 2004s Thomas Zurek SAP NetWeaver BI.

Slides:



Advertisements
Similar presentations
Module 13: Performance Tuning. Overview Performance tuning methodologies Instance level Database level Application level Overview of tools and techniques.
Advertisements

HANA Overview and Capabilities
© 2010 TIBCO Software Inc. All Rights Reserved. Confidential and Proprietary. TIBCO Spotfire Application Data Services TIBCO Spotfire European User Conference.
SAP OLAP, Business Intelligence, & Analytics. ©2011 SAP AG. All rights reserved.2 Model for Data Warehouse for Tyson Foods Dimension tables provide inputs.
Materialization and Cubing Algorithms. Cube Materialization Each cell of the data cube is a view consisting of an aggregation of interest. The values.
Klaus Majenz SAP – Product Line BI
Presented by Brad Gall Using BI Techniques for Database Statistics.
Shimin Chen Big Data Reading Group.  Energy efficiency of: ◦ Single-machine instance of DBMS ◦ Standard server-grade hardware components ◦ A wide spectrum.
307: BW Performance Tuning - Queries / Data Loads
Jeremy Boyd Director – Mindscape MSDN Regional Director
Making Data Warehouse Easy Conor Cunningham – Principal Architect Thomas Kejser – Principal PM.
Scale-out databases for CERN use cases Strata Hadoop World London 6 th of May,2015 Zbigniew Baranowski, CERN IT-DB.
UNWBW1 – Business Information Warehouse NetWeaver Support Consultant Training Data Loading.
Performance and Scalability. Performance and Scalability Challenges Optimizing PerformanceScaling UpScaling Out.
1.
IST722 Data Warehousing Business Intelligence Development with SQL Server Analysis Services and Excel 2013 Michael A. Fudge, Jr.
What is SAP HANA SAP HANA is new Platform Developed By SAP New Product User based license upgrade from ECC 6 TO SAP HANA Possible with 20% Additional Cost.
Steward system Seokjoo Lee University of Florida
One Billion Objects in 2GB: Big Data Analytics on Small Clusters with Doradus OLAP There are many good software modules available today that provide big.
Web Archiving and Access Mike Smorul Joseph JaJa ADAPT Group University of Maryland, College Park.
The 20-Minute Tabular Model Bill Anton Prime Data Intelligence.
BW Know-How Call : Performance Tuning dial-in phone numbers! U.S. Toll-free: (877) International: (612) Passcode: “BW”
Chapter 14 Sharing Enterprise Data David M. Kroenke Database Processing © 2000 Prentice Hall.
OLAP & DSS SUPPORT IN DATA WAREHOUSE By - Pooja Sinha Kaushalya Bakde.
Designing Aggregations. Performance Fundamentals - Aggregations Pre-calculated summaries of data Intersections of levels from each dimension Tradeoff.
National Levee Database Interactive Reports Instructions NLD Point of Contact 1 US Army Corps of Engineers.
Frank Dehnewww.dehne.net Parallel Data Cube Data Mining OLAP (On-line analytical processing) cube / group-by operator in SQL.
Institute for Personal Robots in Education (IPRE)‏ CSC 170 Computing: Science and Creativity.
1 Agenda 7 Hints from the field: how to make BI- Accelerator work for you  Sizing and Implementation  Management and Costs.
Firewater The “split” personality of LucidDB A quick whirl through combining a purpose built BI database with scale “out” capabilities aka – LucidDB roadmap.
1 Adaptive Parallelism for Web Search Myeongjae Jeon Rice University In collaboration with Yuxiong He (MSR), Sameh Elnikety (MSR), Alan L. Cox (Rice),
Oracle OLAP Option Bud Endress Director of Product Management, OLAP.
Scalable data access with Impala Zbigniew Baranowski Maciej Grzybek Daniel Lanza Garcia Kacper Surdy.
Computer Performance. Hard Drive - HDD Stores your files, programs, and information. If it gets full, you can’t save any more. Measured in bytes (KB,
--A Gem of SQL Server 2012, particularly for Data Warehousing-- Present By Steven Wang.
SPECTO TRAINING contact us: , mail :
Optimizing SQL Server and Databases for large Fact Tables =tg= Thomas Grohser, NTT Data SQL Server MVP SQL Server Performance Engineering SQL Saturday.
SAP NetWeaver Business Intelligence SAP Netweaver Business Warehouse (SAP NetWeaver BW) the name of the Business Intelligence,
SAP Tuning 실무 SK㈜ ERP TFT.
Honest Bob’s Cube Processing Bob Duffy Database Architect.
Excel Business Intelligence Tools Lisa Friedrichsen Johnson County Community College Overland Park, Kansas.
Large Scale Semantic Data Integration and Analytics through Cloud: A Case Study in Bioinformatics Tat Thang Parallel and Distributed Computing Centre,
UNIX Epi Dakai Zhu January 5th, 2005.
Hadoop file format studies in IT-DB Analytics WG meeting 20 th of May, 2015 Daniel Lanza, IT-DB.
The demonstration of Lustre in EAST data system
WinCC-OA Log Analysis SCADA Application Service - Reporting
Execution Planning for Success
The New Possibilities in Microsoft Business Intelligence
Privacy Preserving Subgraph Matching on Large Graphs in Cloud
Blazing-Fast Performance:
Your great subtitle in this line
Conditions leading to the rise of virtual machines
Implementing Data Models & Reports with Microsoft SQL Server
Azure SQL Data Warehouse Performance Tuning
Lesson 4: Advanced Transforms
Designing Business Intelligence Solutions with Microsoft SQL Server
Types of OLAP Servers.
20 Questions with Azure SQL Data Warehouse
Reading Execution Plans Successfully
Managing batch processing Transient Azure SQL Warehouse Resource
Midterm review.
Building your First Cube with SSAS
Highly Compressed 82MB 1 =---====""- ·-*i.
Become a Power BI Superstar under 1 hour!
Let’s Build a Tabular Model in Azure
Power BI at Enterprise-Scale
Dashboard in an Hour Using Power BI
Reading execution plans successfully
Parallel Feature Identification and Elimination from a CFD Dataset
Become a Power BI Superstar under 1 hour!
Presentation transcript:

High Performance Analytics (HPA) in NetWeaver 2004s Thomas Zurek SAP NetWeaver BI

 SAP AG 2005, HPTS 2005 / 2 HPA Engine based on Adaptive Computing What is HPA ? SAP BI 7.0 Data Acquisition InfoCubes Analytical Engine Business Explorer Any Tool Any Source SAP NetWeaver 2004s

 SAP AG 2005, HPTS 2005 / 3 What is HPA ? cont'd blade-server based appliance search engine technology  originally developed for unstructured data  now applied to structured data (cube data) data resides in indexes  compressed  vertically / column-wise decomposed  no precomputed results (like materialized views, MOLAP aggregates, …) query processing  parallel  horizontal partitioning  main memory processing

 SAP AG 2005, HPTS 2005 / 4 Cube 1,002,958,286 fact rows on the file system:  CSV files: 950 GB on the RDBMS:  data: 64 GB  indexes:56 GB on the HPA blade servers:  indexes:9 GB  upload: ≈ 7 hours Demo Statistics HPA server 7 * 2 CPU blades each CPU 3.2 GHz 2 GB memory per CPU 1 index server per CPU 470 MB memory consumed per server/CPU 120 GB