peter's profilePeter Koller's BI blogBlogLists Tools Help

peter koller

Occupation
Location

Feed

Loading...Loading...

Peter Koller's BI blog

On Microsoft's BI topology and BI in general
April 08

The IMF recognizes my dire economical situation

This is totally off topic so disregard if you are looking for BI related stuff. This is the most bizarre scam story I have come across so I though I would share.
 
World Bank/Imf Economy Stimulus Program.
(Internation Award 2009.)
08/04/2009
Our Ref: UK/SNT/IMF
Your Ref.
This is to officially inform you that the IMF and the World Bank have chosen you by
random e-mail selection as one of the final recipients of this year's (2009) Stimulus
Grant; the emails were selected from registries and surveys and randomly picked by a
highly developed program.
We are giving out an annual Grant with value, £900,000.00 GBP to 5 international
recipients as a Stimulus Grant from the World Bank in accordance with the campaign for
a better tomorrow. We hope to empower individuals with aims and projects but with no
capital. We hope these funds will be put to good use. To begin claims proceedings
Fill out below information and send it to the District Liason Officer via his email
contact address
************************************
Full Name:
Residential Address:
Occupation:
Country:
Telephone:
Fax Number:
************************************
Grant Batch No: STG-342.8876, G500-09
Mr. Benjamin Stewart
IMF British District Liason
E-mail: benjamin-stewart@msn.com
February 23

MS releases "Fast track track datawarehouse" reference architectures

Microsoft just released the press release detailing their first push into the high end, appliance DWH market. Let me just make it clear right away that this is NOT Madison. The reference architecture is preconfigured hardware running SQL Server 2008 Enterprise Edition with the following benefits to customers:
  • Per terabyte pricing
  • Linear and predictable performance
  • 1.6-32 terabytes capacity
  • A very competitive $/terabyte offering starting at around $13K (32 TB capacity) and ending at $25K (4 TB capacity)

In addition the reference architecture consists of best practices in

  • Windows OS configurations
  • SQL Server startup options
  • Database physical layout
  • Table types
  • Indexes
  • Statistics
  • Managing fragmentation
  • Loading procedures

This is a so called Symmetric Multiprocessing (SMP) offering with a "Shared Everything" architecture. That means (amongst other things) that a single DB instance/Server/CPU shares memory. This is opposed to Massively Parallell Processing (MPP) where nothing is shared and each Server/CPU have their own dedicated resources. The key here is parallellism and this is what Madison/DataAlegro and petabyte scalability is all about (the unit of measure in those systems is 100's of terabytes).

Even the "mid level" data volume that the reference architecture supports is still pretty rare and can mostly be found within the C&HT industries (Telcos) and Finance. With the exponential growth in data volumes seen in virtually every vertical this will change and create a bigger market for the DWH appliance vendors. 

More information can be found @ http://www.microsoft.com/sqlserver/2008/en/us/fasttrack.aspx

February 10

Allup BI VPC 7.1 released and a special treat for MS partners

Microsoft has released the latest version of their mammoth Allup BI VPC (now version 7.1). Still no sign of SQL Server 2008 though...
 
The bits (a massive 14 gigs) can be downloaded from

http://download.microsoft.com/download/E/5/0/E508CE7B-2726-4B6D-813A-033D78072E83/BI VPC R7.1.part01.exe

http://download.microsoft.com/download/E/5/0/E508CE7B-2726-4B6D-813A-033D78072E83/BI VPC R7.1.part02.rar

http://download.microsoft.com/download/E/5/0/E508CE7B-2726-4B6D-813A-033D78072E83/BI VPC R7.1.part03.rar

http://download.microsoft.com/download/E/5/0/E508CE7B-2726-4B6D-813A-033D78072E83/BI VPC R7.1.part04.rar

http://download.microsoft.com/download/E/5/0/E508CE7B-2726-4B6D-813A-033D78072E83/BI VPC R7.1.part05.rar

http://download.microsoft.com/download/E/5/0/E508CE7B-2726-4B6D-813A-033D78072E83/BI VPC R7.1.part06.rar

http://download.microsoft.com/download/E/5/0/E508CE7B-2726-4B6D-813A-033D78072E83/BI VPC R7.1.part07.rar

 

This is all well and good but as everyone working with environment has witnessed: Running the VPC on your run-of-the-mill laptop can be slow and requires a lot of space. Futhermore new releases are coming out quite often and downloading can be a hassle. Fear not: Microsoft's Cloud vision is not all talk. Partners can now sign up for a hosted environment at http://mssalesdemos.com where they can instantiate their own virtual server running the VPC and connect to it via Remote Desktop. In other words: Exactly what you do when you run it locally, only faster.

February 03

Latest Gartner Magic Quadrant for BI platforms

In the latest quadrant Microsoft is still in the leader quadrant for BI platforms. Gartner highlights Microsoft’s attractive license model, growing market penetration and quality of development tools. On the negative side metadata management is still a concern and long release cycles slow down the rate at which innovation reaches customers compared to some competitors.

 

Compared to last year Microsoft is overtaken by IBM / Cognos on the “Ability to execute” axis which should worry Redmond, especially since “Office integration” is highlighted as very strong.

 

A summary of the report can be found here.

January 23

PerformancePoint Planning is no more

Microsoft today anounced that they will retire PerformancePoint as a product.
 
 
Update 2: I have been asked to remove some of the content and direct you here.  
 
Update 3: I have changed the blog postings title to better reflect reality

 

(These opinions and observations are my own and do not necessarily reflect those of my employer)

Why is Microsoft doing this?

-          This has to be seen in light of the general economic climate. Microsoft, like everyone else, needs to adapt and as part of this look over its products in terms of profitability.

-          The cost of sales for PerformancePoint has been very high. These products require a sales process and organization that MS did not have and needed to build. This has proven more costly than anticipated.

-          The partner channel has not worked as intended. Enterprise Planning requires a functional and vertical skill set that most of the partner ecosystem did not have.

What does it mean for Microsoft’s investment in the BI platform?

-          This does not mean that MS is backing out of the BI business. Microsoft can now sharpen its focus on its successful core BI platform based on SQL Server and the Office Platform (Office+SharePoint).

-          Microsoft will continue to offer data warehouse, OLAP, data integration and front-end tools and distribution mechanisms.

-          The core BI platform is unaffected by this. In fact, SharePoint got even more attractive as a distribution platform for BI by the inclusion of the monitoring and analysis capabilities from PerformancePoint.

-          Microsoft has accelerated its release schedule for SQL Server to a new release every 24-36 months. This means that the BI platforms capability and functionality will be improved upon and expanded more rapidly than ever.

-          The next release of SQL Server, codenamed “Kilimanjaro” will be a BI specific upgrade to the platform. It will include powerful self-service analysis functionality exposed through Excel.

-          Microsoft is also working on integrating their DataAllegro aquisisition into SQL Server for large scale data warehouse deployments in the hundreds of terabytes range.

How will it affect PPS customers?

-          Customers running the core BI platform from Microsoft will be unaffected by this.

-          Customers using the Monitoring and Analytics parts of PPS will be unaffected by this.

-          Customers with SharePoint licenses can look forward to even richer BI functionality to be included in their existing licenses.

-          Customers that have implemented planning will need to look over their requirements and see if the SP3 version of the product will support their needs for the future.

-          Historically Microsoft has always compensated customers who have bought licenses that have been discontinued.

How will it affect partners?

-          Small specialized partners who placed a bet on PPS will obviously struggle with the investments they have made in the platform.

-          The whole ecosystem has to adjust their BI strategy and market offerings around Enterprise Performance Management, specifically the planning component.

-     This is an opportunity for 3rd parties to supply the needed planning functionality. There are a number of partners who offered this  functionality before PPS who now are in a good position to offer this to the market.

 

Update: The offical press release on this from Microsoft will come later this afternoon. As far as I know it will include guidance on what customers can do with their PPS licenses. Since the cat is out of the bag I will keep this blog post open even though the news is not technically public.

 

August 07

SQL Server 2008

Today Microsoft made SQL Server 2008 available for download off MSDN.
August 03

Bill Baker leaving Microsoft

Bill Baker who has been championing the BI area at Microsoft for over 10 years is now leaving Microsoft. Baker had a big role in shaping the BI strategy and products at Microsoft and also had a central role in the Proclarity aquisition. I guess its time to break out those CV's :)
 
Update: Bill's new employer is Visible Technologies. Here's a little blurb from them: "Visible Technologies announced this week the appointment of former Microsoft technologist and business intelligence luminary Bill Baker to the role of CTO. His new role at Visible Technologies clearly validates the increasingly pivot role of social media management in the marketing mix and the need for rich data insight into online conversations."
June 01

SSIS framework

I guess most of us who have worked on more than two ETL projects have thought about building this: A metadata driven ETL framwork built on SSIS technology. Looks like Microsoft beat us all to the punch and have released one for SSIS 2008.
April 25

New version of the Business Intelligence VPC from MS

There is a new version (version 6) of the complete, integrated demo virtual image available from Microsoft.
 
This is whats included in the VPC:

Presenter Scripts

Applications Installed

Sample Databases / Cubes

·          Business Intelligence “All-Up” Presenter Script

o    Financial Analyst

o    VP of Sales

o    Sales Representative

o    Chief Financial Officer

o    Data Analyst

·          2007 Microsoft Office System Launch Demo

·          Data Mining Deep Dive

·          Enterprise Manufacturing Intelligence Demo

·          Banking Demo

·          Federal Government Demo

·          State & Local Government Demo

·          Healthcare Demo

·          Oil & Gas Demo

·          Retail Demo

·          Project REAL Sample Demos

·          SQL Server 2005 Demos

·          PerformancePoint Launch Demo

·          PerformancePoint Budgeting Demo

·          PerformancePoint CRM Demo

·          PerformancePoint MAP (Monitoring, Analytics, and Planning) Demo

·          PerformancePoint Planning Demo

·          PerformancePoint Planning Consolidation Demo

·          PerformancePoint Management Reporter Demo

·          PerformancePoint Sales Forecasting Demo

·          PerformancePoint Strategic Planning Demo

·          OfficeWriter Demo

·          PerformancePoint Hands-On Labs

·          New Account Load Demo

·          Windows Server 2003 R2 Service Pack 2

·          Internet Explorer 7

·          Office Enterprise 2007

·          Office Visio 2007

·          SharePoint Portal Server 2007

·          SQL Server 2005 Service Pack 2 (w/ SSIS, SSAS, SSRS)

·          SQL Server 2005 Data Mining Add-ins

·          SQL Server 2005 SharePoint Integration Add-in

·          ProClarity Analytics Server 6.3

·          ProClarity Dashboard Server 6.3

·          ProClarity Desktop Professional 6.3

·          ProClarity Web Professional 6.3

·          PerformancePoint Planning Server 2007

·          PerformancePoint Planning Add-In for Excel

·          PerformancePoint Planning Business Modeler

·          PerformancePoint Monitoring Server

·          PerformancePoint Monitoring Scorecard Builder

·          OfficeWriter for Word Plug-In

·          OfficeWriter for Excel Plug-In

·          Project REAL Reference Implementation

·          Business Intelligence Metadata Samples

·          AdventureWorks

·          AdventureWorks_Mfg (for Lean Manufacturing)

·          AdventureWorksDW (for AdventureWorks data warehouse)

·          Camden (Local Government)

·          Contoso (for PerformancePoint Planning)

·          EP

·          Government_AppDB (PerformancePoint Planning)

·          HC

·          Healthcare_AppDB (PerformancePoint Planning)

·          OSS (Healthcare)

·          PDW (for PerformancePoint Planning)

·          PeoplSoft Financials_AppDB (PerformancePoint Planning)

·          PPS Launch (for PerformancePoint Planning)

·          PSFIN_Data_Mart

·          REAL_Source_Sample_V6 (for Project REAL)

·          REAL_Warehouse_Sample_V6 (for Project REAL)

 
Update: Dan English summarizes what has changed from the 5.1 release here
April 12

Could we get a better Excel provider please?

I have been working with the Excel provider in SSIS for a couple of years now. It has been pretty frustrating. If you have a neat excel sheet with simple columns it works fine and even picks up on data types. Once you get working with real excel sheets with complex nested headers you are walking into a world of pain. You have to start changing connection string properties (IMEX anyone) and usually resign to using named ranges or dumping data into a flat file. To me this is very odd. One would think that a provider in Microsoft's own ETL tool could handle Microsofts #1 data souce a little better.
March 17

MDXStudio

I do not know how this has gone under my radar but there is an incredible tool for analyzing your MDX queries available from Mosha and friends. Having built a MDX parser in my previous life MDXstudio's treeview of the structure of MDX made me feel inadequate and small.
March 05

Need some cool data?

I know, I know: Its been ages since I updated this blog. Please accept the usual excuses: Too much work, too little time. Anyway I came across a Slashdot article about the United Nations making available a lot of its statistical data on the web to the general public. This should give you a nice break from Adventureworks when creating demos!
December 18

Sending me messages

There are a lot of people sending me messages and questions through MSN. Some of you I cannot reply to because of a problem with your MSN account settings. If you want a reply, please fix your settings and resend your Q.

Enterprise Cube: Further verticals

The Enterprise Cube solution I blogged about earlier will broaden out into more verticals. First out are retail and production which should go into TAP early 2008.
 
As a guy working for a MS purist I think this is pretty good news. When I say pretty, there are a couple of issues with this solution that I think will effect partners and ISV's:
  • What will this mean for 3rd party solutions like Profitbase that also offer "packaged" BI solutions for verticals?
  • Enterprise Cube deployment and customization is supposedly a Microsoft Consulting Services responsebility. What will this mean for the MS BI partner network? Does MCS have the resources for this Globally?

 

The OLAP report reviews PerformancePoint

The Olap Report has reviewed PerformancePoint. All in all it is pretty positive so naturally it can be downloaded from Microsoft.
November 13

Enterprise Cube

In December Microsoft will launch its first (?) verticalized solution on their BI platform. The offering will target the telecom vertical. Basically what they are offering is the integrated BI stack (SQL Server, Sharepoint, PerformancePoint, Office) with intellectual property on top. This will consist of predefined data models, cubes, calculations, KPI's, reports and so on. The product is modularized into four subject areas: Customer Segmentation, Revenue Management, Profitability Management and Churn Analysis.
 
This fits very well with Microsoft's strategy of moving up the value-chain from being a pure platform provider to offering enterprise solutions and applications. Verticalizing is the next logical step and mimics what other players, such as SAP, have been doing for a while now.
October 08

SAP buys BusinessObjects

SAP is buying BO for a whooping $6.8 billion. Read more about it here.
October 03

Katmai SSIS profile task

I just saw a demo of a nice new SSIS task coming in SQL Server 2008. The profiling task allows you to output statistics on your data to an XML file (hopefully to other targets as well at RTM). The task gives statistics on things such as how many rows have nulls in a column (nullability), value distribution (number of unique values, what the values are and how many rows have each value) and so on. This is great for handling basic data quality issues and is a much needed improvement to the ETL toolset from Microsoft.
September 24

Microsoft's MDM strategy

Looks like MS is starting to flesh out its MDM strategy and integration of the Stratature technology into its own technology stack (under Office). Looks like we will see the first CTP release towards the end of 2008.  Have a look at this link for more information.
September 23

Want to work for the world's leading integrator of Microsoft technology?

Just thought I'd put this out there since you people probably work within the MS BI field. Avanade Nordics (Norway, Denmark, Finland, Sweden) is looking for BI professionals to join our growing team in the region. We are primarily looking for senior consultant profiles with a proven track record with the MS BI platform. Drop me a line if you are interested and I'll forward it to the right people. For more information about Avanade visit our homepages: Avanade.com and AvanadeAdvisor.com.
September 20

BusinessObjects for sale

 The consolidation in the BI market continues. Looks like BusinessObjects is getting ready to be bought, possibly by SAP. If SAP buys them we will have one less general BI competitor out there, a good thing for those of us working on the MS stack. The downside is that this will probably make SAP pretty self-sufficient in terms of BI (except ETL) giving us fewer opportunities for MS BI integration with SAP BW.
September 18

Some thoughts on PerformancePoint

With the release of PPS in the very near future I thought I'd share some of the thoughts I've had presenting, integrating and getting to know the product.

A new world

PerformancePoint is another example of Microsoft moving up the value chain both in terms of offering configurable packed enterprise applications and targeting the upper-mid and enterprise markets. The dynamics family of products with Microsoft CRM 3.0 and the Axapta ERP system are other examples of this. This is something that we see happening at other big players too, such as ORACLE. The move seems logical: First you build a robust platform (SQL Server, SharePoint, .NET, etc.), then you build applications on top of that. 

For Microsoft's partners within the Business Intelligence area this will present a couple of challenges. To be able to deliver technology within Corporate Performance Management one needs not only expertise on how to configure and integrate the technology, but also an understanding of the customer's vertical, functional expertise and knowledge of how CPM is implemented on the business side. Especially with the planning piece of PPS we are touching on the very heart and soul of corporations: How they model their business, how they set up their goals and how they plan to reach those goals. This requires that partners understand things like how to set up a budgeting and forecasting model, how to do financial consolidations to get an accurate view of enterprise performance and the whole process of planning for an enterprise with forecasting and budgeting cycles, approval processes, etc. Partners with a business consulting arm will definatly have a great advantage provided they can succesfully mate their technological know how with their business expertise.

Tip of the iceberg

Seeing where the PerformancePoint product is placed within the Microsoft BI stack there is no question the product will drive a lot work further down the stack. Even though PPS is a packaged application that theoretically can pull data directly from source system I think this is a scenario we will rarely see. To the contrary I think the product will open up opportunities for taking a bigger piece of the BI platform cake: ETL, datawarehousing, OLAP and data mining. If nothing else, PPS will act as a catalyst for this, when customers start to realize the benefit of an integrated BI system built on cost effective Microsoft infrastructure.

Integration

One of the biggest weaknesses see with PPS is the lack of integration with existing BI infrastructure. As it is today PPS forces you to "restage" and "redatawarehouse" your data even if its sourced from a clean, consolidated data warehouse. Most of this will of course be automated, but it still fragments data and will probably require a higher degree of hardware investments than strictly necessary. There are unupported workarounds for this, such as adding PPS columns to your datawarehouse tables. But that is of course a less than elegant hack.

Getting closer to BI Nirvana

With PPS, Microsoft is getting very close to offering a true end-to-end Business Intelligence solution. This will be even more true when the Master Data Management aquisition Straturum gets integrated in the stack. Couple this with the portal, document management and collaboration features of sharepoint and the penetration of Excel and those of us working with BI on the MS platform have a very strong story to tell.
August 16

PerformancePoint CTP 4 on connect

CTP 4 is out on connect. Whats new directly from the docs:

The following Monitoring and Analytics features have been added to Microsoft Office PerformancePoint Server 2007 (CTP4):

Dashboards

·         OLAP View Sorting/Filtering.  Users can now sort (by column) and filter empty rows/columns in Analytic Charts and Grids.

·         OLAP View Types.  Users can now switch between grids and charts and also change chart types (includes bar charts, stacked bar charts, stacked 100% bar charts, line charts and combined bar/line charts).

·         OLAP Member Properties in Grid.  Users can now add attributes of a member into the OLAP grid.

·         Cell Level Actions.  Users can now see the cell level actions behind a value in an OLAP grid or chart.

·         Export to PowerPoint.  SharePoint users can now export dashboard views to Microsoft Office PowerPoint.

·         Multiple Filters.  Users can now pass multiple dashboard filters to scorecards and report views.

·         Dashboard Viewer for SharePoint Services  Users can now add PerformancePoint Monitoring dashboard items to an existing SharePoint page through a new PerformancePoint Web Part.

Dashboard Designer

·         Dashboard Designer Ribbon Changes.  Usability improvements within the Dashboard Designer Ribbon, which is part of the Microsoft® Office Fluent™ User Interface.

·         OLAP View Configuration.  Enables light configuration options on charts and grid (fonts, formats, chart legend placement, grid layout).

·         PAS Integration.  Users can now add PAS report views into their dashboards.

·         Time Intelligence KPI Filters.  Users can now add Time Intelligence expressions to individual KPIs.

·         Scorecard Filters.  Users can now  pass members from scorecards into report views. (Example:  Passing the KPI Name to an SSRS report.)

Excel Services Support

·         Excel Services as a Data Source. Users can now import tables or named ranges from Excel Services spreadsheets.

The Planning component of Microsoft Office PerformancePoint Server 2007 (CTP4) does not have significant changes from its previous release (CTP2).  The following list contains the targeted improvements delivered by this latest release:

Business Modeler

·         Business Rule Templates.  Several additional rule templates have been added.

·         PPSCmd.  The command-line tool had some additions to provide ability for scripting of overall system processes.  For example, the ability to deploy and reprocess models and data.

·         Migration.  Additional feature work was done to enable migration of an application between two server environments.

·         Jobs.  Improved user experience for executing and managing jobs.

·         Data Types.  Dimension member properties now support more data types.

Excel Client

·         Offline Cache.  Improved management of locally cached objects.

·         Templates.  Additional report templates have been added.

·         Review and Approval.  Reviewers and Approvers can now manage submissions through a single dialog.  Support has been added for bulk operations.

·         Filters.  Form and report filters now support dimension properties.

Server

·         Performance. Several changes were made to improve overall server performance.  Additionally, Financial Job and calculations have specific performance enhancements.

·         System Information.  Error message reporting and system logging has been improved from prior releases.

·         Associations.  Improved capabilities for working with complex associations.  Better performance handling large associations and movement of large data set.

·         Security.  Public interfaces have improved resistance to any potentially malicious attacks.

 

June 27

Two new CTP programs within PerformancePoint

Just a quick heads-up that there are now two more CTP programs on connect related to PerformancePoint. One is for Management Reporter, a tool that lets users create boardroom quality financial reports in Excel or RDL format (as far as I can understand). After skimming through the documentation it looks like this is somewhat similar to report builder but with functional features for reporting on financial data. There also seems to be out of the box Dynamics AX integration. Pretty exciting stuff if you ask me, and another hint of the fact that Microsoft is broadening into the functional space of BI in addition of being a platform provider.

Update: Looks like this is the consolidation piece of PPS where you do your eliminations and so on. Not sure why the have taken it out of the "normal" PPS CTP.

The other CTP is the Data Integration Toolkit which i dont know much about, but it looks more like an accelerator for integrating GL data than an application.

May 15

Microsoft BI conference

Here are my thoughts on various topics that caught my attention at the MS BI Conference in Seattle.

Firstly I am not all that thrilled about the speeding up of the release cycles for SQL Server. Of course we will have to see how this plays out in reality. But if it means having to deal with a new core product every two or so years, with all that this entails in terms of certifications, migrations, customer confusion etc., I am more than happy to wait four years for the next release. The need for MS licencing revenue aside, I would much rather have solid SPs and the ability to buy an addin like the OfficeWriter as an extension to the license than have to deal with an "all new" product this often.

I was a bit surprised there was no mention of a MDM strategy of any kind from Microsoft. Especially considering the surfacing of recent MSDN articles on MDM. I am pretty sure we will hear more of this, as it is one of the key areas within BI where Microsoft lacks any real offering (that is, if you consider MDM a part of BI).

I like the scalability focus of the next version of SQL Server, codenamed Katmai. With data heavy technologies like RFID hitting the mainstream we will probably begin to see a demand for MUCH larger datawarehouses in the near future. Also with a bigger capacity SQL Server will be able to support large datawarehouses that have been the domain of appliance pureplays such as Teradata and Netezza. I just hope they scale all the components of the stack to the same level so that we wont end up with a classic as-good-as-its-weakest-link scenario.

Other than the Katmai release date and the OfficeWriter licensing there were disappointingly few announcements on Technology investments from Microsoft. I would have thought they would milk the BI Conference momentum for all its worth.

The data visualization / portal  3rd party vendors are clearly struggling. Apart from StrategyCompanion (I love the new version of their Analyzer product) none of them could tell me exactly why I should use their product over Reporting Services / Excel / PerformancePoint monitoring. In addition most of them are still hopelessy lost in the whole lets-make-everything-look-like-dashboard-widgets mantra. Is the market really so immature that they dont see the utter pointlessness of emulating real life objects to display data in meaningful ways?  I'm sure Stephen Few would go berserk in that Exhibitor hall.

Lastly: Where are all the 3rd party plugins to SQL Server 2005? Where are all the cool datamining algorithms? Where are all the datasource adapters for SSIS? With such an extensible platform as SQL Server it is pretty surprising that there are not more quality components being produced for SQL Server. All hail to the free stuff floating around (I use much of it) but isnt there a viable market for these things out there?