SSIS, SSAS & Stored Procedure

In the following series SSIS would be utilized to extract data from Stored Procedure which contain query that is linked with SSAS MDX query via linked Server. Talend requires additional components while SSIS has fewer components but the output is the same.

First process in extracting the query through SSAS via Linked Server is to create a linked server.

Linked Server

Second process is to create the stored procedure to extract the data.

Stored Procedure definition with the MDX and regular SQL qeury


Third process is to create an SSIS package. In the Control Flow component you need  two task which the Execute SQL Task and Data Flow task. 


The fourth step is to create the database connection to the source and destination systems. In this case only one database system is being utilized.



Another big difference between SSIS and Talend is that Talend  works well with JDBC but JDBC is allowed in SSIS rather .NET, OLED, ODBC etc which makes the connection easier to implement since the Java version may not work well with selected JDBC.




This will truncate the table using the SQL Statement issued. In Talend you can specify truncate at the table definition.


t



The sixth process is the stored procedure linkage. A variable has to be created to retrieve the user input and pass it along the stored procedure parameter defined in the stored procedure definition

 The last process is to push the data to the destination system. A different connection may be required. Verify the column matching. Now run the package.

Before the execution









Results


Additional Readings Transforming SSAS data   and Advanced ETL SSIS 2012 & Talend 

Comments

  1. kalyaniJune 1, 2020 at 1:38 AM

    Through this post, I know that your good knowledge in playing with all the pieces was very helpful. I notify that this is the first place where I find issues I've been searching for. You have a clever yet attractive way of writing on Msbi online training
    Msbi online training Hyderabad
    Msbi online training India

    ReplyDelete

Post a Comment

Popular posts from this blog

ETL ( Automation vs Manual )

ETL applications like Talend, SSIS and Pentaho can simplify ETL or Data migration by eliminating or reducing the amount of SQL coding needed to complete the process. However same functions performed by ETL applications can be performed by scripting using various dialect of SQL and programming language like C# or Java. The downside of scripting manually without an ETL application is the need of connecting to data source and destination source. However most vendors like Microsoft SQL Server provides developers the option through linked server using SQL Server Management Studio or Oracle MySQL Workbench for MySQL.  Depending on the application a third programming language is need as interface like Java or C++ when performing the process from a developmental application. This will allow both the source and destination sources to be linked.  Another problem with the manual process is the complexity of SQL coding needed which needs to be altered constantly and the length of the codes invol
Read more

Data Migration

Migrating data  can be a challenging  task depending on the size of the data, platform and systems involved with the migration process. The age or the nature of data can also add to the complexity of the migration process. Legacy data or old data needs to be re-validated and cleaned to prevent any major issues when the data has been migrated just like you have with Data Warehouse system. ETL applications like Talend , Pentaho and Microsoft SSIS can be utilized in this process. The structure of the data plays a major role in determining the schema and the layer of the data.Texted based systems and RDBMS have different properties that needs to be examined and changed. The final properties to be examined is the platform. Migrating data from SQL Server 2008 to SQL Server 2012 is much easier than migrating from SQL Server 2008 to Oracle 12c or 11g due to different datatypes, objects , schema and properties. In some cases the underlying objects like Stored pr
Read more