//
you're reading...
Data Migration, Dynamics CRM

How do I get data faster inside Dynamics CRM? – Part 2


In my previous post I begun to discuss the options available for getting data faster inside Dynamics CRM and discussed “Buy vs Build” option when it comes to data migration and also laid out some suggestions to make any built application better performant in data migration. Today, I want to discuss another alternative for data migration – SQL Server Integration Services (SSIS).

SSIS

Source: MIchael J. Swart, Database Whisperer

SSIS is a tool that we can use to perform any Extract-Transform-Load (ETL) operations and the same can be used for loading data into Dynamics CRM. SSIS is one of the primary ETL tools used in Dynamics CRM projects for migrating data.

Here is a quick tip on SSIS to be tried while migrating large volume data into Dynamics CRM.

Use Balanced Data Distributor (BDD)

BDD takes advantage of concurrent processing capability of modern CPUs and distributes the incoming data into equal proportions of outgoing data, however many they are. If you have four outputs, roughly ¼ of the input rows will be routed to each output. Thus BDD introduces parallelism in the data flow of SSIS package and amps up use of multi-processor and multi-core servers.

SSIS BDD

Use of SSIS Balanced Data Distributor (BDD) requires a fair bit of understanding of hardware the package will be running, the performance of the data flow and nature of the data. BDD was designed to solve the bottlenecks of data migration. Generally, bottlenecks can happen in three places –

  1. Bottleneck at Source System. BDD is not going to help much in this case as BDD is out distributing input into multiple outputs.
  2. Bottleneck in the Transformation. BDD could help as it would parallelise the transformation logic.
  3. Bottleneck at Destination. BDD will be able to help in this case.

About Dipankar Bhattacharya

Dipankar is a CITA-F, ITIL certified professional specializing Customer Relationship Management (CRM) and Cloud Computing. He is a certified Microsoft Dynamics CRM specialist and Architect and have been working in the field of CRM for enterprise customers across the globe.

Discussion

No comments yet.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Blog Stats

  • 61,049 hits

Enter your email address to follow this blog and receive notifications of new posts by email.

Join 565 other followers

My Book

Follow me on Twitter

%d bloggers like this: