{"id":5175,"date":"2016-04-04T15:11:37","date_gmt":"2016-04-04T14:11:37","guid":{"rendered":"http:\/\/www.etlsolutions.com\/?p=5175"},"modified":"2019-11-07T13:34:50","modified_gmt":"2019-11-07T13:34:50","slug":"a-six-stage-process-for-data-migration","status":"publish","type":"post","link":"https:\/\/etlsolutions.com\/a-six-stage-process-for-data-migration\/","title":{"rendered":"A six-stage process for data migration"},"content":{"rendered":"<p>Migrating data is a specialist activity that demands a detailed plan \u2013 especially if the project involves complex data.\u00a0Our <a href=\"https:\/\/www.etlsolutions.com\/data-migration-software-services\/\">data migration service<\/a> uses a clear process to mitigate risk and maximise the opportunity for project success. This process has been applied by our consultants to migrations of even the most complex data. Here are the six stages that we consider.<\/p>\n<h4>Stage 1: Project scoping<\/h4>\n<p>If the parameters of the project are unclear, or if you haven\u2019t conducted a data migration before, you will benefit from a scoping exercise. Draw up a plan before the project starts that sets out critical areas of the project\u2019s structure. Elements to include are:<\/p>\n<ul>\n<li>Stakeholders and their required deliverables<\/li>\n<li>Business domain knowledge, system expertise and migration expertise<\/li>\n<li>Communication plans and reporting requirements<\/li>\n<li>Budget and deadlines.<\/li>\n<\/ul>\n<p>If using an external provider to run the project, be clear about your own dataset or you could end up changing requirements and incurring additional fees. Be honest about the scale of the project and have a clear understanding of its scope before agreeing costs with a supplier. This also aids budgeting of an internally-run project.<\/p>\n<p>Our consultants also carry out a review of the migration itself to ensure that all its aspects are functionally correct. This includes:<\/p>\n<ul>\n<li>Ensuring the routes of communication are defined<\/li>\n<li>Ensuring storage and versioning of project artefacts is available<\/li>\n<li>Ensuring hardware is available and accessible<\/li>\n<li>Ensuring that our consultants have access to any required sites or buildings.<\/li>\n<\/ul>\n<p><a href=\"https:\/\/www.etlsolutions.com\/free-eguide-preparing-a-data-migration-plan\/\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-6485\" src=\"https:\/\/etlsolutions.com\/wp-content\/uploads\/2016\/07\/Data-migration-eGuide-read-more.jpg\" alt=\"Data-migration-eGuide\" width=\"450\" height=\"213\" srcset=\"https:\/\/etlsolutions.com\/wp-content\/uploads\/2016\/07\/Data-migration-eGuide-read-more.jpg 450w, https:\/\/etlsolutions.com\/wp-content\/uploads\/2016\/07\/Data-migration-eGuide-read-more-250x118.jpg 250w, https:\/\/etlsolutions.com\/wp-content\/uploads\/2016\/07\/Data-migration-eGuide-read-more-120x57.jpg 120w\" sizes=\"(max-width: 450px) 100vw, 450px\" \/><\/a><\/p>\n<h4>Stage 2: Resource evaluation<\/h4>\n<p>A clear methodology\u00a0is essential if you want a staged, well-managed and robust approach to data migration. Our proven methodology includes thorough assessments of the project and a core migration process <a href=\"https:\/\/www.etlsolutions.com\/how-to-plan-a-data-migration-project\/\">(see details of the process here)<\/a>. Consider incorporating standards into your project. Standards are used to identify problem areas early on, making sure that you don\u2019t reach the final stages with a hundred different issues to sort out. For instance, at ETL Solutions we have the Prince2 management standard, and use ISO standards where appropriate to underpin our data migration methodology.<\/p>\n<p>You will also need to evaluate the migration tools available to you. Apart from evaluation of its features, the critical questions to consider about the data migration software used for the project include: how flexible is your preferred migration tool? Is there a fit with the skills of the people working on the project? If using an external company to manage the project, confirm whether the software is included in the cost, or whether there will be an additional fee.<\/p>\n<p>Initial assessment of staff competency and training requirements can reduce reliance on external experts and boost the confidence of the project team. Will the people carrying out the project be there for the duration?\u00a0 Are they skilled and knowledgeable in the toolsets and methodology they\u2019ll be using? For individuals, this process provides clarity about their role within the data migration.<\/p>\n<h4>Stage 3: Migration design<\/h4>\n<p>This stage plans the extraction, verification and transformation of the data. These core steps are included in our bespoke data migration methodology to enable an uninterrupted flow of data during the migration. <a href=\"https:\/\/www.etlsolutions.com\/how-to-plan-a-data-migration-project\/\">(See more details of the methodology here.)<\/a><\/p>\n<p>The migration itself is dependent on key artefacts being available at this point in the migration project. The migration design should include:<\/p>\n<ul>\n<li>How the data is extracted, held and verified<\/li>\n<li>Mapping rules<\/li>\n<li>How data is loaded into the new system<\/li>\n<li>Recovery plans for each stage of the migration<\/li>\n<li>A schedule of the actions required to go live.<\/li>\n<\/ul>\n<h4>Stage 4: Testing design<\/h4>\n<p>The testing design stage defines an overall test plan for all stages of the migration. An initial overview should assess the tools, reporting, structures and constraints involved with testing. The overview usually includes how each stage will be tested at unit level, followed by how the entire migration will be tested from start to end to ensure that the data flows accurately.<\/p>\n<p>Unit test specifications will define test groups, which contain individual tests for that particular area of the migration. Each test should be broken down into its component steps, including description and expected results.<\/p>\n<h4>Stage 5: Development<\/h4>\n<p>Our consultants use an agile methodology to develop a data migration project in stages. This has proved particularly successful in migrations where a number of stakeholders are involved. An agile approach, which is clearly visible across all teams, ensures that risks are mitigated as soon as they occur. It also provides test data relatively early in the process.<\/p>\n<p>We also create a test framework. This framework allows tests to be run regularly down to unit level, highlighting any potential issues.<\/p>\n<h4>Stage 6: Execution<\/h4>\n<p>Dry runs are often carried out to test the go-live strategy, enabling the go-live plan to be adjusted if necessary. When you&#8217;re ready to go live, you might consider implementing the migration at the weekend to reduce disruption to the organisation. Alternatively, you could run the old and new systems concurrently and transfer data piece-by-piece. Our preference, if business objectives allow, is a parallel migration. This can increase budgets and timescales, but enables your team to address any issues that occur, with minimal disruption.<\/p>\n<p>This process helps ensure that the project is delivered successfully with minimum risk.<\/p>\n<h2>Further reading<\/h2>\n\n<div class=\"wpcf7 no-js\" id=\"wpcf7-f5554-o1\" lang=\"en-US\" dir=\"ltr\">\n<div class=\"screen-reader-response\"><p role=\"status\" aria-live=\"polite\" aria-atomic=\"true\"><\/p> <ul><\/ul><\/div>\n<form action=\"\/wp-json\/wp\/v2\/posts\/5175#wpcf7-f5554-o1\" method=\"post\" class=\"wpcf7-form init\" aria-label=\"Contact form\" novalidate=\"novalidate\" data-status=\"init\">\n<div style=\"display: none;\">\n<input type=\"hidden\" name=\"_wpcf7\" value=\"5554\" \/>\n<input type=\"hidden\" name=\"_wpcf7_version\" value=\"5.8.5\" \/>\n<input type=\"hidden\" name=\"_wpcf7_locale\" value=\"en_US\" \/>\n<input type=\"hidden\" name=\"_wpcf7_unit_tag\" value=\"wpcf7-f5554-o1\" \/>\n<input type=\"hidden\" name=\"_wpcf7_container_post\" value=\"0\" \/>\n<input type=\"hidden\" name=\"_wpcf7_posted_data_hash\" value=\"\" \/>\n<input type=\"hidden\" name=\"_wpcf7_recaptcha_response\" value=\"\" \/>\n<\/div>\n<p>Did you like this article? Get our new articles in your inbox with our occasional email newsletter.\n<\/p>\n<p><span class=\"wpcf7-form-control-wrap\" data-name=\"your-email\"><input size=\"40\" class=\"wpcf7-form-control wpcf7-email wpcf7-validates-as-required wpcf7-text wpcf7-validates-as-email\" aria-required=\"true\" aria-invalid=\"false\" placeholder=\"Your email\" value=\"\" type=\"email\" name=\"your-email\" \/><\/span>\n<\/p>\n<p><input class=\"wpcf7-form-control wpcf7-submit has-spinner\" type=\"submit\" value=\"Sign up for more data knowledge\" \/>\n<\/p>\n<p>We will never share your details with anyone else, except that your data will be processed securely by EmailOctopus (https:\/\/emailoctopus.com\/) in a third country, and you can unsubscribe with one click at any time. Our privacy policy: https:\/\/www.etlsolutions.com\/privacy-policy\/.\n<\/p><div class=\"wpcf7-response-output\" aria-hidden=\"true\"><\/div>\n<\/form>\n<\/div>\n\n<p><a href=\"https:\/\/www.etlsolutions.com\/free-eguide-preparing-a-data-migration-plan\/\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-6485\" src=\"https:\/\/etlsolutions.com\/wp-content\/uploads\/2016\/07\/Data-migration-eGuide-read-more.jpg\" alt=\"Data-migration-eGuide\" width=\"450\" height=\"213\" srcset=\"https:\/\/etlsolutions.com\/wp-content\/uploads\/2016\/07\/Data-migration-eGuide-read-more.jpg 450w, https:\/\/etlsolutions.com\/wp-content\/uploads\/2016\/07\/Data-migration-eGuide-read-more-250x118.jpg 250w, https:\/\/etlsolutions.com\/wp-content\/uploads\/2016\/07\/Data-migration-eGuide-read-more-120x57.jpg 120w\" sizes=\"(max-width: 450px) 100vw, 450px\" \/><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"Migrating data is a specialist activity that demands a detailed plan \u2013 especially if the project involves complex data.\u00a0Our data migration service uses a clear process to mitigate risk and maximise the opportunity for project success. This process has been applied by our consultants to migrations of even the most complex data. Here are the&#8230; <a class=\"view-article\" href=\"https:\/\/etlsolutions.com\/a-six-stage-process-for-data-migration\/\">View Article<\/a>","protected":false},"author":1,"featured_media":5177,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_mo_disable_npp":"","footnotes":""},"categories":[4,31],"tags":[],"acf":[],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/etlsolutions.com\/wp-json\/wp\/v2\/posts\/5175"}],"collection":[{"href":"https:\/\/etlsolutions.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/etlsolutions.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/etlsolutions.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/etlsolutions.com\/wp-json\/wp\/v2\/comments?post=5175"}],"version-history":[{"count":11,"href":"https:\/\/etlsolutions.com\/wp-json\/wp\/v2\/posts\/5175\/revisions"}],"predecessor-version":[{"id":6499,"href":"https:\/\/etlsolutions.com\/wp-json\/wp\/v2\/posts\/5175\/revisions\/6499"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/etlsolutions.com\/wp-json\/wp\/v2\/media\/5177"}],"wp:attachment":[{"href":"https:\/\/etlsolutions.com\/wp-json\/wp\/v2\/media?parent=5175"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/etlsolutions.com\/wp-json\/wp\/v2\/categories?post=5175"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/etlsolutions.com\/wp-json\/wp\/v2\/tags?post=5175"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}