New Recruiter and Jobs: The Largest Enterprise Data Migration at LinkedIn
This addresses data migration challenges for enterprise-scale platforms like LinkedIn, but it is incremental as it applies existing migration principles to a specific case.
LinkedIn tackled migrating data from legacy databases to a new unified platform for Jobs and Recruiter products, ensuring no data discrepancies or downtime, and successfully implemented a general architecture and specific solutions to meet these criteria.
In August 2019, we introduced to our members and customers the idea of moving LinkedIn's two core talent products -- Jobs and Recruiter -- onto a single platform to help talent professionals be even more productive. This single platform is called the New Recruiter & Jobs. A critical and difficult part of this effort is migrating their existing data from the legacy database to the new database and ensure there is no data discrepancy and no down time. In this article, we will discuss the general architecture for a successful data migration and the thought process we followed. Then we expand these ideas to our circumstances and explain in more detail about our specific challenges and solutions. In the Ramp Process section, we explain the inherent difficulties in satisfying our success criteria and describe how we overcome these difficulties and fulfill the success criteria practically.