Senior Data Engineer

Microsoft is on a mission to empower every person and every organization on the planet to achieve more. Our culture is centered on embracing a growth mindset, a theme of inspiring excellence, and encouraging teams and leaders to bring their best each day. In doing so, we create life-changing innovations that impact billions of lives around the world. You can help us achieve ourmission.

Cloud Operations + Innovation (CO+I) is the engine that powers Microsoft's core cloud platforms and services that millions of people use every day. With more than 95% of Fortune 500 business on Azure, 180 million using Office 365, and millions using other services - all running on Microsoft's cloud infrastructure - CO+I builds andoperatesthe foundation upon which Microsoft's mission to empower every person and organization comes to life.

Are you passionate about cloud computing? Do you get excited about taking a hands-on approach to transforming Microsoft's most critical business through investigation, data analysis, and automation? If so, come and help us build the most reliable& efficientdatacenter infrastructure on the planet. The CO+I Critical Environment Systems Intelligence (CESI) teamis responsible fordesigning and delivering solutions to support global datacenter operations and to improve availability. CESI is helping to drive CO+I's transition toacustomercentric, data driven, live service culture. As a Senior Data Engineer, you will be a key player in this transition.

As aSenior Data Engineeron theCO+I Critical Environment Service Intelligence (CESI)team, you will design and deliver the data platforms and toolingrequiredto programmatically understand which customers areimpactedby changes occurring within our data centers. This work enables clear,datadrivenvisibility into customer impact resulting from both planned and unplanned infrastructure events.

You will partner closely with multiple CO+I teams, as well asAzure, Exchange, Bing, and otherfirstpartyservices, to model, integrate, and deliver this capability at scale. A successful candidate will apply strong data engineering fundamentals-data modeling, pipeline design, automation, andlowlatencyprocessing-whileleveragingdomain knowledge across data center infrastructure capacity, service management, customer experience (CXP), containers, cloud services, shared responsibility models, and geoandzoneredundantarchitectures.

Through this work, you will helpestablisha clear source of truth for ownership of data center assets and their relationships tocustomerfacingservices, enablingaccurate,timelyassessment of customer impact during outages and other operational events. The solutions you build willoperateover large, complex datasets and directly inform operationaldecisionmakingacross the fleet.

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positivelyimpactour culture every day.

As a Senior Data Engineer, you will:

• Deliver a data-driven solution to map from servers (and clusters) to their responsible First Party owners and services by exposing leaps of logic thatdon'texplicitly exist between systems

• Develop automations to appropriately calculate risk of impact to customers during an outage in collaboration with responsible parties and Azure Customer Experience.

• Perform thorough data analysis and testing toidentifydata gaps and ensure data quality.

• Work closely with application, data platform, and data engineering teams to reconfigure data ingestion pipelines to be more reliable and continuouslymonitored.

• Partner with engineering teamsto publish easy-to-consume, production-quality data assets

• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.