Software Engineer, Data Engineering (CoreAI)

The CoreAI team is dedicated to empowering every developer to shape the future with AI. This involves creating tools, platforms, and workflows that redefine software development and enable dynamic, AI driven applications.   

The Core AI Infra data science team is focused on building telemetry and observability for the MSFT GPU fleet.  

Responsibilities

• Collaborates with others to identify opportunities to optimize data tools used to transform, manage, and access data across teams, scaling with efficiency and reduced time to new data insights.  
• Writes code to test advanced storage and availability of data platforms and leads the implementation of sustainable design patterns to make data platforms more usable and robust to failure and change.  
• Identifies trends across relevant data sources that allow others to develop insights to plan future data architecture designs or solution fixes. 
• Uses and contributes to the development of advanced and reusable modification techniques and operations (e.g., inserting, aggregating, joining) to transform raw data into a form (e.g., dimensional data model) that is compatible with downstream data consumers, databases, and formats that support applications, analytics and reporting. Expands the application and reusability of software, query languages, and computing tools (e.g., cloud-based) to transform raw data from multiple pipelines..  
• Identifies multiple, complex data sources and builds advanced code to extract raw data from identified upstream sources using query languages, tools, or machine learning algorithms, while assuring quality, scale, and reliability of the data across the pipeline. Contributes to the code review process by providing feedback and suggestions for implementation. Drives the business case to implement advanced orchestration techniques that automate data extraction logic for many sources of data. Plans and strategizes the use of advanced data protocols, reduction techniques, and aggregation approaches to validate the quality of extracted data across the data pipeline, consistent with the service level agreement (SLA). Refines and improves methods and tools used to track and maintain source control and assists in the development of versioning strategy. Applies deep knowledge of data to validate that the correct data is ingested and that the data is applied accurately across the pipeline. Creates data architectural documents for end-to-end systems. 

Qualifications

Required Qualifications:

• Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript or Python
• Experience designing data models for projects and translating business requirements into design specification documents to model the flow and storage of data across data pipelines.
• OR equivalent experience.

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $139,900 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Microsoft posts positions for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay 

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances.  We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.