Senior Software Engineer, CoreAI

Joining theCoreAIorganization at Microsoft means becoming part of the team that builds the end-to-end AI stack powering Azure's innovation. As a member of theFIT trainingteam withinCoreAI, you will help develop the AI infrastructure that accelerates the creation of agentic AI systems across Microsoft. This role is dedicated to advancing scientific methods and scalable infrastructure for training agentic models to achieve frontier-level performance. You will contribute to LLMs, SLMs, and agentic models using both proprietary and open-source frameworks, all aimed at delivering reliable, enterprise-grade agentic workflows.

We areseekinga curious, independent, adaptable problem-solver who thrives on continuous learning, embraces changing priorities, and is motivated by creating meaningful impact. Candidates must be able tolead androlemodelsforteamthatisdriven, able to write efficient code, debug complex training jobs, document findings, anddemonstratea track recordof continuous improvement. Inaddition, we value an agile, startup-style mindset - someone who can iterate quickly, pivot when needed, and collaborate effectively in fast-paced, dynamic environments.

Microsoft's mission is to empower every person and every organization on the planet to achieve more. Asemployeeswe come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positivelyimpactour culture every day.

As amemberof our team, you willparticipatein developing innovative solutions acrossAIPlatform. Responsibilities include the following.

• Collaboration with engineers and researchers to build andoptimizetraining infrastructure and tools for LLMs, SLMs, multimodal, and code-specific models.

• Design, build and improveserviceswith high scalability and reliability.

• Design and implement the services to serve the prod traffic and fulfill the security and privacy requirements.

• Participate in efforts to deliver and improve engineering systems and practices to ensure service quality in complex cloud environments.

• Contribute to the deployment and monitoring of services in production environments.

Required Qualifications:

• Bachelor's Degree in Computer Science or related technical field and 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Python,or equivalent experience.

Other Requirements:

• 5+ years of software engineering experience, with significant ownership of production services, cloud platforms, distributed systems, or developer infrastructure.

• Strong experience building andoperatingcontainerized platforms using Kubernetes or similar orchestration systems.

• Strong coding skills in one or more systems or backend languages such as Python, Go, Rust, C++, C#, or Java.

• Experience designing reliableproductionAPIs, backend services, or control-plane systems that managecompute, storage, networking, or runtime environments.

• Solid understanding of cloud infrastructure fundamentals, including identity, networking, storage, observability, capacity planning, security, and safe deployment practices.

• Experience diagnosing production issues using logs, metrics, traces, dashboards, and incident response processes.

• Demonstrated ability to lead technical design, drive ambiguous projects to completion, mentor other engineers, and collaborate across teams.

Preferred Qualifications:

• Experience with Microsoft Azure, AWS, or Google Cloud, especially managed Kubernetes, container registries, object storage, private networking, identity, secrets, and monitoring services.

• Experience building multi-tenant platforms where reliability, fairness, quota management, isolation, and security are important.

• Experience with sandboxed execution environments, remote development environments, hosted notebook/tool environments, evaluation infrastructure, or ephemeral compute platforms.

• Experience with container image build systems, registry authentication, image caching, package caching, artifact distribution, or startup-latency optimization.

• Experience with cloud networking concepts such as ingress, DNS, proxies, egress control, private endpoints, service routing, and traffic management.

• Experience with secure runtime design, including authentication, authorization, workload identity, secret handling, network isolation, and protecting shared infrastructure from untrusted workloads.

• Experience with AI infrastructure, agent execution, evaluation platforms, GPU workloads, Windows/Linux runtime environments, or VM/container hybrid systems.

• Experience improving service operability through structured logging, distributed tracing, dashboards, alerting, automated validation, and incident playbooks.