New

Databricks Engineer

TEKsystems
$69.00 - $88.00 / hr
life insurance, sick time, 401(k), retirement plan
United States, Maryland, Catonsville
Jul 30, 2025
Description These roles are primarily to support the migration of EMR to Databricks migration, SAS to Databricks migration, and a Databricks Medallion Re-architecture Position Summary: seeking a highly skilled Data Engineer. This role will play a critical part in the modernization of the data platform, building and maintaining scalable, high-performing data pipelines that drive enterprise analytics, reporting, and operational decision-making. The Data Engineer will focus on developing data ingestion, transformation, and processing pipelines across AWS and Databricks-based environments, with an emphasis on Delta Lake lakehouse architectures. Responsibilities: Design, build, and maintain robust ETL/ELT pipelines that ingest, transform, and curate data for analytics and reporting solutions. Develop efficient data processing workflows using Python, SQL, and PySpark within Databricks and Delta Lake environments. Implement scalable data lakehouse architectures supporting complex healthcare datasets and enterprise analytics. Collaborate with Data Architects, Automation Test Engineers, QA Analysts, and Business Analysts to define data transformation logic and data integration standards. Build reusable code and frameworks for data ingestion, data quality validation, and exception handling. Optimize data processing jobs for performance, reliability, scalability, and cost efficiency in AWS and Databricks cloud platforms. Participate in schema design, data modeling, and version-controlled data pipeline development. Contribute to data governance, metadata management, and data lineage documentation to support audit, compliance, and FISMA reporting requirements. Partner with DevOps teams to integrate data pipelines into CI/CD workflows using GitHub, Databricks Repos, and related tools. Perform root cause analysis and resolution of data issues across staging, integration, and production environments. Qualifications Bachelor's degree in Computer Science, Information Systems, Engineering, or related technical field 6+ years of experience in data engineering or data pipeline development roles Strong hands-on experience developing data pipelines using Python, SQL, and PySpark Experience in Java is a plus, to understand existing code and covert to Python and Databricks Notebooks Extensive experience with Databricks, including Databricks Workflows, Delta Lake, notebooks, and distributed computing Proven experience with ETL/ELT design, development, and optimization for large-scale data processing Solid understanding of data lakehouse architecture, data partitioning, and Delta Lake versioning Experience with AWS data services such as S3, Redshift, Glue, IAM, and RDS Familiarity with CI/CD processes for data pipelines (GitHub Actions, Jenkins, Databricks Repos) Experience with data quality validation, data profiling, and debugging data pipeline failures Strong collaboration and communication skills with ability to translate business needs into technical requirements Skills data modeling, analytics, design, data dictionaries, metadata repositories, data ingestion, data transformation, data curation, Redshift, S3, Databricks, RDS, Spectrum., performance optimization, data standardization, quality assurance, governance, ETL/ELT pipelines, error handling, data lineage tracking, versioning, CloudFormation, IAM, modern data lake architecture patterns, relational databases, dimensional modeling, data pipelines, data lifecycle, metadata management, Agile/Scrum, DevSecOps, CMS program experience, CMS Technical Reference Architecture (TRA), CMS Target Lifecycle (TLC), Working knowledge of SAS Viya, Working knowledge of QuickSight, Experience with healthcare or ACA-related data, FISMA audits, Section 508 compliance, CMS Acceptable Risk Safeguards (ARS 5.0) Top Skills Details data modeling,analytics,design,data dictionaries,metadata repositories,data ingestion,data transformation,data curation,Redshift,S3,Databricks,RDS,Spectrum.,performance optimization,data standardization,quality assurance,governance,ETL/ELT pipelines,erro Additional Skills & Qualifications Preferred Qualifications: Experience supporting CMS programs and understanding of the CMS Technical Reference Architecture (TRA) and Target Lifecycle (TLC). Exposure to BI platforms such as QuickSight, Tableau, or Power BI for data consumption and reporting validation. Familiarity with Unity Catalog, data governance, and access control within Databricks. Experience supporting regulated environments requiring audit trails, FISMA audits, or CMS Acceptable Risk Safeguards (ARS 5.0). Exposure to healthcare datasets such as ACA, QHP, HICS, or HIOS. Experience Level Expert Level Pay and Benefits The pay range for this position is $69.00 - $88.00/hr. Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following: * Medical, dental & vision * Critical Illness, Accident, and Hospital * 401(k) Retirement Plan - Pre-tax and Roth post-tax contributions available * Life Insurance (Voluntary Life & AD&D for the employee and dependents) * Short and long-term disability * Health Spending Account (HSA) * Transportation benefits * Employee Assistance Program * Time Off/Leave (PTO, Vacation or Sick Leave) Workplace Type This is a fully remote position. Application Deadline This position is anticipated to close on Aug 5, 2025. h4>About TEKsystems: We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company. The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law. About TEKsystems and TEKsystems Global Services We're a leading provider of business and technology services. We accelerate business transformation for our customers. Our expertise in strategy, design, execution and operations unlocks business value through a range of solutions. We're a team of 80,000 strong, working with over 6,000 customers, including 80% of the Fortune 500 across North America, Europe and Asia, who partner with us for our scale, full-stack capabilities and speed. We're strategic thinkers, hands-on collaborators, helping customers capitalize on change and master the momentum of technology. We're building tomorrow by delivering business outcomes and making positive impacts in our global communities. TEKsystems and TEKsystems Global Services are Allegis Group companies. Learn more at TEKsystems.com. The company is an equal opportunity employer and will consider all applications without regard to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.