Sr. Data Engineer Full Time

RGP is seeking a highly skilled and experienced Microsoft Fabric Sr. Data Engineer to join our Data and Analytics team. The ideal candidate will have experience with the SDLC for modern cloud-based data environments, automated data quality controls, and hands-on experience within Microsoft Fabric.

You will design and maintain CI/CD pipelines, development branching strategies, build automated data quality tests, and set up the release gates for environment promotions from Dev through Production for all aspects of our internal data projects.

Key Responsibilities

• Design and maintain CI/CD pipelines for automatic deployment of Fabric artifacts (notebooks, pipelines, semantic models, etc.) across all workspaces
• Design and maintain branching strategies
• Create test strategy and test plans; impact analysis and risk matrix
• Define and implement a data quality framework – covering completeness, accuracy, uniqueness, referential integrity, and business rule validation
• Write and maintain automated tests integrated into our data lineage and CI pipelines.
• Build and optimize Lakehouses, Delta tables, and Power BI Semantic Models to support enterprise analytics and reporting
• Configure Fabric monitoring/alerts for failures, long-running jobs, and capacity alerts and audit logs and logging
• Contribute to data governance, lineage, cataloging, and metadata management initiatives

Required Qualifications

• Bachelor’s or Master’s degree in computer science, Engineering, or a related field
• 5+ years of experience in data engineering, QA development or a similar role
• Solid understanding of trunk-based development branching strategies
• Experience with data quality frameworks such as Great Expectations, dtd test, or Soda
• Strong experience with Python, PySpark, or Spark-based distributed processing technologies
• Proven expertise with Microsoft Fabric, Azure Data Factory, Databricks, Synapse or Azure Data Services
• Data profiling and lineage tracing
• Experience with CI/CD, DevOps practices, Git and automated testing frameworks.
• Experience writing automated tests and familiar with data testing concepts (row counts, schema validation, referential integrity, etc.)
• Familiarity with Azure Key Vault, Microsoft Entra ID, and role-based access control concepts
• Strong written and verbal communication skills

Preferred Qualifications

• Experience with Microsoft Purview for data governance and sensitivity labeling
• Familiarity with Power BI workspace management, deployment pipelines, and row level security configuration
• Experience with ensuring compliance with regulatory, privacy, and retention requirements
• Prior work on a Medallion (Bronze/Silver/Gold) lakehouse project
• Previous experience integrating data from Workday, Salesforce, on-premise SQL, and other enterprise systems
• High level of proficiency in SQL, data transformations, and performance tuning