Lead Data Engineer Full Time

Position: Lead Data Engineer

Location: San Francisco, CA – Hybrid

Duration: 9+Months with possible extension

Main skills: SQL, Databricks, ADF, DataStage (or other ETL tool), SSAS cubes, Cognos/other, Tableau/other, ThoughtSpot

Job Description:

We are seeking a Lead Data Engineer to design, implement, and maintain our data infrastructure and business intelligence solutions. This role requires a technical expert who can architect scalable data solutions while collaborating across teams to drive business insights.

Required Experience:

• 8-10 years of software development and deployment experience
• At least 7 years of hands-on experience with:
• SQL
• Databricks
• Azure Data Factory (ADF)
• DataStage (or other ETL tools)
• SSAS cubes
• BI tools (Cognos, Tableau, ThoughtSpot, etc.)
• Strong Database knowledge (SQL & No-SQL preferred)
• Advanced SQL and Python skills
• Experience working with APIs for data collection/ingestion

Key Responsibilities:

Technical Development:

• Write SQL for processing raw data, Kafka ingestions, ADF pipelines, data validation, and QA
• Lead, design and implement innovative analytical solutions using Tableau, SQL, and Big Data technologies
• Experience with storing, joining, filtering, and analyzing data using SQL, Spark, Hive, etc.