Lead Data Engineer Job at Incedo Inc., Atlanta, GA

SVI1YjRmQUJ5UVFlY1k4UUFOOCtXZ001K2c9PQ==
  • Incedo Inc.
  • Atlanta, GA

Job Description

Job Title: : Lead Data Engineer

Location : Encino CA /LA California /Atlanta GA

Duration : Fulltime

Role Overview:

We are seeking a Lead Data Engineer with expertise in data modeling , Data Vault architecture , and cloud data warehouse (CDW) architecture utilizing the Kimball model . The ideal candidate will have hands-on experience with data fabric technologies (e.g., Databricks), Spark , and Python on Azure Cloud . This role involves designing, implementing, and optimizing data pipelines and data platforms to support business intelligence and advanced analytics.

Key Responsibilities:

  • Design and implement scalable and efficient data models, including Data Vault and Kimball dimensional modeling for cloud-based data warehouses.
  • Architect and manage Azure Cloud -based data infrastructure, ensuring scalability, security, and performance.
  • Develop and optimize data pipelines using Databricks , Spark , and other data fabric tools to process large volumes of data.
  • Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver high-quality solutions.
  • Implement best practices for data engineering, including data quality, governance, and lifecycle management.
  • Build and maintain infrastructure-as-code using Terraform or other DevOps tools.
  • Create reusable data engineering components for ingestion, transformation, and orchestration.
  • Troubleshoot, optimize, and maintain existing data systems to meet evolving business needs.

Required Skills and Experience:

  • 10+ years of experience in Data Engineering or a similar role, with a proven track record of leading data projects.
  • Expertise in Data Vault 2.0 architecture and Kimball modeling for data warehouse design.
  • Proficiency with Azure Data Services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks).
  • Hands-on experience with Databricks and Spark for distributed data processing.
  • Strong programming skills in Python for ETL/ELT development and automation.
  • Deep understanding of CDW architecture and data fabric frameworks .
  • Experience with CI/CD pipelines and infrastructure-as-code tools like Terraform .
  • Solid knowledge of data governance, security, and compliance best practices.

Educational Qualifications:

  • Bachelor’s degree in Computer Science, Data Engineering, or related fields. Master’s degree preferred.
  • Certifications in Data Engineering , Azure Cloud , or Databricks are highly desirable.

Job Tags

Full time,

Similar Jobs

Blachford Acoustics Group

Buyer/Planner 1 Job at Blachford Acoustics Group

 ...~ Bachelors degree in business administration or related field. ~ Professional certification (e.g., CPP, CPSM, CIPS, Six Sigma, CPM, Scrum) is a plus ~3+ years of experience in procurement, sourcing, or category management. ~ Previous experience in the manufacturing... 

Supply Chain Resources Group, Inc.

Buyer Job at Supply Chain Resources Group, Inc.

 ...but not mandatory. Relevant certifications (e.g., Certified Professional in Supply Management (CPSM), Certified Purchasing Manager (CPM)) are a plus. Experience: o Minimum of 3-5 years of experience in inventory purchasing, supply chain management, or procurement... 

Department of General Services

LOCKSMITH I Job at Department of General Services

 ...department. Under direction of the Supervisor of Building Trades in Region V, the position is responsible for providing skilled locksmith services to multiple State agencies in State owned or leased space within downtown Sacramento and/or Central Services jurisdiction... 

Hansen Recruiting

Director of Marketing Job at Hansen Recruiting

 ...Job Title: Director of Marketing Location: Grapevine, TX [on-site] Job Type: Full-time FLSA Status: Exempt Reports to: President Our client is the premier provider of high-quality home improvement solutions, serving the Dallas-Fort Worth and West Texas... 

CAPCO

Senior Consultant - KYC Analyst Job at CAPCO

 ...delivering continuous improvement and value beyond cost efficiency. About the Job: As a Senior Consultant - Know Your Client ("KYC") Analyst, you will be responsible for participating in Anti-Money Laundering (AML) monitoring, governance, oversight, and regulatory...