Data Engineer - Jazwares

Plantation, FL(Onsite)<\/span><\/span><\/b>
<\/p>

6+ Month Contract <\/span><\/b>
<\/p>

<\/span>
<\/p>

Python, Azure DataBricks, PySpark, CI\/CD <\/span><\/span><\/span><\/b>


As a Data Engineer, your duties will be focused on three core areas: <\/span><\/p>

1. Data Platform Infrastructure & DevOps <\/span><\/b>
<\/p>

· <\/span><\/span><\/span><\/span> Administer, optimize, and scale our Databricks Lakehouse environment, ensuring high performance, cost efficiency, and operational excellence. <\/span>
<\/p>

· <\/span><\/span><\/span><\/span> Develop, maintain, and enhance our data platform infrastructure and security configurations using Terraform . This includes provisioning Databricks workspaces, SQL Endpoints, Unity Catalog objects, and network components. <\/span>
<\/p>

· <\/span><\/span><\/span><\/span> Manage and enforce Unity Catalog for data governance, access control, and metadata management. <\/span>
<\/p>

· <\/span><\/span><\/span><\/span> Implement and manage CI\/CD pipelines for data pipelines, dbt projects, and infrastructure deployments using GitHub Actions . <\/span>
<\/p>

· <\/span><\/span><\/span><\/span> Automate operational tasks, monitoring, and alerting for the data platform. <\/span>
<\/p>

· <\/span><\/span><\/span><\/span> Implement and enforce DevSecOps principles, working closely with security teams to ensure compliance and manage\/rotate credentials securely. <\/span>
<\/p>

2. Data Engineering & Pipeline Development <\/span><\/b>
<\/p>

· <\/span><\/span><\/span><\/span> Design and implement data ingestion patterns into Databricks using Delta Lake , optimizing for large\-scale data processing and storage. <\/span>
<\/p>

· <\/span><\/span><\/span><\/span> Develop, optimize, and troubleshoot complex Spark jobs (PySpark\/Scala) for data processing and transformation within Databricks. <\/span>
<\/p>

· <\/span><\/span><\/span><\/span> Manage and extend data ingestion pipelines using Airbyte <\/b> (or similar modern tools like Fivetran, Stitch), including configuring connectors, monitoring syncs, and ensuring data quality and reliability from diverse source systems (e.g., ERP, CRM, marketing, supply chain). <\/span>
<\/p>

· <\/span><\/span><\/span><\/span> Orchestrate and automate data pipelines and dbt models using Databricks Workflows and potentially integrating with other orchestration tools. <\/span>
<\/p>

3. Data Modeling & Collaboration <\/span><\/b>
<\/p>

· <\/span><\/span><\/span><\/span> Collaborate with Analytics Engineers to translate business requirements into efficient and scalable data models using dbt (Data Build Tool). <\/span>
<\/p>

· <\/span><\/span><\/span><\/span> Implement dbt best practices for modularity, testing, documentation, and version control, ensuring seamless integration with Databricks. <\/span>
<\/p>

· <\/span><\/span><\/span><\/span> Partner effectively with Analytics Engineers, Data Scientists, and business stakeholders to deliver high\-quality data solutions. <\/span>
<\/p>

· <\/span><\/span><\/span><\/span> Provide technical guidance and mentorship to junior team members, and champion data engineering best practices, code quality, and documentation standards. <\/span>
<\/p>

Qualifications & Skills <\/span><\/b>
<\/p>

· <\/span><\/span><\/span><\/span> Education: <\/span><\/b> Bachelor's degree in Computer Science, Data Engineering, or a related technical field required. <\/span>
<\/p>

· <\/span><\/span><\/span><\/span> Experience: <\/span><\/b> 5+ years of progressive experience as a Data Engineer, with a strong focus on cloud\-based data platforms. <\/span>
<\/p>

· <\/span><\/span><\/span><\/span> Deep Databricks Expertise: <\/span><\/b> Extensive experience with Spark (PySpark\/Scala), Delta Lake, Unity Catalog, Databricks SQL, and platform administration. <\/span>
<\/p>

· <\/span><\/span><\/span><\/span> Data Modeling: <\/span><\/b> Proven experience with dbt for data modeling, transformation, and testing. <\/span>
<\/p>

· <\/span><\/span><\/span><\/span> Infrastructure as Code (IaC): <\/span><\/b> Strong proficiency with Terraform for defining, provisioning, and managing cloud infrastructure and Databricks resources as code. <\/span>
<\/p>

· <\/span><\/span><\/span><\/span> DevOps & CI\/CD: <\/span><\/b> Expertise in Git and GitHub Actions for version control and implementing robust CI\/CD pipelines. <\/span>
<\/p>

· <\/span><\/span><\/span><\/span> Programming: <\/span><\/b> Proficiency in SQL and at least one programming language ( Python <\/b> strongly preferred, Scala is a plus). <\/span>
<\/p>

· <\/span><\/span><\/span><\/span> Data Architecture: <\/span><\/b> Solid understanding of data warehousing, data lake, and Lakehouse architectures. <\/span>
<\/p>

<\/span>
<\/p>