Senior Data Engineer
Role: Sr Data Engineer <\/span><\/b>
<\/p>
Location: Plantation, FL (Hybrid â 4 Days a week onsite)<\/span><\/b>
<\/p>
Duration: 6 Months Contract to Hire <\/span><\/b>
<\/p>
<\/p>
Data Platform Infrastructure & DevOps <\/span><\/b>
<\/div>
- Administer, optimize, and scale our Databricks Lakehouse environment, ensuring high performance, cost efficiency, and operational excellence. <\/span>
<\/li>
- Develop, maintain, and enhance our data platform infrastructure and security configurations using Terraform <\/b> . This includes provisioning Databricks workspaces, SQL Endpoints, Unity Catalog objects, and network components. <\/span>
<\/li>
- Manage and enforce Unity Catalog <\/span><\/b> for data governance, access control, and metadata management. <\/span><\/span>
<\/li>
- Implement and manage CI\/CD pipelines <\/b> for data <\/span> pipelines, dbt projects, and infrastructure deployments using GitHub Actions <\/b> . <\/span>
<\/li>
- Automate operational tasks, monitoring, and alerting for the data platform. <\/span>
<\/li>
- Implement and enforce DevSecOps principles, working closely with security teams to ensure compliance and manage\/rotate credentials securely. <\/span>
<\/li>
<\/ul><\/span><\/b>
<\/p>Data Engineering & Pipeline Development <\/span><\/b>
<\/p>
- Design and implement data ingestion patterns into Databricks using Delta Lake, optimizing <\/b> for large\-scale data processing and storage. <\/span><\/span>
<\/li>
- Develop, optimize, and troubleshoot complex Spark jobs (PySpark\/Scala)<\/b> for data processing and transformation within Databricks. <\/span>
<\/li>
- Manage and extend data ingestion pipelines using Airbyte <\/b> (or similar <\/span> modern tools like Fivetran, Stitch), including configuring connectors, monitoring syncs, and ensuring data quality and reliability from diverse source systems (e.g., ERP, CRM, marketing, supply chain). <\/span>
<\/li>
- Orchestrate and automate data pipelines and dbt models using Databricks Workflows and potentially integrating with other orchestration tools. <\/span>
<\/li>
<\/ul><\/span><\/b>
<\/p>Data Modeling & Collaboration <\/span><\/b>
<\/p>
- Collaborate with Analytics Engineers to translate business requirements into efficient and scalable data models using dbt <\/b> (Data Build Tool). <\/span>
<\/li>
- Implement dbt best practices for modularity, testing, documentation, and version control, ensuring seamless integration with Databricks. <\/span>
<\/li>
- Partner effectively with Analytics Engineers, Data Scientists, and business stakeholders to deliver high\-quality data solutions. <\/span>
<\/li>
- Provide technical guidance and mentorship to junior team members, and champion data engineering best practices, code quality, and documentation standards. <\/span>
<\/li>
<\/ul>Qualifications & Skills <\/span><\/b>
<\/p>
- Education: <\/span><\/b> Bachelor's degree in Computer Science, Data Engineering, or a related technical field required. <\/span>
<\/li>
- Experience: <\/span><\/b> 5+ years of progressive experience as a Data Engineer, with a strong focus on cloud\-based data platforms. <\/span>
<\/li>
- Deep Databricks Expertise: <\/span><\/b> Extensive experience with Spark (PySpark\/Scala), Delta Lake, Unity Catalog, Databricks SQL, and platform administration. <\/span>
<\/li>
- Data Modeling: <\/span><\/b> Proven experience with dbt <\/b> for data modeling, transformation, and testing. <\/span>
<\/li>
- Infrastructure as Code (IaC): <\/span><\/b> Strong proficiency with Terraform <\/b> for defining, provisioning, and managing cloud infrastructure and Databricks resources as code. <\/span>
<\/li>
- DevOps & CI\/CD: <\/span><\/b> Expertise in Git and GitHub Actions <\/b> for version control and implementing robust CI\/CD pipelines. <\/span>
<\/li>
- Programming: <\/span><\/b> Proficiency in SQL <\/b> and at least one programming language (Python strongly preferred, Scala is a plus). <\/span>
<\/li>
- Data Architecture: <\/span><\/b> Solid understanding of data warehousing, data lake, and lakehouse architectures. <\/span>
<\/li>
<\/ul>
<\/div><\/span>
<\/body>
<\/html>"}}],"isMobile":false,"iframe":"true","jobType":"Contract","applyName":"Apply Now","zsoid":"19257397","FontFamily":"PuviRegular","jobOtherDetails":[{"fieldLabel":"Start Date","uitype":1,"value":"ASAP"},{"fieldLabel":"Job Opening ID","uitype":111,"value":"9713"},{"fieldLabel":"Duration","uitype":1,"value":"Contract"},{"fieldLabel":"Industry","uitype":2,"value":"Technology"},{"fieldLabel":"Work Experience","uitype":2,"value":"8 \- 12 Years"},{"fieldLabel":"City","uitype":1,"value":"Plantation"},{"fieldLabel":"State\/Province","uitype":1,"value":"Florida"},{"fieldLabel":"Zip\/Postal Code","uitype":1,"value":"33388"}],"headerName":"Senior Data Engineer","widgetId":"171710000002190088","isJobBoard":"false","userId":"171710000000028001","attachArr":[],"customTemplate":"5","isCandidateLoginEnabled":true,"jobId":"171710000031661093","FontSize":"15","location":"Plantation","embedsource":"CareerSite","indeedCallBackUrl":"","logoId":"dwari0d06250feb6641b2a0b44859d0077133"}
- Education: <\/span><\/b> Bachelor's degree in Computer Science, Data Engineering, or a related technical field required. <\/span>
- Collaborate with Analytics Engineers to translate business requirements into efficient and scalable data models using dbt <\/b> (Data Build Tool). <\/span>
- Design and implement data ingestion patterns into Databricks using Delta Lake, optimizing <\/b> for large\-scale data processing and storage. <\/span><\/span>
Recommended Jobs
Program Manager I
Program Manager I Location Pensacola, FL : Overview To manage, influence, and lead development direction and optimal performance of business unit program initiatives. Develop, implement, evaluate, a…
Sales Manager
Job Schedule Corporate Retail Store Job ID 72772 Sales Manager The salary range for this role is $14.25 to $15.00 per hour.* This position is also eligible for incentive pay based on performan…
Direct, Sourcing Specialist
The Impact You'll Make Our Danfoss Turbocor Global H eadquarters in Tallahassee, FL is looking for a Direct Sourcing Specialist to join our team! The Sourcing Specialist – Direct supports the…
Registered Nurse Labor & Delivery Full Time Nights
Responsibilities Job Title: Labor & Delivery Registered Nurse RN Status: Full Time Schedule: Nights *You will be considered for any openings for which you qualify. It is not …
Emergency Medicine Physician in Titusville, Florida
Join our team full-time at Parrish Medical Center in Titusville, Florida. This state-of-the-art community hospital is located just a short drive east of Orlando and internationally known as Florida's…
Prep Cook
With a polished yet well-worn vibe and a menu that features locally grown seasonal ingredients, Noble Crust turns traditional Italian dining into a whole new experience, an experience we call Deep …