Databricks Architect
Job Summary:
We are seeking a Databricks Engineer with strong expertise in building scalable data pipelines, data transformation workflows, and analytics solutions using the Databricks platform. The ideal candidate will have experience with big data technologies, cloud platforms, and modern data engineering practices.
Key Responsibilities:
- Design, develop, and maintain data pipelines using Databricks, PySpark, and Spark SQL.
- Build and optimize ETL/ELT processes for large-scale data processing.
- Develop data ingestion frameworks from various sources including databases, APIs, and cloud storage.
- Implement Delta Lake solutions to ensure data quality, reliability, and performance.
- Collaborate with data analysts, data scientists, and business stakeholders to deliver data solutions.
- Optimize Spark jobs and Databricks workloads for performance and cost efficiency.
- Integrate Databricks with cloud services such as AWS, Azure, or GCP.
- Monitor, troubleshoot, and resolve data pipeline and platform issues.
- Participate in code reviews, testing, deployment, and documentation activities.
Required Skills:
- Strong experience with Databricks, Apache Spark, PySpark, and Spark SQL.
- Proficiency in Python and SQL.
- Experience with Delta Lake, Data Lake, and Lakehouse architectures.
- Knowledge of data modeling, ETL/ELT processes, and data warehousing concepts.
- Experience with cloud platforms (Azure, AWS, or GCP).
- Familiarity with CI/CD pipelines, Git, and DevOps practices.
- Strong analytical and problem-solving skills.
Recommended Jobs
Motorcycle Service Advisor
Lakeland Harley-Davidson is actively searching for a motivated, enthusiastic individual with a passion for customer service and the motorcycle riding lifestyle to fill the position of Service Advisor.…
GUEST SERVICES LEAD
GUEST SERVICES LEAD The Guest Services Lead is responsible for Guest Services (including Ask Me Team) and Guest Tram experience on the Destination. This position is accountable for the welcome and fa…
Trim Technician
QXO, Inc. (NYSE: QXO) is the largest publicly traded distributor of roofing, waterproofing, and related products, and the second largest publicly traded distributor of lumber and building materials i…
Sales Program Analyst I
Compensation Data NA Company Overview For more than 70 years, TBC Corporation has been a leader in the mobility industry and one of North America’s largest marketers and distributors of auto…
Interventional Radiographer
A full-time Interventional Radiographer opportunity is available at a 404-bed tertiary care Level II Trauma Center and Comprehensive Stroke Center in Kissimmee, Florida. This advanced acute care faci…
Corporate Development Manager
Job Description Job Description Salary: $75,000 $100,000 AboutPaynuity: Paynuity is a leading provider of seamless, secure credit card payment processing solutions. Our mission is to simplif…
SAP FICO Functional Lead- Remote with some travel
Job Description Job Description SAP FICO Functional Lead- Remote with some travel We are seeking an experienced Principal level SAP FICO Lead Functional Consultant to support a critical SA…
Fire Sprinkler Systems Repair Technician
Requisition Number: 222613 Job Description Cintas is seeking a Fire Sprinkler Systems Repair Technician for our Fire Protection business. Responsibilities include servicing, repairing, replac…
Application Analyst - Digital Patient Applications
Location: Remote - FL Department: Corporate Systems and IT Administration Work Type: Full Time Shift: Shift 1/ to Minimum to Midpoint Pay Rate: $37.72 - $49.03 / hour Summary The…
Project Engineer
Job Description Job Description Project Engineer Direct Hire Opportunity | Full-Time We are seeking a motivated Project Engineer to support commercial construction projects from preconstruc…