Senior Databricks Data Engineer - Automated data pipelines

Description

Summary: Join Vallen's Operations team as a Senior Databricks Data Engineer, designing scalable data pipelines, building transformation workflows, and optimizing data models. Highlights: 1. Design and develop scalable data pipelines using PySpark and Spark SQL 2. Build modular transformation workflows using DBT 3. Collaborate with data scientists, analysts, and business teams Join the Operations team at Vallen as Senior Databricks Data Engineer Duties & Responsibilities Design and develop scalable data pipelines using PySpark and Spark SQL Build modular transformation workflows using DBT Package and deploy Databricks workflows using Databricks Asset Bundles (DABS) Develop and maintain CI/CD pipelines with Azure DevOps and Git Optimize data models, ETL/ELT processes, and performance Collaborate with data scientists, analysts, and business teams Implement monitoring, logging, and alerting for data pipelines Required Skills & Abilities 5–7 years of experience as a Data Engineer 3+ years working with Databricks Strong skills in Python, PySpark, and Spark SQL Hands-on experience with DBT and DABS Proven experience with Azure DevOps and CI/CD pipelines Solid understanding of data modeling and cloud data platforms Education and Experience Bachelor’s degree in Computer Science, Engineering, or related field Azure and Databricks experience preferred. -Requerimientos- Educación mínima: Educación superior - Licenciatura 5 años de experiencia Idiomas: Inglés Edad: entre 30 y 40 años Conocimientos: Ats, Azure devops, Base de datos, Etl, Programacion, Python, Sql, Teams Palabras clave: senior, sr, datos, data, ingeniero, engineers, ingeniera, ing, engineer