Job Summary: We are seeking a Data Engineer with strong experience in Databricks and PySpark to design, build, and optimize large-scale data pipelines and machine learning workloads. Key Highlights: 1. Design and implement ETL/ELT pipelines with Databricks and PySpark. 2. Optimize data flows for performance and scalability in big data. 3. Integrate data from multiple sources into data lakes and data warehouses. Capital Empresarial Horizonte, a Mexican company specializing in Human Resources and Information Technologies, is looking for: **Data Engineer (Databricks and PySpark)** **Conversational English required** Hybrid work model (3 days remote \- 2 on-site) **Work location to be chosen among CDMX, Guadalajara, Querétaro, or Monterrey** We seek a Data Engineer with solid experience in Databricks and PySpark to design, build, and optimize analytics-oriented large-scale data pipelines and machine learning workloads. The ideal candidate will have experience in distributed data processing and cloud-based data platforms. **Requirements:** * Over **3 years of experience in data engineering or big data development.** * High proficiency in **PySpark and Databricks.** * Practical experience with distributed computing frameworks (Spark). * Knowledge of **SQL** and relational databases. * **Experience with cloud services (AWS S3, Azure Data Lake, GCP BigQuery).** * Familiarity with Delta Lake, data versioning, and streaming data processing. * Knowledge of CI/CD pipelines and DevOps practices applied to data workflows. **Responsibilities:** * Design and implement ETL/ELT pipelines using Databricks and PySpark. * Optimize data flows to improve performance and scalability in big data environments. * Integrate data from multiple sources (structured and unstructured) into data lakes and data warehouses. * Work with cloud platforms (AWS, Azure, or GCP) for deployment and scaling. **We Offer:** * Office hours * 100% payroll scheme * Salary open to negotiation based on experience * Statutory benefits * Enhanced benefits (family health insurance, life insurance up to 1 million MXN, grocery vouchers, 30-day bonus, profit-sharing distribution)