Job Summary: We are seeking a Data Engineer with solid experience in Databricks and PySpark to design, build, and optimize data pipelines focused on large-scale analytics and machine learning workloads. Key Highlights: 1. Solid experience in Databricks and PySpark for data engineering. 2. Design and implementation of ETL/ELT pipelines. 3. Optimization of data flows for big data. Capital Empresarial Horizonte, a Mexican company specializing in Human Resources and Information Technologies, is looking for: **Data Engineer (Databricks and PySpark)** **Conversational English required** Hybrid work model (3 days remote - 2 onsite) **Work location options: CDMX, Guadalajara, Querétaro, or Monterrey** We are looking for a Data Engineer with solid experience in Databricks and PySpark to design, build, and optimize data pipelines focused on large-scale analytics and machine learning workloads. The ideal candidate will have experience in distributed data processing and cloud-based data platforms. **Requirements:** * Over **3 years of experience in data engineering or big data development.** * High proficiency in **PySpark and Databricks.** * Practical experience with distributed computing frameworks (Spark). * Proficiency in **SQL** and relational databases. * **Experience with cloud services (AWS S3, Azure Data Lake, GCP BigQuery).** * Familiarity with Delta Lake, data versioning, and streaming data processing. * Knowledge of CI/CD pipelines and DevOps practices applied to data workflows. **Responsibilities:** * Design and implement ETL/ELT pipelines using Databricks and PySpark. * Optimize data flows to improve performance and scalability in big data environments. * Integrate data from multiple sources (structured and unstructured) into data lakes and data warehouses. * Work with cloud platforms (AWS, Azure, or GCP) for deployment and scaling. **We Offer:** * Office hours * 100% payroll scheme * Salary open to negotiation based on experience * Statutory benefits * Enhanced benefits (family SGMM, SV 1 million, grocery vouchers, 30-day bonus, PTU)