Data Engineer

Description

Job Summary: We are seeking a Data Engineer to design, develop, implement, and tune large-scale distributed systems and data pipelines, with a focus on scalability and low latency. Key Highlights: 1. Design and implementation of large-scale distributed systems 2. Focus on scalability, low latency, and fault tolerance 3. Handling of large volumes of data and pipelines IDS Comercial is a 100% Mexican IT company with 43 years of experience and presence in Mexico, Latin America, and the USA. Over 1500 consultants work across numerous projects in financial, commercial, manufacturing, telecommunications, services, government, and other sectors. We are accredited at CMMI Level 5 (Capability Maturity Model Integration), a quality model established by the Software Engineering Institute (SEI). Certified by ISO under standard ISO/IEC 27001:2013. We hold the Socially Responsible Enterprise (ESR) distinction. WE ARE LOOKING FOR YOU! · Data Engineer · Key Responsibilities: Design, develop, implement, and tune large-scale distributed systems and pipelines that process large volumes of data; focusing on scalability, low latency, and fault tolerance in every system built. · Requirements: Advanced English Experience with Python for writing data pipelines and data processing layers. Extensive experience and proficiency in SQL, optimized for data transformation and implementation of business rules. Practical experience with ETL tools such as Dataiku for data preparation, transformation, and orchestration of data pipelines. Experience with Airflow and GitHub. Experience with cloud technologies (GCP). Professional experience with Big Data technologies: Hadoop, Hive, Kafka, Presto, Spark, HBase, Automic, and Aorta. Experience leading teams. · Work Modality: Remote (Home Office). · Location: CDMX. · We Offer: Monthly base salary (100% payroll scheme) Statutory benefits Attendance bonus (10% of monthly base salary) 5% housing fund (percentage of payroll) 2% retirement fund (percentage of payroll) Major Medical Expenses Insurance Minor Medical Expenses Insurance Accident Life Insurance Savings Fund (Optional) Fleet Auto Insurance (Optional) Commercial Agreements · We are an inclusive company free from any form of discrimination, where opportunities are available to those who demonstrate attitude and talent. We do not require medical certificates confirming non-pregnancy or HIV status as prerequisites for joining our large workforce family and accessing equal growth opportunities.-Requirements- Minimum Education: Higher Education – Bachelor's Degree years of experience Keywords: data, data, engineer, engineers, female engineer, eng, engineer