Semi-Senior Data Engineer

Description

Job Summary: Join us as a Semi-Senior Data Engineer to collaborate on standardization, preparation, and deployment of models, contributing to maintenance and scalability. Key Highlights: 1. Collaborate on standardizing production code and notebooks. 2. Design and implement ML pipelines tailored to GCP. 3. Ensure scalability of processes for varying data volumes. **Join our team as a Semi-Senior Data Engineer at IDS Comercial, S.A. de C.V.** **Requirements:** Engineering or bachelor’s degree in a field related to information technologies. At least 3 years of professional experience. Intermediate/Advanced English. **Experience:** Experience working with models developed in Python and notebooks (Jupyter). Practical knowledge of: Model preparation for production. Best practices for reproducibility and versioning. Advanced: Python & SQL programming. MLOps (Git). Intermediate: Machine learning algorithms; cloud platforms such as GCP and its AI tools (Vertex AI, BigQuery, Airflow, Cloud Functions/Run, etc.); Data Governance and Data Lake/DWH architectures; experience with CI/CD pipeline tools. Desirable: Harness deployment tools. **Responsibilities** * Collaborate on standardizing: code and notebook structure toward production-ready code. * Manage model configurations and parameters. Version dependencies, models, and artifacts. Support: preparing execution environments (Docker, requirements, configurations). Adapting models for GCP services (e.g., Vertex AI, Cloud Run). * Generate clear and reusable documentation on: model and pipeline execution; relevant dependencies and configurations; basic deployment and update procedures. * Contribute to making models easier to maintain and operate in the future. * Propose technical improvements based on prior experience. * Design and implement ML pipelines tailored to the GCP ecosystem to ensure model portability and efficiency. * Ensure scalability of processes for varying data volumes or request loads. **Benefits** * We offer a dynamic and challenging work environment. * You will have access to cutting-edge tools and technologies. * Access to professional development opportunities and continuous training. This role presents a unique opportunity to contribute to our team’s success and grow professionally within an innovative environment.