Data Lineage

Description

Job Summary: IDS Comercial is seeking a Data Lineage professional for a dynamic and collaborative environment, contributing to the development of advanced data solutions. Key Highlights: 1. Development of advanced data solutions. 2. Inclusive and continuously learning work environment. 3. Opportunities for professional development and growth. IDS Comercial, S.A. de C.V. is seeking to hire a professional for the Data Lineage role. This position offers the opportunity to work in a dynamic and collaborative environment, contributing to the development of advanced data solutions both on-site and remotely. · Requirements: Engineering or bachelor's degree in a field related to information technologies. At least +3 years of professional experience as a Data Engineer. Codility certification is desirable. Advanced/Upper-Intermediate English · Experience: Essential knowledge: Proven extensive experience in data engineering or similar roles. Technical Skills (Hard Skills): Proficiency in programming languages (Python, Scala, Java, SQL), Big Data tools (Spark, Hadoop), and cloud platforms (AWS, Google Cloud, Azure). Data Modeling: Skills in designing relational and non-relational (NoSQL) databases. Soft Skills: Leadership, excellent communication, critical thinking, and ability to solve complex problems. Technical Knowledge: Architecture Design: Creating and maintaining robust and efficient data pipelines. Data Management: Implementing ETL (Extract, Transform, Load) processes to integrate data from diverse sources. Technical Leadership: Guiding and mentoring junior engineers, as well as defining best practices for coding and development. Optimization and Quality: Improving query performance and ensuring data integrity, security, and availability. Responsibilities: Deliver specialized services from a development cell, including the following: 1. Data Flow Diagramming:      a. Documentation of services, applications, and interfaces.      b. Identification of data structures.      c. Identification of elements or fields within these data structures.      d. Validation and approval by process owners. 2. Information Mapping and Lineage:      a. Identification of original data sources.      b. Tracing lineage from source table field to destination table field, including transformation processes.      c. Validation and approval by process owners. 3. Data Requirements Document:      a. Explanation of the transformation process from source to destination.      b. Validation and approval by process owners. Benefits: We offer an inclusive and continuously learning work environment. You will have opportunities for professional development and growth. A workplace culture that values excellence and innovation. · Join us and contribute to the success of IDS Comercial, S.A. de C.V. with your expertise and skills in data management.-Requirements- Minimum education: Higher education - Bachelor's degree 3 years of experience Keywords: data, data