- Junior Data Engineer -

Description

Job Summary: The Junior Azure Data Engineer Consultant will execute data flows, developing data ingestion from ecosystems (especially SAP) into Azure and transforming them in Snowflake. Key Highlights: 1. Development of data ingestion pipelines from SAP and other ecosystems into Azure. 2. Data transformation in Snowflake using pure SQL. 3. Operational role focused on building and monitoring data pipelines. DESCRIPTION ***Position for Monterrey*** The **Junior Azure Data Engineer Consultant** will be responsible for the technical execution of data flows. Their primary function is to develop data ingestion from various ecosystems (especially SAP) into the Azure cloud and transform this data within Snowflake. This is an operational role focused on building and monitoring data pipelines. ### **2\. Key Responsibilities** * **Data Ingestion:** Configure, develop, and schedule data extraction processes from **SAP and Non\-SAP** sources using **Azure Data Factory (ADF)**. * **Storage:** Load and organize raw and processed data into **Azure Data Lake Storage (ADLS)** following best practices for naming conventions and folder structure. * **Transformation (ETL):** Develop data transformation logic within the **Snowflake** platform using exclusively **pure SQL**. * **Maintenance:** Perform unit testing on developed data flows and ensure the integrity of loaded data. * **Documentation:** Record data ingestion processes and data mappings performed during the project. REQUIREMENTS **Azure Data Factory (ADF):** Basic knowledge of creating and managing *Pipelines*, *Linked Services*, and *Datasets*. Ability to schedule ingestion *Triggers*. **Azure Data Lake Storage (ADLS):** Proficiency in cloud storage management, container organization, and folder structures (*landing, raw, curated*). **SQL (Basic Level):** Proficiency in standard syntax for queries (SELECT, FROM, WHERE, GROUP BY). Ability to perform joins (*JOINs*) and apply data filters for validation. **Snowflake:** Familiarity with the platform and ability to write transformation (ETL) scripts using **pure SQL**. **SAP Ingestions:** (Desirable) Knowledge of or interest in learning data extraction from SAP connectors into cloud environments.