Job Summary: The Senior Azure Data Engineer Consultant is responsible for the technical architecture and integrity of data flows, designing and implementing large-scale ingestion strategies and optimizing processing in Snowflake. Key Highlights: 1. Data Architecture and Complex Ingestion Design 2. Snowflake Optimization and Data Governance 3. Technical Leadership and Junior Profile Mentoring DESCRIPTION ### **1. Role Summary** The **Senior Azure Data Engineer Consultant** is responsible for the technical architecture and integrity of data flows. Their primary function is to design and implement large-scale ingestion strategies from critical systems (SAP) into Azure, ensuring that processing in Snowflake is scalable, cost-efficient, and high-performing. They serve as the technical escalation point and mentor for Junior profiles. ### **2. Key Responsibilities** * **Data Architecture Design:** Define ingestion and storage structure in **ADLS Gen2**, ensuring correct data transition across *Bronze, Silver, and Gold* layers. * **Complex Ingestions:** Lead data connection and extraction from **SAP (S/4HANA, ECC)** using **Azure Data Factory**, managing advanced *Integration Runtime* configurations. * **Snowflake Optimization:** Develop and oversee advanced ETL/ELT processes using **expert SQL**. Optimize resource usage (*Warehouses*), micro-partition management, and *Clustering* strategies. * **Governance and Security:** Implement data security policies, encryption, access control (RBAC), and ensure compliance with data quality standards. * **Technical Leadership:** Conduct *Code Reviews*, define team development standards, and resolve technical bottlenecks in the project. REQUIREMENTS ### **Essential Technical Requirements (Hard Skills)** * **Azure Data Factory (Expert):** * Design of dynamic and parameterized architectures. * Advanced handling of *Self-hosted Integration Runtimes* (for SAP connectivity). * Implementation of complex control flows (loops, conditionals, error handling, and retries). * **Snowflake (Advanced):** * Proficiency in storage and compute architecture. * Handling of *Time Travel*, *Fail-safe*, and *Zero-copy Cloning*. * Experience in optimizing cost and performance of *Virtual Warehouses*. * **SQL (Expert Level):** * Writing highly efficient code. * Use of *Window Functions*, *Common Table Expressions (CTEs)*, and stored procedures. * Query tuning and optimization (execution plan analysis). * **SAP Ecosystem:** * Proven experience extracting data from **SAP (ECC or S/4HANA)**. * Knowledge of communication protocols (ODP, RFC, CDS views, or SAP Tables). * **Azure Storage:** * Advanced configuration of **ADLS Gen2** (security, ACLs, and *Bronze, Silver, Gold* layer management)