Data Engineer - MS Fabric

Description

At **Derevo**, we empower enterprises and individuals by unlocking the value of our clients’ data and amplifying the talent that transforms it. With over 15 years of experience, we design end-to-end data and AI solutions: from integration into modern architectures to implementing intelligent models in key business processes. If you’re passionate about data and innovation, this could be your moment! **We’re looking for your talent — Data Engineer (MS Fabric) !! ✋** **Your mission:** You will play a pivotal role in designing and implementing high-quality, modern data architectures, driving analytical solutions built on Big Data technologies. You will design, maintain, and optimize parallel multi-processing systems, applying best practices for storage and management across data warehouses, data lakes, and lakehouses. As a passionate data professional, you’ll collect, process, clean, and orchestrate large volumes of data—understanding both structured and semi-structured data models—to integrate and transform multiple sources efficiently. You’ll define the optimal strategy aligned with business objectives and technical requirements, turning complex problems into achievable solutions that help our clients make data-driven decisions. **‍ How will you do it?** * **You’ll join the project and its sprints**, executing development activities while consistently applying data best practices and the technologies we implement. * **You’ll identify requirements and define scope**, participating in sprint planning and engineering sessions with a consultant mindset that adds extra value. * **You’ll proactively collaborate in workshops and meetings** with both internal teams and clients. * **You’ll classify and estimate tasks** using agile methodologies (epics, features, technical/user stories) and provide daily follow-up to maintain sprint velocity. * **You’ll meet committed delivery deadlines** and manage risks by timely communication of deviations. **What do we ask for?** **To join us and feel right at home as a Data Engineer at Derevo, here’s what we’ll consider:** **Advanced English** **Technical Skills:** **Query and Programming Languages** **T-SQL / Spark SQL:** DDL and DML, intermediate and advanced queries (subqueries, CTEs, multi-table joins with business rules), grouping and aggregation (GROUP BY, window functions, business metrics), stored procedures for ETL/ELT, index optimization, statistics, and execution plans for large-scale processes. **Python (PySpark):** Object-oriented programming (classes, modules), handling data structures and types (variables, lists, tuples, dictionaries), flow control via conditionals and loops, ingestion of structured and semi-structured data, development of DataFrames and UDFs, temporal windows and partitioning for optimization, coding best practices (PEP8, modularity). **JSON / REST APIs:** Orchestration of pipelines and CI/CD deployments via calls to Fabric REST APIs, dynamic parameterization of executions, and artifact management. **Microsoft Fabric** * **Lakehouse (OneLake + Delta Lake)**: data modeling using ACID-compliant Delta tables, partitioning and optimizations (OPTIMIZE, Z-ORDER) for performance improvement; use of time travel for auditing and recovery. * **Warehouses (Synapse Analytics)**: configuration of provisioned and serverless SQL pools; star/snowflake schema design; execution of transactional T-SQL with isolation levels and automatic resource scaling. * **CI/CD & Lifecycle Management**: definition of pipelines in Azure DevOps or GitHub Actions across dev-test-prod environments; unit testing of datasets, schema validations, and automated deployment of artifacts. * **Monitor Hub & Activator**: creation of custom dashboards for ingestion and transformation metrics (latency, throughput, errors); proactive alerts and automated runbooks triggered by defined conditions. * **Eventstreams & Eventhouse**: configuration of code-free real-time event ingestion; definition of processing windows, incremental aggregations, and optimized storage for temporal analytics. * **Security and Data Governance**: granular role administration (Admin, Member, Contributor, Viewer) and item/workspace-level permissions; row-level, column-level security policies and dynamic data masking; access and change auditing for regulatory compliance. * **Desirable:** general knowledge of **Azure Data Factory** **Additionally, it’s important that you identify with the following Soft and Business Skills:** * **Approachable communication**: you clearly and directly explain technical and business findings. * **Squad-based collaboration**: you work under a Squad Lead/Tech Lead, contributing ideas and raising concerns when something doesn’t align. * **Proactivity and collaboration**: you detect issues, propose solutions, and share challenges with the team to solve them collectively. * **Continuous learning**: you keep an open mind, consume videos and documentation to specialize in emerging technologies. * **Accountability and organization**: you manage your OKRs, report progress, and allocate time effectively to meet commitments. * **Data consultancy**: you interpret business rules and propose technical implementation scenarios to convert needs into solutions. * **Requirements management**: scope and requirement analysis to ensure project success. * **Client-aligned strategy**: you translate business goals into practical, robust data architecture. * **Client presentations**: you communicate proposals and results effectively. **✅ What benefits will you get?** * WELLNESS: We’ll support your holistic well-being—personal, professional, and financial. Our statutory and additional benefits help you achieve it. * LET'S RELEASE YOUR POWER: You’ll have opportunities to comprehensively specialize across diverse areas and technologies, enabling interdisciplinary growth. We’ll encourage you to take on new challenges and surpass yourself. * WE CREATE NEW THINGS: We love thinking outside the box. You’ll have the space, trust, and freedom to create—and the required training to succeed. * WE GROW TOGETHER: You’ll participate in cutting-edge, multinational technology projects alongside international teams. **Where will you do it?** We are a large, fully remote team—flexible yet structured—providing all necessary equipment and internal communication tools to streamline our operations and those of our clients. If you meet most of the requirements and are interested in this role, don’t hesitate to apply—we’ll contact you soon! Become a derevian & develop your superpower!