Data Engineer - Use Cases

Description

Job Summary: We are seeking an IT Consultant with technical expertise and business acumen to design, develop, and optimize data processing solutions in the financial sector. Key Highlights: 1. You will participate in high-impact projects and learn from experts. 2. Design and develop data pipelines using Python, Spark, and SQL. 3. Collaborate with multidisciplinary teams and apply agile methodologies. We’re not just looking for talent—we’re looking for curious minds who enjoy learning and transforming the future. We are tech-driven, demanding, and yes—we move fast. But no one competes alone. We work as a team. If you seek challenges that push you beyond your comfort zone (because growth doesn’t happen there), you’re in the right place. Here, you’ll learn from experts, participate in high-impact projects, and stay consistently ahead in technology. ***IT Consultant*** Technical expertise and business vision to design, develop, and optimize data processing solutions within specific use-case contexts in the financial sector. The ideal candidate must possess strong Big Data technology skills and experience managing cloud-based data (AWS preferred). **Key Responsibilities:** * Understand and translate business requirements into scalable technical solutions. Design and develop data pipelines using Python, Spark, and SQL. * Participate in designing and improving the data lifecycle. Implement solutions on Big Data ecosystems and cloud platforms (AWS preferred). * Automate processes using orchestrators such as Control\-M or EventBridge. * Apply version control and collaboration best practices using Git or Bitbucket. * Perform efficient data analysis, transformation, and cleansing. * Collaborate with multidisciplinary teams to ensure high-quality deliverables. **Technical Requirements – Programming Languages and Tools:** * Proficiency in Python (data manipulation, scripting, automation). * Experience with Apache Spark (PySpark preferred). * Solid SQL knowledge (complex queries, tuning). * Functional knowledge of Java. Big Data and Data Architecture: Understanding of Big Data paradigms and distributed architecture. * Understanding of the data lifecycle (ingestion, transformation, quality, exploitation). * Experience with version control systems: Git / Bitbucket. DevOps / Jenkins tools. * Knowledge of regular expressions (Regex) (desirable). * Operating System and Commands: Advanced usage of Linux/Unix systems. * Command-line and shell scripting experience. * Process Orchestration: Experience with Control\-M, EventBridge, or other process orchestration tools (desirable). * Data process testing and validation. * Experience in end-to-end testing, process validation, and monitoring. * Data testing and unit testing for pipelines. * Best Practices: CI/CD principles. Clear and reusable technical documentation. * JIRA: Familiarity with agile methodologies and JIRA usage. AWS knowledge desirable. * Experience or familiarity with the following services: S3 (storage), EC2 (compute instances), Athena (queries on data in S3\), EMR (distributed processing), SageMaker (machine learning, desirable), CloudWatch (monitoring and logs) Soft Skills: Analytical thinking and problem-solving. Strong communication and collaborative teamwork. Adaptability to changing environments and agile methodologies. Proactivity and results orientation. Self-management. Communication between technical and functional teams (minutes writing, documentation development). Ability to connect technical information with business information. What do we offer you? * Support for your personal and professional growth through individual development plans—where you own your career path and decide how far you want to go. * Vacation days exceeding statutory requirements: No need to wait a full year to enjoy your vacation days; additional days are also granted for special events and holidays. * Additional economic benefits beyond your salary: Grocery vouchers, savings fund, training allowance, wellness bonus, partnerships, and discounts. * Emotional support—we care about your physical and mental well-being, offering diverse benefits covering personal balance for you and health coverage for your family. We want to take care of you and your loved ones! There’s room here for good people… like you. We’d love to meet you!