Senior Python Developer

Description

We are looking for a highly skilled and experienced **Senior Python Developer** to become an integral part of our innovative team. In this role, you will design and sustain high\-quality solutions at every stage of the Software Development Life Cycle (SDLC). This opportunity calls for a resourceful engineer who excels at addressing complex challenges and demonstrates an eagerness to learn and adapt to emerging technologies. **Responsibilities** * Create and manage cloud resources in AWS * Implement data ingestion processes for a variety of data sources, including technologies like RDBMS, REST HTTP APIs, flat files, streams, and proprietary time\-series data * Develop data ingestion and processing pipelines using Big Data technologies * Process and transform data with Spark and cloud\-based services while embedding crucial business logic * Build automated data quality validations to maintain data processing integrity and accuracy * Develop infrastructure to collect, transform, integrate, and distribute customer data effectively * Optimize and streamline processes for enhanced data collection, analytics, and visualization * Ensure scalability, reliability, and flexibility of data pipelines and associated analyses * Identify, analyze, and interpret complex data patterns and trends * Create frameworks with data visualization tools to provide actionable insights for stakeholders * Actively participate in Agile Scrum ceremonies as part of development teams * Generate well\-structured reports and develop effective queries to share findings * Mentor junior colleagues and uphold best practices across the team **Requirements** * 3\+ years of data engineering experience within domains such as consumer finance, loans, collections, or similar fields * Background in math, statistics, computer science, data science, or related disciplines * Advanced knowledge of Python or Snowflake * Proficiency in using tools like HDFS, YARN, Hive, Spark, Kafka, Oozie/Airflow, AWS, Docker/Kubernetes, and Snowflake * Skills in programming languages (e.g., SAS, SQL, R, Python), database technologies (e.g., PostgreSQL, Redshift, Snowflake, Greenplum), and data visualization platforms (e.g., Tableau, Looker, MicroStrategy) * Showcase of flexibility to adopt and employ new technologies and tools effectively * Strong organizational and multitasking attributes supported by consistent adherence to deadlines * Expertise in business intelligence, analytics techniques, and modern methodologies * Proficiency in written and verbal communication in English (minimum B2 level), ensuring clarity when addressing non\-technical stakeholders **Nice to have** * AWS certification showcasing relevant expertise * Competency in Spark Streaming * Understanding of ELK Stack * Familiarity with Cassandra or MongoDB technologies * Proficiency in deploying CI/CD tools such as Jenkins, GitLab, or Jira/Confluence * Background in Go Language use