Solution Data Engineer Sr.

Description

Summary: Seeking a Solution Data Engineer Sr. to manage Databricks, implement data governance, optimize processing logic, and handle data warehousing and integration. Highlights: 1. Full management of the Databricks environment 2. Implement data governance using Unity Catalog 3. Develop and optimize data processing with Python, SQL, PySpark Important IT company At the Latin American level, growth requires: **Solution Data Engineer Sr.** ***Must Have Skills*** * *Databricks Ecosystem* o Full management of the Databricks environment o Environment configuration and workspace administration * *Governance \& Storage* o Implement data governance using Unity Catalog o Manage structured storage with Delta Lake tables * *Development* o Write and optimize data processing logic using Python, SQL, and PySpark * *Version Control* o Manage code lifecycle and collaborative development using Git o Data Warehousing \& Integration (Important) ***Important Skills*** * *Snowflake* o Manage data architecture, performance, and integrations within Snowflake * *Adobe Data Ingestion* o Handle Adobe Data Feeds and Adobe Analytics o Ensure correct ingestion and transformation of external marketing data ***Nice to Have*** * *Redshift* o Oversee data warehousing operations in Amazon Redshift * *Orchestration* o Use Airflow to schedule, monitor, and manage complex data pipeline workflows ***Desirable*** * *Google Cloud Platform* o Maintain data availability and basic operations in BigQuery * *AWS Data Services* o Manage serverless querying with Athena o Handle metadata management with AWS Glue * *Pipeline Ownership* o Own end to end maintenance of data pipelines o Ensure reliability from data ingestion through final delivery across multiple cloud platforms **ADVANCED CONVERSATIONAL ENGLISH AND SPANISH ESSENTIAL** (Will be evaluated). **If you are a foreingner residing in Mexico, you must have a valid INE, CURP, NSS and RFC.** **Job type**: Remote. **Location**: Mexico **Salary**: $105,000 gross **Benefits**: Excellent superior benefits.