Remote
Full-Time
Key Responsibilities
- Assess complex Informatica workflows including sessions, mappings, and parameterizations and translate them into equivalent Python EL scripts and dbt transformation models.
• Develop and maintain Python EL pipelines to land high-volume data, including billion-row tables, into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools such as Oracle Data Pump and SQL Server BCP.
• Design and develop dbt transformation models based on Informatica mapping logic, incorporating dbt best practices including model layering, macros, incremental strategies, and snapshot patterns.
• Develop dbt-native tests as well as custom Python unit tests to validate transformation correctness and data quality.
• Develop Airflow DAGs to orchestrate Python EL and dbt scripts end-to-end, producing output that is functionally equivalent to the source Informatica workflows.
• Contribute to GitLab CI/CD pipeline for dbt and Airflow code, including lint gates, automated testing, and deployment to shared NAS.
• Perform peer code reviews and provide constructive technical feedback to fellow engineers.
• Troubleshoot performance issues and data discrepancies during SIT and UAT, including row-count reconciliation between source Oracle/SQL Server systems and the target warehouse.
• Contribute to technical documentation, runbooks, and handover materials.
Originally posted on Himalayas
Similar opportunities
B
National Placement Director
Baldwin Risk Partners, LLC
United States of America
Remote
Full-Time
HIMALA-NTDIRECTOR
1 hour ago
A
Director, Field Reimbursement (Remote Strategic Leader)
Alcon
United States of America
Remote
Full-Time
HIMALA-EGICLEADER
1 hour ago
M
Director, Product Engineering
May Mobility
United States of America
USD 160,000 - 230,000 per year
Remote
Full-Time
HIMALA-NGINEERING
1 hour, 2 minutes ago
I
Customer Success Manager (Job ID: VRCSMPH)
InsideOutVAS
Philippines
USD 1,400 per month
Remote
Full-Time
HIMALA-BIDVRCSMPH
1 hour, 2 minutes ago