Summary
The Systems Integration & Data Engineer maintains and improves integrations, automation routines, and data pipelines that connects the CTRM to downstream systems and reporting. This role designs integration patterns, builds ETL pipelines, supports BI reporting distributions, and ensures data outputs (PnL/exposure) match reality.
Key Responsibilities
1. Integration and Automation:
- Design blueprints for how integrations interact, including processes, gates (authentication), and communication patterns across systems.
- Maintain all in-house connections, vessel tracking, price feeds, document generation tools, and automation utilities.
- Build and maintain scheduled jobs, ETL routines, and VM scripts; monitor and debug issues.
2. Data Engineering and Warehouse Management:
- Build and maintain the data warehouse and data models supporting reporting and reconciliation.
- Manage ETL pipelines between data environments and reporting environments.
- Implement validation logic and reconciliation checks to ensure data quality and consistency.
3. Reporting & Distribution:
- Manage reporting distributions and delivery schedules.
- Support BI development and stakeholder communication for reporting outputs (PowerBI/Tableau).
- Ensure PnL and exposure reports match operational reality (sense-checking data).
Required Skills and Experience
- Fluent in programming languages (Python) with strong scripting skills.
- Strong SQL, data modeling, and ETL pipeline experience.
- API architecture, integration patterns, authentication methods, and system design knowledge.
- BI tools familiarity (PowerBI/Tableau) and reporting distribution experience.
- Strong monitoring, debugging, and troubleshooting skills.
PnL/exposure and trading/finance data understanding for validation and reconciliation.
