About Our Client
Our client is a major player in the commodities sector, specializing in international trading. The company plays a key commercial role in supply chain and supports the energy transition. Through its expert local teams, it provides global coverage with tailored sourcing, risk management, logistics and financing solutions to a wide network of industrial clients.
The Opportunity
We are seeking a proactive and experienced Data Infrastructure Engineer to design, build, and maintain robust data infrastructure and pipelines. This role is central to enhancing data architecture, integrating platforms, and supporting data science industrialization. The ideal candidate brings strong expertise in cloud-based data solutions, such as Azure Data Factory, Microsoft Fabric, Databricks or Snowflake, as well as in governance and cost monitoring. The successful candidate will champion data best practices across the organization.
Main Responsibilities
Data Pipeline Development & Integration
- Design, build, and optimize scalable data pipelines
- Integrate data from diverse sources (on-prem SQL databases, Azure DWH, external data sources) while ensuring consistency, integrity, and validation
- Transform raw data through cleansing, enrichment, aggregation, and filtering techniques
Performance & Reliability
- Monitor and tune data systems for performance, scalability, and efficiency
- Implement query optimization strategies
- Analyze and optimize data loads and troubleshoot operational issues
Governance & Quality
- Implement data quality checks and validations to ensure accuracy, completeness, and consistency
- Maintain data lineage documentation and tools
- Act as a gatekeeper for data access, helping to ensure security, compliance, and governance
- Establish and enforce best practices in data strategy, infrastructure, analytical applications and services
Collaboration & Oversight
- Work closely with data scientists and analysts to support model optimization and governance
- Guide and challenge external data consultants to align with internal standards and expectations
- Develop agile, business-driven data platform solutions
- Monitor Azure costs to ensure cost-effective operations
Key Projects
Integration Platform with ETL to Complement Azure Data Factory
- Objective: Establish a robust integration platform to standardize data exchange between on-prem applications and for analytics
Data Science Industrialization
- Objective: Optimize and professionalize the practice of data science by applying best practices
Data Infrastructure Upgrade
- Objective: Upgrade the data platform to enhance performance, scalability, and efficiency
Required Profile
Education & Experience
- Bachelor's degree in Computer Science, Engineering, Physics, or similar quantitative field
- More than 4 years of experience as Data Engineer or in a similar role in a hedge fund or similar financial company, including data integration, modeling, optimization and data quality, or other areas directly relevant to data engineering responsibilities and tasks
Technical Skills
- SQL: Proficient in writing and optimizing complex SQL queries
- Python: Strong programming skills in Python for data manipulation and automation
- Azure: In-depth knowledge of Azure services and cost management
- MS Fabric: Experience with MS Fabric for data integration and management
- Data processing tools: PySpark or SparkSQL
Key Competencies
- Strong analytical and problem-solving skills
- Excellent communication and teamwork abilities
- Excellent business acumen and interpersonal skills; able to work across business lines at a senior level to influence and effect change to achieve common goals
- Ability to describe business use cases/outcomes, data sources and management concepts, and analytical approaches/options
- Ability to design, build, and deploy data solutions that capture, explore, transform, and utilize data to support AI, ML, and BI
- Ability to translate among the languages used by executive, business, IT teams
What We Offer
- Opportunity to work with cutting-edge technologies
- Collaborative and innovative work environment
- Permanent contract with competitive package
- Career development within an international structure
- Exposure to global commodities markets and energy transition projects
