General
We are looking for a Data Engineer Technical Leader who will join our client’s team contributing to the development and maintenance of the data infrastructure while proactively anticipating and preventing incidents in the fraud detection system.
Responsibilities/Activities
- Lead the development of Big Data projects to address business and technical needs, conduct comprehensive end-to-end testing with defined test scenarios, document defects, and oversee production deployment
- Supervise and ensure the quality of the data engineering team’s developments by identifying optimal technical solutions, providing guidance, and supporting the training of new and less experienced team members
- Oversee the development and maintenance of the data infrastructure, including databases, data warehouses, data lakes, and data visualization tools
- Monitor data pipelines and infrastructure to identify, analyse, and resolve performance issues
- Proactively manage production incidents by investigating root causes, coordinating resolution efforts, and facilitating effective communication with all involved parties to maintain a reliable environment
- Develop and implement strategies to reduce technical debt, enhance security measures, and manage the decommissioning of unused resources
- Collaborate with the team to maintain accurate and up-to-date documentation while ensuring compliance with rules and data governance standards
Requirements
Technical
- At least 7 years of professional experience in data engineering
- At least 3 years of professional experience in technical leading activities
- Experience with HDFS, HBASE, Scala, Spark, Hadoop
- Experience with Cloudera CI/CD, Jira, ElasticSearch
Education
- University degree in Computer Science or other related fields preferred
Others
- English language – Advanced
- French language – Intermediate (A2-B1)
- Good communication skills
- Leadership skills
- Autonomy, be proactive in solution proposition
- Be thorough on respecting planning commitments and reporting
Nice to have requirements
- Experience with control-M, Yarn, Kafka