General
We are looking for Data Engineers who will join our client’s team contributing to the development and maintenance of the data infrastructure while proactively anticipating and preventing incidents in the fraud detection system.
Responsibilities/Activities
- Contribute to the development of Big Data projects to address business and technical needs, conduct comprehensive end-to-end testing with defined test scenarios, document defects, and oversee production deployment
- Create, implement, and maintain efficient data pipelines for extracting, transforming, and loading (ETL) data from diverse sources
- Manage and enhance the organization’s data infrastructure, including databases, data warehouses, data lakes, and data visualization tools
- Monitor and anticipate potential incidents within the fraud detection microservices, conduct investigations, provide follow-ups, and coordinate communication with all relevant stakeholders
- Collaborate with the team to maintain accurate documentation, uphold data governance standards, and ensure responsible and compliant data usage
- Develop strategies to reduce technical debt, enhance security, and decommission outdated or unused resources
Requirements
Technical
- At least 3 years of professional experience in development activities, production follow-up
- Experience with Scala, Spark, Hadoop
- Experience with Cloudera CI/CD, Jira, ElasticSearch
Education
- University degree in Computer Science or other related fields preferred
Others
- English language – Advanced
- Autonomy, be proactive in solution proposition
- Be thorough on respecting planning commitments and reporting
Nice to have requirements
- Experience with HDFS, HBase, control-M, Yarn, Kafka
- French language