General
We are looking for Big Data Engineers who will join our client’s team contributing to the development and maintenance of the data infrastructure while proactively anticipating and preventing incidents in the fraud detection system.
Responsibilities/Activities
- Carry out the development of Big Data projects to address business and technical needs, conduct comprehensive end-to-end testing with defined test scenarios, document defects, and oversee production deployment
- Design, build, and maintain robust data pipelines for extracting, transforming, and loading data from diverse sources
- Develop and manage the data infrastructure (databases, data warehouses, and data lake) as well as data visualization tools
- Proactively anticipate and mitigate production incidents affecting fraud detection microservices in the Big Data environment, through investigations, monitoring, and cross-team communication
- Define and implement strategies to reduce technical debt, enhance security, and decommission obsolete resources
- Collaborate with the team to ensure up-to-date documentation, enforce data governance standards, and promote responsible data usage
Requirements
Technical
- At least 3 years of professional experience in development activities, PROD follow-up
- Experience with Scala, Spark, Hadoop
- Experience with Cloudera CI/CD, Jira, ElasticSearch
Education
- University degree in Computer Science or other related fields preferred
Others
- Good level of English
- Autonomy, be proactive in solution proposition
- Be thorough on respecting planning commitments and reporting
Nice to have requirements
- Experience with HDFS, HBase, control-M, Yarn, Kafka
- French language