EU remote
Data Engineer
About this role
Are you a Data Engineer looking for a new challenge? If you want to expand your reach and share your knowledge with a team of professionals, contribute to the development of your colleagues' or Clients' skills, want to consolidate your expertise and grow on innovative projects, this is your opportunity! What this experience will bring you First of all, an interesting technical challenge but also an overview of our Client's projects.
We will build your career together and accompany you towards the development of new skills and technical leadership. What will your role be? We are looking for a Data Engineer to perform the following activities: Design, develop, deploy, validate and maintain scalable data pipelines and data architectures. Define and implement efficient data structures to ensure consistency, scalability and performance. Set up, maintain and optimise databases, data lakes and storage solutions for structured and unstructured data.
Develop data pipelines supporting Machine Learning algorithms and advanced data processing workflows. Manage and improve CI/CD pipelines, including automated testing, deployment and code quality. Collaborate with software developers, data scientists, engineering and production teams to meet technical and business requirements. Contribute to the continuous improvement of data engineering practices, testing strategies and development standards.
What are we looking for in you? Experience and competencies Master's degree in Computer Science, Engineering, Informatics or a related field. Solid experience in Data Engineering, including data pipeline development and data architecture. Strong proficiency in Python, SQL, Apache Spark and Docker . Familiarity with Jenkins, Jupyter, Apache Superset and Dagster . Good understanding of databases, data lakes, data warehouses and data processing architectures.
Experience with CI/CD pipelines, automated testing and unit testing . Interest in open-source technologies and on-premises solutions. Strong analytical, organisational and communication skills, with the ability to work in multidisciplinary teams. Nice to Have Experience with Kubeflow and data warehousing solutions. Knowledge of MATLAB unit testing . Familiarity with C/C++, Git, Bitbucket and DevOps . Additional experience in software engineering, frontend development or data analytics.