EU remote
Senior Data Engineer
About this role
Are you an experienced Data Engineer who wants to work with cutting edge technologies? Are you keen to build, develop and work at the forefront and centre of data engineering in a global enterprise? If so, this may be the role for you! This is a hybrid role with the flexibility to work both virtually and from Dublin office. Reporting to the Data Engineering Manager you will: Work with solution architects, data architects, and application developers to gather data integration requirements and develop solutions accordingly Collaborate with data scientists to develop and integrate statistical and forecasting algorithms into robust high-performing pipelines.
Design, develop, and optimize data pipeline solutions scaling to multi-terabyte datasets in Databricks environments Assess and improve Spark performance in areas of memory management, caching strategies, and cluster resource optimization Manage individual tasks and communicate updates to colleagues following an Agile Scrum methodology Mentor junior colleagues, providing guidance and support to help them grow professionally Maintain up to date Technical and Operational documentation How this opportunity is different This is a great opportunity for an experienced Engineer who wishes to broaden their role through working across multiple data and analytics projects and products.
The Data Engineering team is working with new, innovative technologies such as Databricks, Unity Catalog, and AWS alongside established technologies like SQL Server. Third level IT qualification or equivalent experience, with a solid foundation in mathematics and/or statistics. 10+ years hands-on experience as an ETL/DWH developer with strong knowledge in designing, developing, and scaling end-to-end high-volume data integration processes Strong programming experience with Python, SPARK, and SQL Strong understanding of Spark execution plans and memory management Experience with Databricks cluster configuration, performance, and cost optimization strategies Customer focused with excellent communications skills (both oral and written) A strong team player that can also work independently Why Version 1? At Version 1, we believe in providing our employees with a comprehensive benefits package that prioritises their wellbeing, professional growth, and financial stability.