Data Engineer

Job Description

We are seeking a skilled Data Engineer to join our Cardiff team. In this role, you will be responsible for developing, constructing, and maintaining data architectures and pipelines. You will work on large datasets and collaborate with various teams to optimize data flow and quality.

Responsibilities

• Develop data pipelines to process and store large amounts of data.
• Work with machine learning teams to provide data for predictive modeling.
• Ensure data security measures are in place for sensitive information.
• Automate repetitive tasks to improve workflow efficiency.
• Develop performance metrics to assess data processing efficiency.
• Provide support and training to team members on data tools.
• Report on data quality and performance metrics.

Requirements

Education

• Bachelor's degree in Information Technology or a related field
• Master's degree is a plus

Experience

• 5+ years of experience in data engineering

Technical Skills

• R
• Apache Spark

Soft Skills

• Teamwork
• Leadership

Certifications

• Certified Data Management Professional
• Microsoft Certified: Azure Data Engineer Associate

Languages

• English: Fluent

Advantageous

• Experience with containerization tools: Familiarity with Docker and Kubernetes for handling applications.
• Knowledge of Big Data technologies: Experience with tools like Hadoop and Spark.

Benefits

• Flexible working hours and remote work options
• Health and wellness programs
• Pension scheme with employer contribution
• Regular team-building events

Company Culture

• Continuous Learning: We promote ongoing professional development and provide learning resources.
• Work-Life Balance: We value the importance of balancing work and personal life for well-being.
• Diversity and Inclusion: We celebrate diverse backgrounds and perspectives within our team.