Big Data Engineer

Job Description

As a Big Data Engineer, you will leverage your expertise in data processing and analytics to enhance our data infrastructure and support decision-making processes. Your role will involve developing scalable data pipelines, ensuring data quality, and collaborating with data scientists to implement predictive models.

Responsibilities

• Build and manage robust data processing systems for real-time analytics.
• Work closely with stakeholders to gather data requirements.
• Implement best practices for data governance and security.
• Monitor and troubleshoot any performance issues or data discrepancies.
• Guide junior data engineers in their tasks and development.
• Participate in team meetings to discuss project progress and challenges.

Requirements

Education

• Bachelor's degree in Computer Science, Data Science, or a related field
• Master's degree is a plus

Experience

• 3+ years of experience in big data engineering or related field

Technical Skills

• Apache Hadoop
• Spark
• SQL
• Python
• Java

Soft Skills

• Analytical thinking
• Team collaboration
• Communication

Certifications

• AWS Certified Big Data - Specialty
• Certified Data Management Professional (CDMP)

Languages

• English: Fluent

Advantageous

• Familiarity with machine learning frameworks like TensorFlow or Scikit-learn: Understanding of machine learning concepts and frameworks for analytics.
• Experience with NoSQL databases such as MongoDB or Cassandra: Proficient in using NoSQL databases for unstructured data handling.

Benefits

• Generous holiday allowance
• Pension scheme with company contributions
• Employee wellness programs
• Access to the latest technology and tools

Company Culture

• Team Collaboration: Our workplace thrives on teamwork and cooperation to achieve common goals.
• Work-Life Balance: We promote a healthy work-life balance to support employee wellbeing.
• Feedback and Recognition: We value feedback and ensure that achievements are recognised and celebrated.