Big Data Engineer (Hadoop & Spark)

Job Description

We are seeking a Big Data Engineer skilled in Hadoop and Spark to join our dynamic tech team. The ideal candidate will have a proven track record in designing and implementing big data solutions, optimizing processing pipelines, and managing large datasets in a fast-paced environment.

Responsibilities

• Architect and develop big data solutions with a focus on Hadoop and Spark.
• Design data models and schemas that align with business needs.
• Integrate diverse data sources into the data infrastructure.
• Ensure data security and compliance within all big data projects.
• Create documentation for big data processes and workflows.
• Lead code reviews and mentor junior team members.
• Collaborate in agile teams to deliver projects on time.

Requirements

Education

• Bachelor's degree in Computer Science or a related field
• Master's degree is preferred

Experience

• 5+ years of experience in big data engineering or related fields

Technical Skills

• Hadoop
• Apache Spark
• SQL
• Python
• Data warehousing

Soft Skills

• Analytical Thinking
• Communication Skills
• Time Management

Certifications

• Cloudera Certified Professional (CCP)
• AWS Certified Big Data - Specialty

Languages

• English: Fluent

Advantageous

• Experience with containerization tools: Familiarity with Docker and Kubernetes for deployment.
• Knowledge in machine learning algorithms: Basic understanding of machine learning principles and frameworks.

Benefits

• Competitive salary and performance-related bonuses
• Comprehensive health insurance including dental and vision
• Flexible working arrangements including remote work
• Professional development and training opportunities

Company Culture

• Collaborative Environment: We encourage collaboration and teamwork to drive innovation.
• Continuous Development: We support ongoing professional development and learning.
• Inclusive Work Culture: We are committed to fostering an inclusive environment for all employees.