Big Data Engineer (remote)

On behalf of our client, a growing software development company focusing on Big Data Analytics, we are currently looking for a self-driven Big Data Engineer, to drive its software development team to the next level.

A day in the life of a Big Data Engineer

As a Big Data Engineer, your daily journey is all about unleashing the power of data. You will find yourself immersed in the world of Scala and Spark applications, where your role involves designing, developing, and optimizing solutions for processing vast amounts of data at scale. Beyond that, you'll be responsible for deploying and monitoring these applications in customer environments, contributing to their seamless functionality. In the spirit of collaboration, you'll also assist other teams in the design and development of Spark applications.

Your day-to-day

• Implement analytical algorithms in Spark
• Use Spark to transform and process network data
• Optimize and test Spark applications
• Deploy and monitor applications in customers’ environments
• Assist other teams in the design and development of Spark applications

What you will need

• At least 3 years of experience developing Spark applications in PySpark and/or Scala
• Excellent skills in deploying and monitoring distributed applications
• Strong experience with Unix systems
• Extensive experience with Python
• Experience with workflow engines i.e. airflow
• Strong skills in teamwork, communication, and analytical thinking
• Knowledge of version control tools
• Fluency in English, both oral and written

We love your personality if you

• like acting as an owner
• enjoy being a Team player
• enjoy start up mentality

What’s in it for you

• a stable working environment with great prospects
• fully remote position
• competitive salary with extra benefits
• supportive team members with expertise in their domain