Data Engineer

• Practice Data

• Technologies Business Intelligence Jobs and Data Recruitment

• Location Laakdal, Belgium

• Type Contract

Data Engineer

RESPONSIBILITIES

• Develop Data Pipelines using Databricks and or Spyspark libraries.
• Design and implement unit/component/integration tests
• Collaborate with other engineers on creating common code bas using Github SCM
• Take care of the non-functional requirement like Security, Compliance, performance and maintenance.
• Learn new technologies/tools and be able to support that in quick span of time.
• Experience in Data Analytic work would be a plus

REQUIRED

• Bachelor's degree in statistics, business, economics, mathematics, computer science, engineering, research, or a related field.
• 5+ years of industry experience, 3+ years of relevant big data experience
• Demonstrated experience and ability to deliver results on multiple projects in a fast-paced, agile environment

• Strong programming experience in Python, good knowledge of PySpark
• Experience working with Hadoop and Big Data processing frameworks (Spark, Hive, Nifi, Spark-Streaming, Flink, etc.)
• Knowledge of SCM Tools – Github, Bitbucket
• Experience working with NoSQL data stores such as HBase, DynamoDB, etc.

• Experience with SQL and SQL Analytical functions
• Experience building domain-driven Microservices
• Experience working with structured and unstructured datasets, including CSV, TXT, JSON, and XML
• Experience provisioning RESTful API’s to enable real-time data consumption

• Ability to collaborate with key partners to understand, identify, and capture requirements

• Ability to work in cross-functional teams following Agile Methodologies (SAFe, SCRUM)
• A flexible, dynamic personality who works well partnering/collaborating in a matrixed team environment
• Ability to work independently requiring minimal direction, execute large projects following established guidelines/procedures and take the initiative to explore and solve problems
• Desire to work collaboratively with your teammates to come up with the best solution to a problem
• Strong desire to learn and share knowledge with others

• share
• 
• 
• 
•