For one of our clients in Amsterdam are we looking for a Data Engineer.
Organization
The organization has been active within the Aviation industry for more than 50 years and brings a lot of people around europe every day.
Data Science is evolving rapidly and taking a central role in many industries. In order to, not only better service our passengers, but also to optimize the operational performance this capability is vital to this airline. We are specifically looking for a person with a passion for Big Data, Scalable environments and advanced Business Intelligence solutions to provide all stakeholders with actionable insights.
Project
As a Data Engineer it is your responsibility to make sure that the Data Scientists and Analysts have access to all the needed data and tooling. To be able to do this you must be comfortable working in an Azure environment and you are always looking for new ways to improve and accelerate. Besides providing everything evolving around data and tooling, you can also advice on important topics such as: security, performance and emerging technologies.
Tasks & Responsibilities
- Setup and maintenance of the cluster and gateway infrastructure;
- Installation and updating the Data Science environment and tooling;
- Build, support and schedule data applications and pipelines;
- Import and transform internal & external data sources.
Experience
- Programming (Python, Scala, Java);
- You are familiar with versioning, testing and API technologies like REST and JSON;
- Linux and command line tooling;
- Experienced in working with the Hadoop eco system. You are comfortable configuring big data tooling like HDFS, Spark, Hive, etc;
- Knowledgeable on databases and query languages like SQL;
- You are familiar with setting up ETL pipelines;
- Working in multidisciplinary SCRUM teams.
Characteristics
You are a real team player, full of ideas and courageous when it comes to ownership. Furthermore you are energetic and have an eager personality with a touch of humor and a strong focus on results.
Starting date and location
- ASAP
- Amsterdam
- Hours per week: 36-40
