About:
The Data Engineer extracts, combines, transforms, loads, manipulates and cleanses data all whilst effectively handling interfaces to large amounts of data and creates/integrates data structures suitable for analysis.
The Data Engineer must understand data architecture and data management. Develop and deploys algorithms in performance-efficient code in analytical and data platforms. Liaise with enterprise architects, data governors, and subject matter experts to fill any gaps in the requirements or design.
Core Responsibilities:
• Works and experiments with state-of-the-art data storage and processing technologies.
• Builds large-scale batch and real-time data pipelines with data processing frameworks in cloud platforms or on-premise
• Leverages best practices in continuous integration and delivery
• Pre-process, clean and structures data to facilitate data exploration and advanced analytics/Machine Learning activities
• Learns and uses modern data preparation, integration and AI-enabled metadata management tools and techniques.
• Tracks data consumption patterns, working with data governance and information stewards within these teams, and participates in vetting and promoting content created in the business and by data scientists to the curated data catalogue for governed reuse
• Performs intelligent sampling and caching.
• Recommends and implements automation in existing and future integration flows.
• Helps improve data quality by driving advancements in data acquisition, testing and tooling
• Works in cross-functional agile teams to continuously experiment, iterate and deliver on new product objectives
• Analyzes requested changes to fill in the details fitting in the complete picture and while doing that aligns with all parties involved (Architects, Data Governance, …), either as preparation for yourself or for data engineer colleagues, before starting the implementation.
Education & Experience:
• Bachelor’s or Master’s Degree in Computer Science preferred or equivalent combination of education and experience
• Minimum 4 years of experience as a data engineer
• Experience in (captive) financial services and understands the processes and execution models in financial services is an asset
• Experience in Azure SQL, Azure Data Factory, Azure DevOps, Databricks, Delta Lake is a must, certification is recommended
• Experience in working with high-volume heterogeneous data sets 2
• Experience in agile software processes and data-driven development
• Experience with data lakes and dimensional models
Required Competencies and Skills:
• Azure Data Engineer Associate certification is recommended
• Databricks Data Engineer Professional certification is recommended
• Strive for clean, reusable and performant code
• Skilled ETL/ELT developer
• Strong understanding of data and information
• Business savvy, understand information from a business perspective and use that to more effectively develop enabling technologies
• Strong problem-solving and analytical skills
• Goal-oriented and positive attitude to deliver against targets
• Able to work independently and proactively
• Global, open, innovative, holistic and goal-oriented mindset
• Ability to set and meet deadlines
• Ability to work in high-pressure situations
• Excellent attention to detail
• Advanced level of English, oral and written
If you are interested in this position or know someone who would be perfect for this role please contact us to find out all details of the position!
Data Engineer • North Holland, Netherlands, Netherlands
PostNL zoekt een Data Engineer die verantwoordelijk is voor het bouwen en onderhouden van de data-infrastructuur.Je vertaalt businessbehoeften naar schaalbare data pipelines en werkt nauw samen met... Laat meer zien
A tech-driven company is seeking a Software Engineer to join their AI team in Amsterdam.The role involves building data collection processes for model training, and requires extensive knowledge in ... Laat meer zien
Parttime/fulltime, 32-40 uur) /b /ppBij PB Web Media bouwen we aan adult content platforms met miljoenen bezoekers per dag.Dit betekent dat elke beslissing telt en elke voorspelling direct enorme i... Laat meer zien
Progressive is seeking an experienced Senior Data Analyst in Hoofddorp, Netherlands to analyze web and digital data, translating insights into actionable business recommendations.You will join a mu... Laat meer zien
Overview /h3pPuffy Amsterdam, North Holland, Netherlands /ppbPosition: /b Head of Data Infrastructure Analytics /ppbCompensation: /b Up to USD $200,000 per annum + up to 25% Performance Bonus (Equ... Laat meer zien
Overview /h3 pBen jij klaar om de volgende stap te zetten in je carrière als PKI Engineer en een sleutelrol spelen in het waarborgen van digitale veiligheid? Voel jij je thuis in een dynamische en ... Laat meer zien
Als Principal Platform Engineer Database Platforms ben jij het technisch aanspreekpunt voor de databaseplatformen binnen Enterprise Technology.Je combineert diepgaande database‑expertise met strate... Laat meer zien
Overview /h3pbFreelance Data engineer - Finance domain /b /ppFor a client active within aviation, I am looking for an experienced Data engineer that has experience with the GCP stack and scala.This... Laat meer zien
Bouw mee aan het Azure-platform achter de mooiste reizen? /p pBij Fox Reizen draait alles om bijzondere reiservaringen.Fox Reizen telt circa 140 medewerkers, waarvan ongeveer 15 collega's werkzaam ... Laat meer zien
Een toonaangevende recruiter in Nederland zoekt een Chief Engineer voor het technisch beheer binnen datacenters.Als u iets meer wilt weten over deze vacature, of overweegt te solliciteren, lees dan... Laat meer zien
An innovative tech company is seeking an AI Engineer based in the Netherlands to join a dynamic team.The successful candidate will design, develop, and deploy cutting-edge AI solutions.Key responsi... Laat meer zien
Circle B builds sustainable IT infrastructure for the AI and cloud era.For over a decade— we have designed and deployed datacenter, edge, and AI/HPC systems on Open Compute Project (OCP) hardware.W... Laat meer zien
A leading technology company in Schiphol-Rijk is seeking a Solutions Engineer to engage in technical selling of their products and services.The successful candidate will work with sales and partner... Laat meer zien
Senior Backend Engineer (AWS) – Lumenalta /ppLocation: Amsterdam, North Holland, Netherlands /ph3Key Responsibilities /h3ulliBackend Development: Build, maintain, and optimize backend systems using... Laat meer zien
Heb jij een passie voor het ontwikkelen van dataoplossingen die daadwerkelijk bijdrage aan waarde voor de klant? Wil je meebouwen aan moderne datamanagement oplossingen en herken je zaken als Data ... Laat meer zien
Ekco, opgericht in 2016 in Ierland, is een snelgroeiende internationale en pro-actieve IT-organisatie die graag met je meedenkt!.De consultants, architecten en beheerders van Ekco adviseren en help... Laat meer zien
Lees hieronder meer over de algemene taken die bij deze functie horen, evenals de vereiste vaardigheden.Would you like to participate in large (cloud) migrations of our international customers? At ... Laat meer zien
Huxley Schiphol-Rijk, North Holland, Netherlands /p h3Principal Consultant @Huxley | Technology for Aviation Tech-Platforms | Interim /h3 pFor a client within aviation, we are looking for a bCloud... Laat meer zien
A leading D2C brand in Amsterdam is seeking a Head of Data Infrastructure Analytics to architect analytics systems driving strategic decision-making.The role involves ensuring data quality, managi... Laat meer zien
Senior Platform Database Engineer | Paid relocation to Barcelona 🇪🇸 /h3p1 week ago Be among the first 25 applicants /ppGet AI-powered advice on this job and more exclusive features.At Preply, we’... Laat meer zien
