Data Engineer - database | Oppdrag | kons.no

As a Data Engineer, you will work with implementing data sources in the data layer. The work comprises technical disciplines such as data analysis, understanding of the ACORD data model, implementation of streaming ETL and data quality tests. As the best solutions are made in collaboration, you will engage with people from across the organization and will work closely with data scientists, app developers, business analysts and business sponsors.

Professionel skills:

Our tech stack is ever growing and evolving ensuring we stay up to date with the technology, as we often have to work on the edge of streaming. As a data engineer you will mainly be exposed to:

SQL and SQLMesh – This is used to write the transformation logic
Trino and RisingWave – These are our execution engines
Kafka – Kafka is used as the streaming platform. Our pipelines work purely on Kafka; both input and output
GIT – Everything must go into a Git repository, and together with our DevOps team we are moving toward a GitOps setup.
GraphQL – Used as an integration layer to other systems to read data from

Through you collaboration with our Platform team you might also be exposed to the following technologies:

Docker
K8S
Operators
CI Pipelines

Oppstart: Asap

Varighet: 31.03.2027

Arbeidssted: Ønsket i Bergen, men remote er også akseptabelt

Omfang: 100%