Een bedrijf van de Tenth Revolution Group

nieuwKenmerk: NFI 10412412_1738172928

Senior Data Engineer

Norway

  • NOK 100,000 to NOK 1,100,000 NOK
  • Developer/Programmer Functie
  • Vaardigheden: MS BI, Microsoft BI, Azure, Data Lake, Power Platform, Power BI, PowerApps, CDM, CDS, Technical, Python, CI/CD, DevOps
  • Niveau: Senior

Functiebeschrijving

Senior Data Engineer

NFI 10412412_1738172928

Are you our next Senior Data Engineer?

If you're a Senior/Lead Data or Backend Engineer passionate about a chance to contribute to the technical decisions and data infrastructure around the IoT products providing a greener, fault-free future for our railways, this role might be a great fit for you!

About the Role
We are seeking a Senior Data Engineer to join our team, bringing expertise in building scalable and resilient data platforms, as well as developing APIs to expose data pipelines, models, and insights to other systems. Our product is already established in the market, serving customers and users across three continents. However, as we transition from a startup to a global SaaS company, we aim to enhance our data-heavy platform. We're looking for a new team member to help us drive our vision for data intelligence in the railway industry. In this role, you'll collaborate with a small, cross-functional team to design, build, and improve solutions, ensuring a seamless end-to-end user experience. If you're passionate about data and want to shape the future of railway technology, we'd love to have you on board!

Key Responsibilities

* Design and maintain scalable data pipelines for high-volume IoT data ingestion, streaming platforms, and similar technologies.
* Work closely with the data science team to support real-time data processing and model training workflows on platforms such as Databricks.
* Optimise TimescaleDB databases for managing large-scale, terabyte-sized time-series data.
* Ensure smooth integration of IoT telemetry with the data platform.
* Manage cloud infrastructure on Azure, using Infrastructure as Code tools and deploying with Docker for scalability.
* Monitor and optimise data pipelines to enhance performance, reduce costs, improve scalability, and ensure reliability.
* Implement technologies to support data governance, quality control, and system monitoring.
* Document systems and processes and communicate effectively with cross-functional teams.

Requirements
To succeed in this role, you'll need a strong technical background, proactive problem-solving abilities, and experience building scalable, data-centric solutions. The ideal candidate will have:

* 5+ years of experience in data engineering, with a focus on high-volume data pipelines and real-time data processing.
* Experience working with event streaming platforms for large-scale data ingestion.
* Proficiency in managing time-series databases and handling terabyte-scale datasets, particularly with TimescaleDB.
* Hands-on experience with Python for production-level data processing and AI/ML model deployment (e.g., MLflow, Airflow, PySpark, polars).
* Experience in building APIs to expose data pipelines, models, and insights to other systems - knowledge of frameworks like FastAPI is a bonus.
* Strong understanding of cloud infrastructure services, IaC tools such as Terraform, and Docker for containerised deployments.
* Excellent communication and documentation skills to collaborate across teams.

It would also be advantageous if you have experience with:

* MQTT and IoT data ingestion, particularly for IoT fleet management.
* Modelling complex data and designing pipelines using frameworks like DBT.

What We Offer

* A competitive compensation package that reflects your experience, knowledge, and contribution, including base salary, bonus, share options, 5% pension, and comprehensive insurance.
* A unique opportunity to influence the future of the railway industry, helping make sustainable transport more competitive and future-proof.
* The chance to apply and grow your skills in a diverse, real-world environment with a cross-functional team.
* The opportunity to work with cutting-edge technology, including state-of-the-art IoT-based data collection and analytics tools.
* Be part of an early-stage scale-up journey where you can significantly impact what we build and how we do it.
* A dynamic, international, and supportive work environment, with a focus on work-life balance and flexible home-office arrangements.