Data Engineer

Role Overview:

Oslo - 6 Months

Start date: August

As a Freelance Data Engineer, you will be instrumental in designing, developing, and optimizing our data infrastructure. Your expertise in Python, SQL, Azure Databricks, Microsoft Fabric, and Spark will be crucial in driving the success of our project. This role requires a proactive individual with a passion for data engineering and a strong ability to solve complex problems.

Key Responsibilities:

* Design and develop scalable data pipelines and ETL processes.
* Optimize and manage data storage solutions using Azure Databricks and Microsoft Fabric.
* Implement and maintain data models and data architecture to support analytics and reporting.
* Utilize Python and SQL to perform data manipulation, transformation, and analysis.
* Leverage Spark for big data processing and real-time data integration.
* Collaborate with data scientists, analysts, and other stakeholders to ensure data quality and accessibility.
* Monitor and troubleshoot data pipelines to ensure reliability and performance.
* Document and maintain best practices and standards for data engineering processes.