Data Engineer

This is a remote position.

The IT training pioneer BilgeAdam is presenting yet another OS opportunity, this time for a Data Engineer. Are you looking for a remote position where you can contribute to your professional development? Does an international work environment with the newest tech stack sound tempting? If yes, you might be interested in this position.

As a Senior Data Engineer, you collaborate with our client on designing, building and maintaining their data platform, from obtaining data from the source to making data available for users. Additionally, orchestration, security and adoption are also important aspects of your function.

Responsibilities:

• Develop and maintain the data platform using technologies above including:
  
• Designing data solutions
  
• Consuming data from various data sources (flat files, JSON, APIs, Kafka streaming)
  
• Implementing data cleansing
  
• Building complex analytical queries
  
• Monitoring the health and performance of the data platform
  
• Participate in Agile (Scrum) ceremonies with the team
  
• Collaborate with product owners to define upcoming data product changes and ensure alignment
  
• Partner with external data source providers to establish and maintain data source definitions
  

Technologies:

• Azure Databricks (PySpark)
  
• Azure Data Factory
  
• Azure Synapse Analytics (Serverless pool)
  
• Azure Data Lake Gen2
  
• Azure SQL Database
  
• Power BI
  

Requirements:

• Proficiency in English (German is also beneficial)
  
• You have gained 3-5 years of work experience in a similar role
  
• You have experience using Azure Data Factory, Azure Databricks and/or Azure Synapse Analytics and know how to efficiently utilize these technologies.
  
• You have experience working with large datasets and know how to develop solutions to process large amounts of data as efficiently as possible.
  
• Experience with Agile/Scrum and knowledge of DevOps or JIRA is a plus.
  
• You are excited about the latest developments within the Microsoft domain, such as Fabric and Copilot, and are enthusiastic about experimenting with them.