Match score not available

Cloud Data Engineer

Remote: 
Full Remote
Contract: 
Experience: 
Senior (5-10 years)
Work from: 

Offer summary

Qualifications:

Bachelor's degree in Computer Science or IT, 7+ years experience as Data/Cloud Engineer, Proficient with AWS, Azure, and GCP, Experience in ETL tools and data platforms, Strong programming skills in Python, Java, or Scala.

Key responsabilities:

  • Design and maintain scalable ETL pipelines
  • Architect and implement data lakes and warehouses
  • Integrate various data sources into a data lake
  • Monitor and optimize pipeline performance
  • Collaborate with teams to deliver data solutions
Brighttier logo
Brighttier Scaleup https://brighttier.com/
11 - 50 Employees
See more Brighttier offers

Job description

Job Title: Cloud Engineer 
Location: Remote
Job Type: Contract

Overview
Bright Tier Solutions is seeking a highly skilled Cloud Engineer with a strong background in cloud platforms like AWS, Azure, and GCP. The ideal candidate will be proficient in designing, implementing, and maintaining scalable ETL pipelines and data lakes using a variety of cloud-native tools. This role demands expertise in data platforms like Redshift, Snowflake, Databricks, and Synapse, with a focus on optimizing data ingestion and transformation processes. Familiarity with data extraction from SAP or ERP systems is a plus.

Key Responsibilities:
Design and Development:
- Design, develop, and maintain scalable ETL pipelines using cloud-native tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, and GCP Dataflow.
- Architect and implement data lakes and data warehouses on platforms such as AWS, Azure, and GCP.
- Develop and optimize data ingestion, transformation, and loading processes using platforms like Databricks, Snowflake, Redshift, BigQuery, and Azure Synapse.
- Implement ETL processes with tools like Informatica, SAP Data Intelligence, and others.
Data Integration and Management:
- Integrate various data sources including relational databases, APIs, unstructured data, and ERP systems into the data lake.
- Ensure data quality and integrity through rigorous testing and validation.
- Perform data extraction from SAP or ERP systems when necessary.

Performance Optimization:
- Monitor and optimize the performance of data pipelines and ETL processes.
- Implement best practices for data governance, security, and compliance.

Collaboration:
- Collaborate with data scientists, analysts, and cross-functional teams to understand data requirements and design data solutions.
- Partner with stakeholders to deliver high-quality, efficient cloud data solutions aligned with business needs.

Documentation and Maintenance:
- Document all technical solutions, processes, and workflows.
- Maintain, troubleshoot, and optimize existing ETL pipelines and data integrations.

Required Qualifications:

- Education: Bachelor's degree in Computer Science, Information Technology, or a related field (Advanced degrees are a plus).

- Experience:
 - 7+ years of experience in a Data Engineer or Cloud Engineer role.
 - Extensive experience with cloud platforms like AWS, Azure, and GCP.
 - Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.
 - Proficiency in data platforms like Redshift, Snowflake, Databricks, BigQuery, and Azure Synapse.
 - Experience with SAP or ERP systems data extraction is a plus.
 - Strong experience with Spark and Scala for data processing.

Key Skills:

- Strong programming skills in Python, Java, or Scala.
- Proficient in SQL and query optimization techniques.
- Familiarity with data modeling, ETL/ELT processes, and data warehousing concepts.
- Knowledge of data governance, security, and compliance best practices.
- Excellent problem-solving, analytical, and communication skills.

Preferred Qualifications:

- Experience with additional data tools and technologies such as Apache Spark or Hadoop.
- Certifications in cloud platforms (e.g., AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified: Azure Data Engineer Associate).
- Experience with CI/CD pipelines and DevOps practices for data engineering.

Required profile

Experience

Level of experience: Senior (5-10 years)
Spoken language(s):
English
Check out the description to know which languages are mandatory.

Other Skills

  • Analytical Thinking
  • Verbal Communication Skills
  • Problem Solving

Cloud Engineer Related jobs