AWS Data Engineer

Work set-up: 
Full Remote
Contract: 
Experience: 
Senior (5-10 years)
Work from: 

Offer summary

Qualifications:

Minimum 6 years of experience in data engineering., Proficiency in Python, PySpark, SQL, and AWS services like Glue and Lambda., Strong understanding of data warehousing concepts and architecture, including Redshift and Athena., Experience designing and optimizing ETL pipelines and data models..

Key responsibilities:

  • Design, develop, and test data ingestion and ETL pipelines.
  • Implement and optimize data models and database performance.
  • Work with cloud-based data warehousing solutions like Redshift and Athena.
  • Collaborate with teams to ensure data security and best practices.

Exavalu logo
Exavalu Information Technology & Services Scaleup https://www.exavalu.com/
201 - 500 Employees
See all jobs

Job description

This is a remote position.

Overview :
  • 6 – 12 years of experience
  • Design, Develop and Test data ingestionETL pipelines with S3 Storage, Postgres, Athena, Redshift
  • Strong experience in python, pyspark, SQL, Glue, Lambda and orchestration techniques
  • Develops stored procedures, database triggers and SQL queries with an understanding of data warehousing objects (type2 dimensions, CDC, aggregations, starsnowflake schema, etc)
  • Knowledge of appropriate data partitioning strategy in Data Warehouse with an understand of Distribution styleskeys and Sort keys, compression level considerations, security and knowledge of Redshift underlying architecture in terms of Leader Nodes, Compute Nodes, slices and how data is distributed.
  • Identify and resolve data model performance issues to optimize database performance and must be able to apply best Practices


    • Benefits

      At Exavalu, we are committed to building a diverse and inclusive workforce. We welcome applications for employment from all qualified candidates, regardless of race, color, gender, national or ethnic origin, age, disability, religion, sexual orientation, gender identity or any other status protected by applicable law. We nurture a culture that embraces all individuals and promotes diverse perspectives, where you can make an impact and grow your career.

      Exavalu also promotes flexibility depending on the needs of employees, customers and the business. It might be parttime work, working outside normal 95 business hours or working remotely. We also have a welcome back program to help people get back to the mainstream after a long break due to health or family reasons.



Required profile

Experience

Level of experience: Senior (5-10 years)
Industry :
Information Technology & Services
Spoken language(s):
English
Check out the description to know which languages are mandatory.

Data Engineer Related jobs