Minimum 5 years of experience in data engineering or related field
Strong proficiency in Python programming language
Deep understanding of AWS services, including Kinesis, S3, Athena, Redshift, DynamoDB, and Lambda
Experience with data ingestion pipelines, ETL processes, and data warehousing concepts
Requirements:
Develop, maintain and enhance ETL pipelines
Craft client code that is efficient, performant, testable, scalable, secure, and of high quality
Gather requirements, validate understanding amongst the team, and create and maintain relevant documentation
Take ownership of projects from technical design to a successful launch
Job description
Greetings, future tech savant:
Embark on an exciting journey into the realm of software development with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on crafting cutting-edge technologies that revolutionize industries. As a Software Engineer, you'll play a vital role in our dynamic team, contributing to exciting projects that redefine urban living, establish new media channels for enterprise companies, or drive innovation in healthcare. This opportunity goes beyond code – it's about creating epic solutions that leave a lasting impression in the market. If your passion for programming fuels your drive to make a real-world impact, consider this your pass to the captivating world of Product Development!
We are seeking a highly skilled Senior Data Engineer to join our team and play a pivotal role in building and maintaining robust data ingestion pipelines. The ideal candidate will have a strong foundation in data engineering principles, AWS technologies, and Python programming.
Responsibilities:
Develop, Maintain and Enhance ETL Pipelines
Craft client code that is not just efficient, but also performant, testable, scalable, secure, and of the highest quality.
Provide accurate status tracking, reporting, and estimation using project methods and tools.
Gather requirements, validate their understanding amongst the team, create and maintain relevant documentation.
Execute activities within current methodology and upholding the highest quality standards.
Foster collaboration with fellow engineers, designers, and managers to comprehend user pain points and iterate on solutions that drive client success.
Take ownership of projects, from technical design to a successful launch.
Qualifications:
Minimum 5 years of experience in data engineering or a related field.
Strong proficiency in Python programming language.
Deep understanding of AWS services, including Kinesis, S3, Athena, Redshift, DynamoDB, and Lambda.
Experience with data ingestion pipelines, ETL processes, and data warehousing concepts.
Proficiency in SQL and NoSQL databases.
Experience with data modeling and schema design.
Strong problem-solving and analytical skills.
Excellent communication and collaboration skills.
Experience with data security and privacy best practices.
Benefits:
At 3Pillar, we offer a world of opportunity:
Imagine a flexible work environment – whether it's the office, your home, or a blend of both. From interviews to onboarding, we embody a remote-first approach.
You will be part of a global team, learning from top talent around the world and across cultures, speaking English everyday. Our global workforce enables our team to leverage global resources to accomplish our work in efficient and effective teams.
We’re big on your well-being – as a company, we spend a whole trimester in our annual cycle focused on wellbeing. Whether it is taking advantage of fitness offerings, mental health plans (country-dependent), or simply leveraging generous time off, we want all of our team members operating at their best.
Our professional services model enables us to accelerate career growth and development opportunities - across projects, offerings, and industries.
We are an equal opportunity employer. It goes without saying that we live by values like Intrinsic Dignity and Open Collaboration to create cutting-edge technology AND reinforce our commitment to diversity - globally and locally.
