Match score not available

Unlock Premium Benefits Today!
🚀 Elevate your career with priority access.
Stand out to top recruiters with Jobgether Priority Access:
  • ✅ Top Match: We help you identify job offers where you're a perfect fit.
  • ✅ Exclusive Referral Service: Connect directly with recruiters as a Jobgether Certified Premium User.
  • ✅ Personalized Feedback: Receive feedback and expert guidance on applications, and have your profile manually reviewed.

Start Your Free Trial Now!

Start my free trial

Senior Data Engineer LatAa

Remote: 
Full Remote
Contract: 
Full time
Experience: 
Senior (5-10 years)
Work from: 
Costa Rica, Colombia

Offer summary

Qualifications:

5+ years in data engineering, Expertise in Databricks and Spark, Experience with cloud platforms (AWS preferred), Proficiency in cloud data warehousing, Strong knowledge of Python and SQL.

Key responsabilities:

  • Collaborate with clients to understand requirements
  • Collect and manage large data volumes
  • Design and maintain data pipelines for Data Products
  • Develop unified data models for the organization
  • Optimize ETL/ELT pipelines for performance
Provectus logo
Provectus Information Technology & Services SME https://www.provectus.com/
501 - 1000 Employees
About Provectus
Provectus is an Artificial Intelligence consultancy and solutions provider, helping businesses achieve their objectives through AI. We are recognized by industry think tanks as a leading provider of AI solutions in specific business domains, driven by sophisticated IT service management and tech innovation. Provectus is a value driver and a trusted partner for our clients and employees. Provectus is an AWS Premier Consulting Partner with competencies in Data & Analytics, DevOps, and Machine Learning. We design and build AI solutions for industry-specific use cases, Data and Machine Learning foundation, Cloud transformation, and DevOps adoption.
See more Provectus offers

Job description

Join us at Provectus to be a part of a team that is dedicated to building cutting-edge technology solutions that have a positive impact on society. Our company specializes in AI and ML technologies, cloud services, and data engineering, and we take pride in our ability to innovate and push the boundaries of what's possible.


We are seeking a talented and experienced Senior Data Engineer. As part of our diverse practices, including Data, Machine Learning, DevOps, Application Development, and QA, you will collaborate with a multidisciplinary team of data engineers, machine learning engineers, and application developers. You will encounter numerous technical challenges and have the opportunity to contribute to exciting open-source projects, build internal solutions, and engage in R&D activities, providing an excellent environment for professional growth.


Let's work together to build a better future for everyone!

Requirements:
  • 5+ years of hands-on experience in data engineering, with a strong emphasis on Databricks and Apache Spark.
  • Expertise in cloud platforms (AWS preferred, GCP, or Azure) preferably with relevant certifications.
  • Proficiency with cloud data warehouse technologies (Snowflake/Redshift/Clickhouse).
  • Proven experience in handling batch data workflows using Airflow or similar tools.
  • Experience in handling real-time data using Kafka and streaming processing frameworks.
  • Strong command of Python and SQL for building scalable and efficient data pipelines.
  • Strong communication skills with the ability to collaborate effectively in English.
  • Exceptional problem-solving skills and the ability to thrive in fast-paced environments.

    • Nice To Have:
  • Solid experience with Infrastructure as Code tools such as Terraform or AWS CloudFormation.
  • Databricks Data Engineering certification.
  • Experience designing scalable APIs using frameworks such as FastAPI or Flask.
  • Familiarity with BI tools such as Power BI, QuickSight, Looker, or Tableau.
  • Experience in implementing Data Mesh architecture or distributed data solutions.
  • In-depth knowledge of Data Governance principles, including Data Quality, Lineage, Security, and Cost Optimization.
  • Familiarity with Machine Learning frameworks (e.g., AWS SageMaker, MLflow) and classical ML tasks (e.g., OCR).
  • Experience in building Generative AI applications such as chatbots and RAG systems.

    • Responsibilities:
  • Collaborate with clients to understand their IT environments, applications, business requirements, and digital transformation objectives.
  • Collect, process, and manage large volumes of structured and unstructured data from diverse sources.
  • Work directly with Data Scientists and ML Engineers to design and maintain robust, resilient data pipelines that power Data Products.
  • Define and develop data models that unify disparate data across the organization.
  • Design, implement, and optimize ETL/ELT pipelines, ensuring scalability, performance, and maintainability.
  • Leverage Databricks and Apache Spark to perform complex data transformations and processing.
  • Build, test, and deploy scalable data-driven solutions in collaboration with cross-functional teams.

    • Required profile

    Experience

    Level of experience: Senior (5-10 years)
    Industry :
    Information Technology & Services
    Spoken language(s):
    EnglishEnglish
    Check out the description to know which languages are mandatory.

    Hard Skills

    Python (Programming Language)DatabricksSQL (Programming Language)Apache SparkAmazon RedshiftSnowflake (Data Warehouse)gRPCAmazon Web ServicesApache AirflowApache KafkaMicrosoft AzureMLflowOptical Character Recognition (OCR)Data GovernanceTableau (Business Intelligence Software)Power BIFlask (Web Framework)AWS CloudFormationAmazon QuickSightTerraformFastAPIAWS SageMakerData Grid

    Other Skills

    • Communication
    • Problem Solving
    Are you interested?

    Data Engineer Related jobs

    See more Data Engineer jobs
    Sign in or sign up with Google or LinkedIn