Key Facts

Remote From:

Latin America

Category: Data Engineer

Full time

Mid-level (2-5 years)

English

Hard Skills

gRPC PostgreSQL BigQuery FastAPI

Other Skills

•
Communication

Roles & Responsibilities

4+ years of experience building data pipelines, backend services and automated data processing systems
Strong background in web scraping with tools like Scrapy, Playwright or similar
Experience deploying pipelines on cloud platforms such as GCP or AWS
Solid knowledge of ETL frameworks, workflow orchestration (Airflow) and modern data stores (BigQuery, PostgreSQL)

Requirements:

Build new structured datasets, including scraping accelerators, Form D filings and dynamic web sources
Develop automated ETL pipelines that parse, clean and transform content using LLMs
Define and maintain database schemas in Supabase or PostgreSQL
Create evaluation frameworks to measure and compare LLM performance across pipeline components
Contribute to the design of scalable data architectures using GCP services
Improve reliability, observability and deployment workflows for scraping and data processing systems

NIR-YU

Human Resources, Staffing & Recruiting

About NIR-YU

Nir-Yu specializes in helping Small and Medium Enterprises unlock the potential of their business. Our typical customer is worried about not being able to make enough progress on their product(s) or project(s) with their current team; they need additional team-members to deliver work on-time and with the required quality. Tight budgets also make it necessary to lower average wage costs, making it necessary to consider hiring internationally to lower costs. We help these companies by providing a bespoke service that finds and hires remote workers from Mexico, Colombia, Argentina, Chile, Brazil and other countries in LatAm based on the company’s specific job descriptions to work as an extension of their team and perform the required functions. Unlike many other companies, we don’t have a bench of contractors to be hired out, instead each team is hired specifically to meet specific requirements and to work exclusively as a remote employee.

Company type: Scaleup

Industry: Human Resources, Staffing & Recruiting

Founded: 2018

Company size: 201 - 500

Website LinkedIn See all jobs →

Job description

The Role:

You’ll help build the data foundation of our product: high‑volume web scraping systems, structured datasets and LLM‑driven processing pipelines. The role combines hands‑on engineering with architectural thinking and suits someone who enjoys turning messy web data into reliable, scalable outputs.

Key Responsibilities:

Build new structured datasets, including scraping accelerators, Form D filings and dynamic web sources.
Develop automated ETL pipelines that parse, clean and transform content using LLMs.
Define and maintain database schemas in Supabase or PostgreSQL.
Create evaluation frameworks to measure and compare LLM performance across pipeline components.
Contribute to the design of scalable data architectures using GCP services.
Improve reliability, observability and deployment workflows for scraping and data processing systems.

Requirements:

4+ years of experience building data pipelines, backend services and automated data processing systems.
Strong background in web scraping with tools like Scrapy, Playwright or similar.
Experience deploying pipelines on cloud platforms such as GCP or AWS.
Solid knowledge of ETL frameworks, workflow orchestration (Airflow) and modern data stores (BigQuery, PostgreSQL).
Comfortable working with Docker and API frameworks like FastAPI.
Clear, fluent communication in English.