Match score not available

NLP Data Engineer

Remote: 
Full Remote
Contract: 
Experience: 
Mid-level (2-5 years)
Work from: 

Offer summary

Qualifications:

3+ years as a Data Engineer, Proficient in Python and R, Experience with NLP and prompt engineering, Skilled in ETL pipeline design, Knowledge of API integration.

Key responsabilities:

  • Develop prompt-engineering scripts for data cleansing
  • Standardize metadata for products across platforms
  • Ensure proper merging and deduplication of products
  • Create review systems for manual data validation
  • Group similar products by attributes effectively
Massive Pixel Creation logo
Massive Pixel Creation Information Technology & Services SME https://massivepixel.io/
51 - 200 Employees
See more Massive Pixel Creation offers

Job description

PROJECT

We are developing a mobile application that allows users to compare prices of the same products across different stores in the United States. Our app aims to provide consumers with real-time insights into product availability, pricing, and brand choices, helping them make more informed shopping decisions. We are currently expanding our efforts to enhance the quality of product metadata and automate data processing, utilizing cutting-edge technologies like Natural Language Processing (NLP) and machine learning.

To support our rapid growth, we are looking for a talented Data Engineer with a strong focus on Prompt Engineering to help us build and optimize automated systems that will improve data accuracy, reduce manual work, and ensure smooth integration of new data sources. Your work will be instrumental in ensuring that our users can confidently compare prices with accurate and complete product information.

SALARY

πŸ’΅ B2B: 20 000 - 30 000 PLN netto

Responsibilities

Primary Role: Develop and maintain prompt-engineering scripts and semi-automatic flagging/review systems to clean, validate, and standardize metadata for various product fields.

Prompt Engineering & Scripts

  • Create and optimize prompts/scripts to automatically clean, categorize, and tag product metadata.
  • Improve existing scripts for product types, sizes, tags, brands, and other metadata fields.

Data Cleanup & Standardization

  • Write scripts to handle data cleanup for brands, prices, sizes, and availability.
  • Convert size values to numerical representations based on product type-specific rules.

Manual Review System

  • Develop systems for manual review of flagged items in the data warehouse (DW).
  • Build review mechanisms for user-flagged issues and those identified by automated systems.

Data Integration & Deduplication

  • Ensure proper merging of products by identifying and consolidating duplicates using UPCs and metadata.

Product Grouping

  • Create scripts for identifying and grouping similar products based on size, color, scent, etc.

Skills & Qualifications

βœ… 3+ years of experience as a Data Engineer or in a similar role.

βœ… Strong proficiency in Python (Mid/Senior level), R (Mid/Senior level), and experience with Java is a plus.

βœ… Experience with NLP techniques, especially in prompt engineering for data automation.

βœ… Proficient in designing and optimizing ETL pipelines and working with cloud data warehouses (e.g., Snowflake, BigQuery, Redshift).

βœ… Familiarity with product metadata structures and experience working with large datasets in a commercial environment.

βœ… Excellent problem-solving skills and attention to detail, especially in data validation and error handling.

βœ… Strong communication skills to work effectively with cross-functional teams, including QA, backend developers, and product managers (English and Polish B2 + is a must).

βœ… Experience with APIs, data integration, and handling multiple data sources.

Benefits

βœ… 25 days of paid leave for B2B or contract services;

βœ… Flexible working hours, with the option to work remotely or from the office;

βœ… Private healthcare (Luxmed);

βœ… Subsidy for insurance (Warta);

βœ… MPCharity: a program where you can propose initiatives that you would like to support.

About Us

We are a Katowice-based IT company with over 100 people on boardβ€”and one dog. We have greatly diversified our operations, and despite the pandemic, we’ve experienced the most growth in the past few years. Our work focuses on our own product, getzendo.io, collaboration with a client from the United States, and a software house division (providing IT services to external companies).

RECRUITMENT PROCESS

Step 1: A 45-minute interview with an HR representative (you will receive information about the project, and we will ask a few basic questions);

Step 2: Technical Interview (about 1-1.5h)

Step 3: Final interview with Product Owner (1h)

Required profile

Experience

Level of experience: Mid-level (2-5 years)
Industry :
Information Technology & Services
Spoken language(s):
EnglishEnglishPolish
Check out the description to know which languages are mandatory.

Other Skills

  • Verbal Communication Skills
  • Detail Oriented
  • Problem Solving

Data Engineer Related jobs