Offer summary

Qualifications:

3-4 years of hands-on experience with ETL tools, preferably Talend., Strong SQL skills and experience with relational databases like SQL Server., Proficiency in Python, PySpark, and shell scripting for data processing., Understanding of data modeling, data formats, and big data technologies such as Spark and Kafka..

Key responsibilities:

Design and develop ETL processes using Talend, SQL, and Python.

Build and maintain data pipelines for batch, streaming, and IoT data on big data platforms.

Collaborate with team members to enhance enterprise data storage solutions.

Monitor and improve the performance and reliability of data processing jobs.

Job description

We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions.
With over 7,400 CI&Ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.

At CI&T, were growing fast and seeking a talented and motivated Senior Talend Data Engineer to join our team. In this role, you will primarily focus on developing largevolume information ingestion and transformation. This position is responsible for orchestrating data interfaces into (and out of) our Enterprise Data Warehouse using Talend, SQL, Python, Databricks, and other data engineering solutions.

Key Responsibilities

Design and develop ETL (Talend) SQL Pythonbased processes to perform complex data transformation processes.
Design, code, and test major data processing features, as well as work jointly with other team members to provide complex software enhancements for the enterprise data storage platforms (RDBMS and NoSQL platforms)
Build Data Integration solutions to handle batch streaming IoT data on ETL, BigData platforms.
Develop and deliver changes in the Enterprise Data Warehouse according to Data Warehousing best practices.
Utilize Databricks for data processing, including Delta Live Tables, PySpark, and Databricks Workflows, to build reliable and maintainable pipelines.
Gather requirements and construct documentation to aid in maintenance and code reuse in accordance with team processes and standards.
Design, code, and test major data processing features, as well as collaborate with other team members to provide complex software enhancements for enterprise data storage platforms.
Monitor scheduled jobs and improve the reliability of ongoing processing.
Monitor, measure, and enhance ways to improve system performance.
Ability to multitask deliverables and efficiently manage them.
Perform other duties as assigned.

Qualifications

Understanding and Handson experience with key technologies (SQL, ETL, Data modeling, data processing).
Development experience in a Big Data environment is a Plus; Spark, Kafka, and Message Queues.
34 yrs Handson experience with ETL tools (Talend preferred).
Strong SQL skills with Relational DBMS technology SQL Server is a plus.
Experience with shell scripting Python PySpark.
Good understanding and expertise in relational databases and data processing concepts.
Experience in handling multiple data formats (Delimited file, JSON, XML, etc).
Handson experience designing and implementing data ingestion techniques for realtime processes (IoT, eCommerce) is a plus.
Strong communication skills (oral and written).
Good analytical and problemsolving skills.
Knowledge of HR systems is a plus.
Candidate must be thorough and detailoriented.
Able to work on multiple priorities in a deadlinedriven environment.

Our benefits include:
Premium Healthcare
Meal voucher
Maternity and Parental leaves
Mobile services subsidy
Sick payLife insurance
CI&T University
Colombian Holidays
Paid Vacations
And many others.

Collaboration is our superpower, diversity unites us, and excellence is our standard.
We value diverse identities and life experiences, fostering a diverse, inclusive, and safe work environment. We encourage applications from diverse and underrepresented groups to our job positions.