Offer summary

Qualifications:

At least 2 years of professional development experience, preferably in consulting., Over 1 year of experience working with Databricks., Proficiency in writing complex SQL queries for data manipulation., Experience with ETL/ELT patterns, Spark, Kafka, Hadoop, and data visualization tools..

Key responsibilities:

Support data projects through requirements gathering, pipeline development, and testing.

Configure data enrichments, quality rules, and connect to new data sources.

Troubleshoot data pipelines and ensure data accuracy for reporting and dashboards.

Collaborate with clients and internal teams to gather requirements and develop solutions.

Job description

We are seeking a talented Data Engineer to join our Data Engineering & Analytics team. In this role, you will collaborate with our clients to address their most complex needs, working alongside a team of highly skilled engineers and architects. You will also be involved in strategic enterprise data projects and largescale implementations.

Responsibilities:

· Support projects leveraging an agile delivery model through requirements gathering and documentation, data ingestion pipeline development, and technical testing.

· Contribute to project delivery in the following ways:

· Add configurations for data enrichments such as lookups, type conversions, calculations, and concatenations

· Add data quality rules

· Connect to new data sources

· Map multiple sources into a single output

· Interpret error messages to troubleshoot data pipelines

· Create outputs that facilitate reporting, dashboarding, and semantic modeling for tools such as Tableau and Power BI

· Test data pipelines to ensure accuracy

· Work closely with our clients as part of the development team to gather technical requirements and develop solutions

· Coordinate activities with data source application owners to understand the underlying data, ensure integration and data integrity

· Build relationships with clients through written and verbal communication

Qualifications:

· 2+ years of handson professional development experience, consulting experience preferred.

· 1+ years of experience working with Databricks

· Experience writing complex SQL queries related to data manipulation strategies

· Experience building or working with metadatadriven ETL ELT patterns and concepts.

· Experience with Spark, Databricks, Kafka, Kinesis, Hadoop, andor Lambda.

· Exposure using ETL tools (Azure Data Factory, AWS Glue, Informatica, Talend, IBM DataStage, etc.), database platforms (Snowflake, Redshift, Azure Synapse, or Oracle), and data visualization tools (Tableau, Power BI, Looker).

· Experience in technical testing, issue identification and resolution

· Strong verbal and written communication skills

Required profile