Bachelor's degree in Computer Science, Information Technology, or related field.
Proficiency in Data Engineering, Warehousing, and ETL processes.
Experience with Spark or similar big data ETL tools.
Understanding of data quality and job optimization, especially with streaming data.
Requirements:
Compare data between two warehouses and generate data QC reports.
Utilize big data ETL tools like Spark to process and optimize data jobs.
Ensure data quality and accuracy in warehouse data.
Collaborate with team to improve data processing workflows.
Job description
Coders Brain is a global leader in its services, digital, and business solutions that partners with its clients to simplify, strengthen, and transform their businesses. We ensure the highest levels of certainty and satisfaction through a deepset commitment to our clients, comprehensive industry expertise, and a global network of innovation and delivery centers.
Location: Remote (Work From Home)
Position: Permanent with Coders Brain Technology Pvt. Ltd.
Notice Period: Immediate.
Experience 3 + Yrs
Skill Data Engineering, Warehousing, ETL,Spark
JD For Junior Data engineer :
Responsible for comparing two warehouse data, generating data QC reports.
Good to have : Apache Spark or equivalent big data ETL tools, data quality jobs and optimisation of jobs with streaming data.
