Match score not available

Unlock Premium Benefits Today!
🚀 Elevate your career with priority access.
Stand out to top recruiters with Jobgether Priority Access:
  • ✅ Top Match: We help you identify job offers where you're a perfect fit.
  • ✅ Exclusive Referral Service: Connect directly with recruiters as a Jobgether Certified Premium User.
  • ✅ Personalized Feedback: Receive feedback and expert guidance on applications, and have your profile manually reviewed.

Start Your Free Trial Now!

Start my free trial

Lead Data Engineer(8+ Years of Exp)

extra holidays - fully flexible
Remote: 
Full Remote
Contract: 
Full time
Experience: 
Senior (5-10 years)
Work from: 
India

Offer summary

Qualifications:

7+ years of experience in data engineering, Advanced SQL and relational database design skills, Strong Python skills and experience with data libraries, Experience with cloud Data Warehouse solutions.

Key responsabilities:

  • Architect robust data platforms on multiple cloud technologies
  • Develop ETL/ELT processes for data extraction and manipulation
3Pillar logo
3Pillar Large http://www.3PillarGlobal.com/
1001 - 5000 Employees
About 3Pillar
3Pillar Global builds breakthrough software products that power digital businesses. 3Pillar is an innovative product development partner whose solutions drive rapid revenue, market share, and customer growth for industry leaders in Software and SaaS, Media and Publishing and Information Services. Leveraging a lean and agile approach, 3Pillar delivers value-generating, digital solutions with specialized product strategy and management, user experience design, as well as software and data engineering expertise across mobile, cloud, and disruptive technologies. For more information on the company and our services, please visit https://www.3pillarglobal.com. For current job openings in North America, APAC, LATAM and EMEA, please visit https://www.3pillarglobal.com/career-opportunities/.
See more 3Pillar offers

Job description

At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Lead, Data Engineering, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.

Key Responsibilities
  • Understanding the client requirement and architect robust data platforms on multiple cloud technologies.
  • Take the lead on creating, defining and driving the data engineering solutions for complex client engagements
  • Develop ETL/ELT processes to help extract and manipulate data from multiple sources.
  • Work with the leadership to set the standards for software engineering practices within the data engineering team
  • Maintain and optimize the data infrastructure required for accurate extraction, transformation, and loading of data from a wide variety of data sources.
  • Monitor data systems performance and implement optimization strategies.
  • Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
  • Partner with data scientists and functional leaders in sales, marketing, and product to deploy machine learning models in production.
  • Choose and use the right analytical libraries, programming languages, and frameworks for each task.
  • Lead data engineering team.

    • Minimum Qualifications
  • Demonstrated expertise with a minimum of 7+ years of experience in data engineering domain
  • Advanced SQL skills and experience with relational databases and database design.
  • Experience with data modeling
  • Experience working with cloud Data Warehouse solutions (e.g., Snowflake, Redshift, BigQuery, Azure Synapse, etc.).
  • Strong Python skills with hands-on experience on Pandas, NumPy and other data related libraries
  • Experience with working on large data sets and distributed computing (e.g. Hive/Hadoop/Spark/Presto/MapReduce). ​​
  • In depth knowledge and understanding of data streaming tools like Apache Kafka, AWS Kinesis.
  • Proficient in data pipeline and workflow management tools e.g. Airflow, AWS Step functions etc
  • Experience with data visualization tools like PowerBI, Tableau, AWs Quicksight etc
  • Experience with the AWS/Azure/GCP data engineering services
  • Knowledge of AWS services viz., EC2, EMR, S3, Lambda, EBS, IAM, Redshift, RDS, GLUE ETL
  • OR
  • Knowledge of Azure services viz., ADF, Databricks, Azure Synapse Analytics, ADLS Gen2, Azure Devops
  • Good understanding of NoSQL databases like Redis, Cassandra, MongoDB, or Neo4j.
  • Excellent problem-solving, communication, and organizational skills.
  • Proven ability to manage a highly skilled data engineering team.

    • Required profile

    Experience

    Level of experience: Senior (5-10 years)
    Industry :
    Spoken language(s):
    English
    Check out the description to know which languages are mandatory.

    Hard Skills

    Data EngineeringPython (Programming Language)SQL (Programming Language)Cloud DatabaseData ModelingData VisualizationData StreamingDistributed ComputingNoSQLData Pipeline ManagementAmazon Web ServicesETL (Extract Transform Load)Azure Cloud ServicesAWS KinesisMachine LearningTableau (Business Intelligence Software)Power BIData MiningAmazon QuickSightApache AirflowApache Kafka

    Other Skills

    • Communication
    • Problem Solving
    • Organizational Skills
    Are you interested?

    Data Engineer Related jobs

    See more Data Engineer jobs
    Sign in or sign up with Google or LinkedIn