Big Data Engineer

Role: Big Data Engineer (AWS) – Lead Consultant

Location: India

Asian Shift: 7 AM to 4 PM.

About Lingaro:

Lingaro Group is the end-to-end data services partner to global brands and enterprises. We lead our clients through their data journey, from strategy through development to operations and adoption, helping them to realize the full value of their data.

Since 2008, Lingaro has been recognized by clients and global research and advisory firms for innovation, technology excellence, and the consistent delivery of highest-quality data services. Our commitment to data excellence has created an environment that attracts the brightest global data talent to our team.

Website:

https://lingarogroup.com/

Requirements:

• Bachelor’s degree or equivalent in Computer Science, Software Engineering, Information Systems, or related field.
• Good written and verbal communication skills (English)
• 6-10+ years of working experience in building and supporting big data solutions
• Strong experience in design, develop/coding, Implement and delivering robust and sustainable both streaming and batch big data solutions built on (AWS) cloud
• Strong experience in Data Storage and Data Lakes: Amazon S3, AWS Lake Formation, Amazon Glacier and Glacier Deep drive.
• Strong experience in Data Processing and ETL: AWS Glue, AWS Lambda, AWS step function.
• Strong experience in Big Data Processing and Analytics: Amazon Athena, Amazon RedShift and RedShift Spectrum, AWS Data Pipeline.
• Strong experience in Databases: Amazon RDS. No SQL.Strong experience in Data Security and Governance: AWS Identity and Access Management (IAM), AWS Key Management Service (KMS), Amazon Macie, AWS CloudTrail.
• Strong experience in Monitoring and Optimization: Amazon CloudWatch, AWS Cost Explorer and Trusted Advisor, AWS Config.
• Strong experience in Data Integration and Workflow Orchestration: Amazon EventBridge, AWS Data Migration Service (DMS), AWS Batch.
• Strong knowledge of Data Warehouse concepts and Schema modeling
• Strong technical expertise with SQL and NoSQL databases and data mapping, as well as ETL tools (AWS cloud native tool preferred)
• Strong coding skills in Python, PySpark, Apache Spark, Glue PySpark, SQL, JSON, HDFS
• Strong troubleshooting skills of big data platforms and data intensive workload (strong SQL query building skills)
• Background in DataOps.

• GOOD TO HAVE: knowledge of AWS technologies like API Gateway, SNS, AWS security, CloudFormation, node.js, serverless framework, AWS networking, Power-BI Data Visualization Tool. Experience in Azure or GCP as secondary cloud computing skill.
• ADVANTAGES: Bash Shell Scripting, DevOps / CICD GitHub, Git Actions, Agile.

Tasks: The Data Engineer’s role is expected to build a scalable platform to collect, enrich C activate data across multiple channels to deliver data driven marketing. The Data Engineer will collaborate with business and senior technology associates to define the requirements for the data C analytics projects and develop solutions that will enable marketers to efficiently build and use platforms C services that enable data ingestion, enrichment, and activation.

• Play a key role in collecting, transforming, curating, and serving data via big data solutions
• Deliver actionable insights via reporting tools
• Work on a reusable and scalable promotion platform with other team members
• Work with marketers, data/business analysts to understand marketing challenges, business questions, processes etc.
• Using Agile and Dev/Ops methods, build solutions utilizing technologies including AWS, Power BI C Adobe suite (AEP C ecosystem).
• articipate in cross-functional teams to promote technology strategies, analyze, test products, perform proofs-of-concept, and pilot new technologies and/or methods.
• Establish and document standards, guidelines, and best practices for teams utilizing the solutions.
• Keep current on industry best practices and products that can be leveraged to support the company’s business objectives

Why join us:

• Stable employment. On the market since 2008, 1300+ talents currently on board in 7 global sites.
• 100% remote.
• Flexibility regarding working hours.
• Full-time position
• Comprehensive online onboarding program with a “Buddy” from day 1.
• Cooperation with top-tier engineers and experts.
• Unlimited access to the Udemy learning platform from day 1.
• Certificate training programs. Lingarians earn 500+ technology certificates yearly.
• Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
• Grow as we grow as a company. 76% of our managers are internal promotions.
• A diverse, inclusive, and values-driven community.
• Autonomy to choose the way you work. We trust your ideas.
• Create our community together. Refer your friends to receive bonuses.
• Activities to support your well-being and health.
• Plenty of opportunities to donate to charities and support the environment.