Big Data Engineer

Role: Big Data Engineer (AWS) – Lead Consultant

Location: India

Asian Shift: 4:30 AM-1:30 PM IST

About Lingaro:

Lingaro Group is the end-to-end data services partner to global brands and enterprises. We lead our clients through their data journey, from strategy through development to operations and adoption, helping them to realize the full value of their data.

Since 2008, Lingaro has been recognized by clients and global research and advisory firms for innovation, technology excellence, and the consistent delivery of highest-quality data services. Our commitment to data excellence has created an environment that attracts the brightest global data talent to our team.

Website:

https://lingarogroup.com/

Requirements:

• Candidates need to work in Japan shift time, which is 8 AM to 5 PM (4:30 AM to 1:30 PM IST).
• 5+ years of working experience in building and supporting big data solutions.
• Strong developer experience in Open-Source Big Data technologies: Apache Spark, Hadoop, HDFS, HIVE or presto
• Strong coding skills in Python, PySpark, Pandas, Boto3, SQL, JSON.
• Strong developer experience in AWS Big Data technologies: S3, Redshift, Glue, Glue PySpark, Athena, EMR, Kinesis, Lambda.
• Strong experience in design, develop/coding, Implement and delivering robust and sustainable both streaming and batch big data solutions built on (AWS) cloud
• Strong knowledge of Data Warehouse concepts and Schema modeling
• Strong technical expertise with SQL and NoSQL databases and data mapping, as well as ETL tools (AWS cloud native tool preferred)
• Bachelor’s degree or equivalent in Computer Science, Software Engineering, Information Systems, or related field.
• Good written and verbal communication skills (English)
• Strong troubleshooting skills of big data platforms and data intensive workload (strong SQL query building skills)
• Background in DataOps
• GOOD TO HAVE: knowledge of AWS technologies like API Gateway, SNS, AWS security, CloudFormation, node.js, serverless framework, AWS networking, Power-BI Data Visualization Tool. Experience in Azure or GCP as secondary cloud computing skill.
• ADVANTAGES: Bash Shell Scripting, DevOps / CICD GitHub, Git Actions, Agile Information Sensitivity: General\Internal
• Candidate should be able to design, configure, and manage databases to ensure optimal performance and reliability.
• Experience with data integration tools and techniques, such as ETL and ELT Candidate should be able to integrate data from multiple sources and transform it into a format that is suitable for analysis.

Tasks: The Data Engineer’s role is expected to build a scalable platform to collect, enrich C activate data across multiple channels to deliver data driven marketing. The Data Engineer will collaborate with business and senior technology associates to define the requirements for the data C analytics projects and develop solutions that will enable marketers to efficiently build and use platforms C services that enable data ingestion, enrichment, and activation.

• Play a key role in collecting, transforming, curating, and serving data via big data solutions
• Deliver actionable insights via reporting tools
• Work on a reusable and scalable promotion platform with other team members
• Work with marketers, data/business analysts to understand marketing challenges, business questions, processes etc.
• Using Agile and Dev/Ops methods, build solutions utilizing technologies including AWS, Power BI C Adobe suite (AEP C ecosystem).
• articipate in cross-functional teams to promote technology strategies, analyze, test products, perform proofs-of-concept, and pilot new technologies and/or methods.
• Establish and document standards, guidelines, and best practices for teams utilizing the solutions.
• Keep current on industry best practices and products that can be leveraged to support the company’s business objectives

Why join us:

• Stable employment. On the market since 2008, 1300+ talents currently on board in 7 global sites.
• 100% remote.
• Flexibility regarding working hours.
• Full-time position
• Comprehensive online onboarding program with a “Buddy” from day 1.
• Cooperation with top-tier engineers and experts.
• Unlimited access to the Udemy learning platform from day 1.
• Certificate training programs. Lingarians earn 500+ technology certificates yearly.
• Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
• Grow as we grow as a company. 76% of our managers are internal promotions.
• A diverse, inclusive, and values-driven community.
• Autonomy to choose the way you work. We trust your ideas.
• Create our community together. Refer your friends to receive bonuses.
• Activities to support your well-being and health.
• Plenty of opportunities to donate to charities and support the environment.