Software Engineer (AWS & Big Data)

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money.

We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.

We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.

We are looking for an experienced Software Engineer with experience in AWS cloud services and Distributed Systems. You should have a foundation in software development and experience using cloud and Big Data platforms to build scalable and efficient solutions. You will be reporting to a Senior Manager. You will WFO 2 days a week from Hyderabad.

Responsibilities:

1. Collaborate with teams to understand requirements and design software solutions that use AWS cloud services and Big Data technologies.
2. Develop and maintain scalable and reliable software applications using programming languages such as Java, Python, or Scala.
3. Use AWS services including EC2, S3, Lambda, Athena, RDS, DynamoDB, EMR, and others to build cloud-native applications and microservices.
4. Design and develop data processing pipelines using Big Data frameworks like Hadoop, Spark, Kafka, Presto and Hive.
5. Implement monitoring, logging, and alerting solutions to ensure system reliability, availability, and performance.
6. Collaborate with DevOps teams to automate deployment processes and ensure smooth integration of software components.

• Bachelor's or Master's degree in Computer Science, Engineering, or related field

• Experience as a Software Engineer, with at least 2- 5 years of experience developing software applications.
• Proficiency in programming languages such as Java, Python, or Scala, and familiarity with software development methodologies and best practices
• Hands-on experience building Big Data applications with AWS cloud services and infrastructure, including compute, storage, networking, and security
• Develop custom operators and sensors to extend Airflow functionality and support specific use cases
• Develop Batch applications using Spark & Scala or PySpark

Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's people first approach is award-winning; World's Best Workplaces™ 2024 (Fortune Top 25), Great Place To Work™ in 24 countries, and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.

Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here