Position/Designation to fill Kafka AWS Administrator
A) Skills Required
Essential Skills (Two top skills) Kafka, Elastic Search - DBA
B) Other Information
Educational
Qualifications
Graduate
Experience Mid-Level (5+ years)
Minimum Qualifications:
Design, develop, deploy, and maintain enterprise logging platform
using ELK and Kafka technologies.
Extensive experience with Apache Kafka or Confluent Kafka and AWS
MSK.
Manage large scale multi-nodes Kafka and ELK cluster environments
residing on AWS OpenSearch and On-premises.
Handle all Kafka environment builds and upgrades including design,
capacity planning, cluster setup, performance tuning, connectors, and
ongoing monitoring.
Perform high-level, day-to-day operational maintenance,support, and
upgrades for the Kafka and ELK clusters.
Day to day Kafka administration such as topic creation, altering topic
configurations, rebalancing partitions, and checking overall Kafka
cluster health.
Great exposure working to Kafka Connectors and bridges, this
includes the ability to set them up as well as support them.
Familiar with Confluent Control Center.
Experience working with encryption both in transit and at rest and
setting up SSL/TLS for Kafka and ELK.
Ability to setup Zookeeper and administrate the Zookeeper CLI.
Experience in setting up ELK Stack (Elasticsearch, Logstash, Kibana
stack) to process data from multiple data sources including Kafka and
IBM Frameworks
Contribute to design and architectural tradeoffsincluding Scalability,
Resiliency, High Availability and Security Perform capacity planning
and solution review related to Kafka and ELK environments.
Work with data log streaming platforms and tools to ingest data from
systems, applications, and access logs.
Investigate emerging Elastic advancements that relate to our
customer's needs and implement those upgrades.
Extensive experience with Elasticsearch index configuration options,
shards, aliases, etc.
Experience with Elastic API Integration.
Day to day ELK administration such as rebalancing, shard
maintenance, user creation, role creation and Kibana security.
Comfortable working with Unix/Linux based Operating System.
Capable of writing automation scripts in both Python and Bash Shell.
Design and develop monitoring solutions including the ability to work
with monitoring and alerting tools such as Grafana, Datadog and
Prometheus.
Process automation and new application on-boarding, integration
with CICD pipeline.
Fluent with CloudFormation or Terraform, preferably CloudFormation
as we are an AWS shop.
Big plus, previous experience with Docket and Kubernetes setup and
administration.
About Us
TCG Digital is the flagship data science and technology solutions company of ‘The Chatterjee Group’
(TCG), a multi-billion dollar global conglomerate. With ‘Velocity to Value’ as its mantra, TCG Digital
accelerates enterprise digital transformation by delivering rapid, measurable ROI through its state-of-
the-art advanced analytics platform – TCG MCube, and leads businesses to successful and sustainable
Why TCG?
At TCG Digital, you will work with most talented engineers, designers, and thought leaders to shape the
future Velocity to Value. We hail from over 6 countries, speak more than 15 languages, and apply an
incredible breadth and depth of experience to our work. Our roster also includes designers, math
geniuses, singers, stand-up comedians, white hat hackers, sponsored skateboarders, bluegrass
musicians, chefs, community activists, competing motorcyclists, and more.
Recognition
As a truly exceptional place to work, we continually win major industry recognition for our
company and work places
TCG Digital was ranked the “Dream Company to Work” in 2016 by 6th Asian HR Leadership
Awards
NASSCOM’s “Innovative Application of Analytics for Business Solution in 2015Most recently, we
were named “Most Innovative Partner in Business Intelligence” ITPV
