Data Engineer

Title: Data Engineer Terms: Long Term Contract Location: Atlanta area 100% REMOTE __Are you looking for a career opportunity that allows you to grow your career? If so, this opportunity will genuinely excite you! Our client is transforming how their organization services their customers while aligning best in breed technology solutions. We are looking for a Data Engineer who will help build out & develop best in class work and work on innovative projects for the business.

Role Details : - 6+ years of overall IT experience - 3+ years of experience with high-velocity high-volume stream processing: Apache Kafka and Spark Streaming - Experience with real-time data processing and streaming techniques using Spark structured streaming and Kafka. - Deep knowledge of troubleshooting and tuning Spark applications - 3+ years of experience with data ingestion from Message Queues (Tibco, IBM, etc.) and different file formats across different platforms like JSON, XML, CSV - 3+ years of experience with Big Data tools/technologies like Hadoop, Spark, Spark SQL, Kafka, Sqoop, Hive, S3, HDFS, or - 3+ years of experience building, testing, and optimizing ‘Big Data’ data ingestion pipelines, architectures, and data sets. - 2+ years of experience with Python (and/or Scala) and PySpark/Scala-Spark - 3+ years of experience with Cloud platforms e.g., AWS, GCP, etc. - 3+ years of experience with database solutions like Kudu/Impala, or Delta Lake or Snowflake or BigQuery - 2+ years of experience with NoSQL databases, including HBASE and/or Cassandra. - Experience in successfully building and deploying a new data platform on Azure/ AWS - Experience in Azure / AWS Serverless technologies, like, S3, Kinesis/MSK, lambda, and Glue - Strong knowledge of Messaging Platforms like Kafka, Amazon MSK & TIBCO EMS or IBM MQ Series - Experience with Databricks UI, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL, Delta Live Tables, Unity Catalog - Knowledge of Unix/Linux platform and shell scripting is necessary. - Strong analytical and critical thinking skills

• Preferred (Not Required): Strong SQL skills with ability to write intermediate complexity queries.
• Strong understanding of Relational & Dimensional modeling
• Experience with GIT code versioning software
• Experience with REST API and Web Services
• Good business analyst and requirements gathering/writing skills.

Education - bachelor’s degree required. Preferably in Information Systems, Computer Science, Computer Information Systems, or related field Good Communication Skills - Good Teamwork / Collaborator “Humble, Hungry, Knowledgeable”

About GSquared Group :Shouldn’t your recruiting partner put as much effort and value into your career as you do? With GSquared Group, we take the time to understand where you would like to take your career and what is important to you.

GSquared Group is a woman-owned boutique technology services company in the Atlanta area. Founded in 2010, we are a premier provider of IT talent search, management consulting, and software development services. We support a diverse client base that spans all industries and includes Fortune 100 to mid-market companies. We offer direct hire placement, contract, and contract-to-hire positions. We are proud to be known by our community for putting relationships at the core of everything we do.

• GSquared Benefits :Competitive & Comprehensive Healthcare Package (available only for W2 hourly consultants)
• Simple IRA with company match (available only for W2 hourly consultants)
• Professional development & networking opportunities
• A family-friendly environment
• Nice bonuses for referrals

• A culture that supports you and your career

• Hear what others are saying on Glassdoor: https://www.glassdoor.com/Reviews/GSquared-Group-Reviews-E651488.htm?filter.iso3Language=eng