Platform Engineer (DASP)

This is a remote position.

Role and Responsibilities:

A Platform Engineer in this role is responsible for designing, implementing, and maintaining the underlying infrastructure and platforms that support the organization's DASP (Data Analytics and Science Platform) solutions. This includes managing cloud-based data platforms for analytics and machine learning.

Key Responsibilities:

• Cloud Platform Management:
  
• Manage cloud-based platforms (AWS, Azure, GCP) for DASP solutions.
  
• Provision and configure cloud resources (VMs, storage, networking).
  
• Implement and manage cloud infrastructure automation using tools like Terraform.
  
• Data Platform Administration:
  
• Administer data platforms like Apache Hadoop, Apache Spark, or Databricks.
  
• Perform data ingestion, transformation, and storage tasks.
  
• Optimize data platform performance and query execution.
  
• Machine Learning Infrastructure:
  
• Manage infrastructure for machine learning workloads (e.g., GPU clusters, distributed computing).
  
• Support machine learning frameworks (TensorFlow, PyTorch, Keras).
  
• Data Governance:
  
• Implement data governance policies and standards.
  
• Ensure data quality and integrity.
  
• Security and Compliance:
  
• Ensure compliance with data security and privacy regulations.
  
• Implement security measures to protect data.
  
• Collaboration:
  
• Collaborate with data scientists, data engineers, and application developers to support their data needs.
  
• Work with other IT teams to ensure platform integration and compatibility.
  

Required Qualifications:

• Strong understanding of cloud platforms (AWS, Azure, GCP) and their services.
  
• Experience with data platforms (Hadoop, Spark, Databricks).
  
• Proficiency in data processing and analytics tools (SQL, Python, R).
  
• Knowledge of machine learning frameworks and algorithms.
  
• Experience with data governance and data quality.
  
• Strong problem-solving and troubleshooting skills.
  
• Excellent communication and interpersonal skills.