Platform admin/engineer experience with big data technologies such as Spark, Object Storage (Dell ECS preferred), and metadata management.
Strong SQL database and data warehouse experience, including SQL workloads, performance optimization, and database internals.
Understanding of distributed file formats and data transformation methods (Iceberg, Delta, Parquet).
Scripting (Python) and DevOps tooling knowledge (Git, GitLab, Splunk, Ansible) with familiarity with cloud providers (Azure preferred).
Requirements:
Collaborate with the technical team and Product Manager to identify, document, plan contingencies, and track/manage risks and issues until resolution.
Demonstrate strong problem-solving and root-cause analysis while driving optimization and efficiency.
Maintain incident, change, and problem management processes: detect service-impacting issues, perform triage, communicate with stakeholders, contain impact, restore service, and conduct post-incident follow-up.
Support automation and scripting (e.g., Python) to improve platform reliability and efficiency.
Job description
Job Title - Data Engineer _ Lakehouse Platform Location - Remote Duration - 12 Plus Months Rate - DOE U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time.
Job Description
Knowledge and understanding of diverse data platforms and operating systems, including current and emerging technologies.
Having Strong Platform engineer(Admin) experience working with big data technologies, such as Spark, Object Storage ( Dell ECS preferred), Metadata, or related technologies.
Having Strong Platform engineer(Admin) experience with SQL database systems and database technologies such as MPP/Data Warehouse Database, SQL workloads, SQL and DB optimization, DB internals
Understanding of various distributed file and table formats such as Iceberg, Delta, Apache Parquet, and common methods in data transformation
Understanding of hardware systems performance: CPU, RAM, storage, network, Linux, JVM, distributed systems performance.
Experience using DevOps-related tools like GIT, Gitlab, Splunk, and Ansible.
Knowledge of one or more major Cloud Service Providers MS Azure preferred.
Collaborate with the technical team and PdM to identify, document, plan contingency, track and manage risks and issues until all are resolved.
Proven strengths in problem-solving and root-causing issues while continuously seeking ways to drive optimization, efficiency, and the bottom line.
Clear understanding of Incident management, change management and problem management process. Ability to detect all service-impacting issues, accurate triage, partner communication, impact containment, service restoration, and post-incident follow-up.
