Experience building and optimizing data pipelines in a distributed environment
Deep knowledge of the Palantir Foundry platform, including its tools such as Workshop, Quiver, and Slate; proficiency in designing data workflows, visualizations, and user interfaces
Proficiency working in Linux environment and advanced knowledge of SQL, Python, and PySpark (4+ years)
Experience using version control and CI/CD tools such as Git/Bitbucket, Jenkins/CodeBuild, and CodePipeline
Requirements:
Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation
Collaborate with product and technology teams to design and validate the capabilities of the data platform
Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability
Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services
Job description
Foundry Data Engineer Duration: 12 Months Location: Oakland, CA (Remote)
Potential to convert to perm
Key things Python, Pyspark, Palantir Foundry Palantir Foundry experience a must.
Responsibilities
Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.
Collaborate with product and technology teams to design and validate the capabilities of the data platform
Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability
Provide technical support and usage guidance to the users of our platform’s services.
Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.
Qualifications
Experience building and optimizing data pipelines in a distributed environment
Experience supporting and working with cross-functional teams.
Deep knowledge of the Palantir Foundry platform, including its tools like Workshop, Quiver, and c Slate, which are used to design data workflows, build visualizations, and create user interfaces. · · Proficiency working in Linux environment· 4+ years of advanced working knowledge of SQL, Python, and PySpark
Knowledge on Palantir
Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline