Sr. Data Engineer (GC25001) at phData

Offer summary

Qualifications:

Bachelor's Degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field., At least five years of experience in data engineering, including shell scripting and data wrangling., Proficiency in Java, UNIX Shell Scripts, Python, and experience with HDFS and Sqoop., Experience with Hive scripts and Pyspark applications for data transformation..

Key responsabilities:

Design, develop, test, and implement Big Data technical solutions.

Lead the delivery of database systems and integrate data from various sources.

Drive solution architecture and deploy data pipelines and applications.

Develop data transformation code and execute automation strategies.

Job description

Join phData, a dynamic and innovative leader in the modern data stack. We partner with major cloud data platforms like Snowflake, AWS, Azure, GCP, Fivetran, Pinecone, Glean and dbt to deliver cutting-edge services and solutions. We're committed to helping global enterprises overcome their toughest data challenges.

phData is a remote-first global company with employees based in the United States, Latin America and India. We celebrate the culture of each of our team members and foster a community of technological curiosity, ownership and trust. Even though we're growing extremely fast, we maintain a casual, exciting work environment. We hire top performers and allow you the autonomy to deliver results.

5x Snowflake Partner of the Year (2020, 2021, 2022, 2023, 2024)
Fivetran, dbt, Atlation, Matillion Partner of the Year
#1 Partner in Snowflake Advanced Certifications
600+ Expert Cloud Certifications (Sigma, AWS, Azure, Dataiku, etc)
Recognized as an award-winning workplace in US, India and LATAM

JOB TITLE:
Sr. Data Engineer (GC25001)

POSITION DUTIES:
Design, develop, test, and implement Big Data technical solutions. Recommend the right
technologies and solutions for a given use case, from the application layer to infrastructure. Lead
the delivery of compiling and installing database systems, integrating data from a variety of data
sources (data warehouse, data marts) utilizing on-prem or cloud-based data structures. Drive
solution architecture and perform deployments of data pipelines and applications. Author DDL
and DML SQL spanning technical tacks. Develop data transformation code and highly complex
provisioning pipelines. Ingest data from relational databases. Execute automation strategy. Tools
and technologies used include: DDL, DML, HDFS, Hadoop, Spark, Kafka, Python, Pyspark,
UNIX shell, Java, Scala, Sqoop, Pipewrench, Streamsets, NiFi, Cloudera, AWS, Snowflakes,
Databricks, HDFS, Hive, YARN, HBAs, Solr, Impala, Kudu, and SQL. Position may include a
telecommuting benefit from anywhere in the United States. May require travel to unanticipated
client sites throughout the United States less than 10% of time.

REQUIREMENTS:
At least a Bachelors Degree or foreign equivalent in Computer Science, Computer Engineering,
Electrical and Electronics Engineering, or a closely related technical field, and at least five (5)
years of post-bachelor’s, progressive experience writing shell scripts; validating data; and
engaging in data wrangling. Experience must include at least three (3) years of experience
debugging data; transforming data into Microsoft SQL server; developing processes to import
data into HDFS using Sqoop; and using Java, UNIX Shell Scripts, and Python. Experience must
also include at least one (1) year of experience developing Hive scripts for data transformation
on data lake projects; converting Hive scripts to Pyspark applications; automating in Hadoop;
and implementing CI/CD pipelines. Position may include a telecommuting benefit from
anywhere in the United States. May require travel to unanticipated client sites throughout the
United States less than 10% of time.

Wage range $150,363.00-$180,870.00 per year. The company offers medical, health, dental and
life insurance; PTO and paid holidays.

LOCATION OF EMPLOYMENT:
400 South 4th Street, Suite 401, Minneapolis, MN 55415
APPLY TO:
Resumes To:
phData, Inc.
ATTN: HR [Job ID: GC25001]
P.O. Box 15051
Minneapolis, MN 55415
recruiting@phdata.io

#LI-DNI

phData celebrates diversity and is committed to creating an inclusive environment for all employees. Our approach helps us to build a winning team that represents a variety of backgrounds, perspectives, and abilities. So, regardless of how your diversity expresses itself, you can find a home here at phData. We are proud to be an equal opportunity employer. We prohibit discrimination and harassment of any kind based on race, color, religion, national origin, sex (including pregnancy), sexual orientation, gender identity, gender expression, age, veteran status, genetic information, disability, or other applicable legally protected characteristics. If you would like to request an accommodation due to a disability, please contact us at People Operations.

Required profile