2024-7209_Data Engineer

AGSI was incorporated in April 2016. We are committed to supporting the goals of Arch divisions through exceptional service delivery. We pride ourselves on maintaining flexibility and responsiveness to adapt to business unit and industry demands while focusing on sound project management. We are dedicated to growing and developing our employees as we build strong teams with strategic leadership.

Strategic Analytics is a growing team at Arch. The team develops innovative predictive models and analytical tools to improve profitability and growth. This position will help support the data engineering needs across a growing portfolio of high-profile analytics projects by developing complex data structures and pipelines leveraging a diverse set of tools and languages. This includes the following cloud based technologies: Databricks, Snowflake, Spark, Python and Azure Data Factory. As a key member of the Strategic Analytics team, you will advance our data engineering capabilities helping the team analyze data faster. 

• Work closely with predictive modelers to assemble large, complex data sets that help solve business problems and increase profitability
• Perform data manipulation and transformation using SQL and Python
• Identify, design, and implement internal process improvements: automating manual processes and optimizing data pipelines
• Discover and explore new sources of data with curiosity and creativity
• Create and maintain optimal data pipeline architecture
• Author detailed and comprehensible documentation of data pipelines and technical solutions
• Ensure data quality and completeness

• TECHNICAL SKILLS          Proficiency Level          Required (R) /Optional (O)
  SQL                                                  4                                           R
  Relational SQL databases               3                                           R  
  Data integrations services (SSIS, Azure Data Factory, etc.)
                                                           2                                           R
  Microsoft Excel                                 3                                           R
  Python, Scala, C++, Java or similar
                                                            2                                           O
  Snowflake or other cloud-based data warehouse
                                                            3                                            O
  NoSQL databases / unstructured data
                                                            2                                            O
  Azure cloud services
                                                             1                                           O

• Bachelor’s degree in computer science, MIS or related field required