We are looking for a hands-on Senior Software Engineer to join an Integration Engineering team and deliver file transfer integrations on an in-house managed file transfer platform. The platform is built on Azure Logic Apps, Azure Data Factory and Terraform, with AWS services for cross-cloud transfers and provides approved, reusable patterns for moving files between internal systems, cloud storage and external partners. The first assignment is an Apache Hive to Databricks migration, which requires a number of new interfaces built quickly on the platform, following its established patterns. We need someone who can start fast and deliver independently. Responsibilities Lead discovery and design conversations with business and technical stakeholders to define file transfer requirements: source and destination, frequency, file sizes and security needs Design each file transfer solution by selecting and applying the right platform pattern (e.g., SFTP to Blob, Blob to SFTP, S3 to Blob, Azure File Share), and extend the platform with new patterns where needed Build and deploy reusable, configurable workflows using Azure Logic Apps, Data Factory, Storage Accounts, Key Vault and Azure Monitor, plus AWS S3 and Transfer Family where needed Develop migration interfaces that integrate with Databricks as the target and with Hive sources where needed Define and deploy infrastructure and workflow configuration as code using Terraform Create and maintain automated tests (functional, connectivity, regression), troubleshoot and monitor workflows, and fix issues quickly Deliver secure-by-default integrations using managed identities, secrets in Key Vault, SSH key authentication, PGP encryption where required, and monitoring and alerting Define integration standards, documentation and templates, and document the interfaces and workflows built Collaborate with the delivery team, BAs and PMs to clarify requirements, support functional and UAT testing, and keep delivery on schedule Contribute to and reuse shared platform capabilities (InnerSource), favouring standard solutions over one-off builds Requirements 3+ years of hands-on experience in software engineering with a focus on cloud integrations Expertise in Azure Logic Apps (Consumption and/or Standard: triggers, connectors, error handling, expressions), Azure Data Factory and Storage Accounts (Blob and File Shares) Proficiency in Key Vault and Azure Monitor, including monitoring and alerting with KQL Strong knowledge of file transfer protocols and patterns: SFTP, SMB and cloud storage transfers Working knowledge of AWS S3 and AWS Transfer Family Hands-on Terraform skills on Azure (modules, state management, CI/CD deployment) Background in secure file transfer using managed identities, Key Vault secrets, SSH keys and PGP Familiarity with automated testing for file transfer workflows, Git and CI/CD (Azure DevOps or GitHub Actions) Showcase of designing scalable, templated, configuration-driven integration patterns Experience leading discovery and design with business and technical stakeholders across multiple systems or projects Capability to work independently, ramp up quickly and move between projects as priorities shift, with strong ownership and clear communication Comfortable working under tight deadlines as a proactive, clear communicator with stakeholders English proficiency at an Upper-Intermediate level (B2) or higher Nice to have Databricks exposure (jobs, workflows, REST APIs, Unity Catalog) Understanding of Apache Hive / Hadoop and data migration projects Familiarity with Azure Functions, Service Bus, and Event Grid Experience with Agile delivery
