Senior Data Engineer

Scope of Services:

• The Data Engineer(s) will be required on a full-time basis, working across two (2) to three (3) projects. Time, location and frequency of work will vary depending on the needs of the project. At the end of each term, it is expected that the Data Engineer(s) may work a maximum of 1,960 hours, unless otherwise agreed upon with the province. However, Data Engineer(s) may be required to work fewer or more hours depending on the nature and needs of their work, as directed by the province.
• Services and project deliverables should evolve as the work progresses in response to emerging user and business needs, as well as evolving design and technical opportunities. However, the following deliverables must be delivered iteratively throughout the course of the project:
• Data Engineering:
• Design, build, and maintain scalable data pipelines across on-premises and cloud platforms (Azure, Databricks, Microsoft Fabric, GCP, AWS) to ingest, transform, and store diverse datasets in support of enterprise business use cases.
• Develop, optimize, and maintain data models, including dimensional models (star and snowflake schemas), to improve query performance, scalability, and usability for analytics and reporting.
• Integrate data from a variety of sources, including relational databases, NoSQL platforms, APIs, and files, applying AI-enabled data integration techniques such as intelligent data mapping, schema discovery, metadata enrichment, and automated data quality validation to improve accuracy and efficiency.
• Enhance ETL/ELT processes through optimization, automation, and performance tuning to improve scalability, reduce bottlenecks, and support high-volume data processing.
• Develop and operate end-to-end ETL/ELT workflows using tools such as SSIS, Azure/Fabric Data Factory, Dataflows, and Notebooks, incorporating data validation, error handling, logging, monitoring, and scheduling to ensure reliable data operations.
• Automate data pipeline deployment and operations through CI/CD practices, including automated testing, release management, and monitoring to enable faster and more reliable delivery.
• Support the management and governance of enterprise data platforms, including data lakes, data warehouses, security controls, and access management.
• Partner with architects, developers, and stakeholders to translate requirements into solutions, and prepare curated data marts and fact/dimension tables to support analytics.
• Data Analytics:
• Analyze datasets to identify trends, patterns, and anomalies. Use statistical methods, DAX, Python, and R to generate insights that inform business strategies.
• Develop interactive Power BI dashboards and reports, leveraging DAX to create calculated columns and measures, monitor key performance indicators, deliver service dashboards, and communicate results effectively to stakeholders.
• Build predictive or descriptive models using statistical, Python, or R-based machine learning methods. Design and integrate data models to improve service delivery.
• Present findings to non-technical audiences in clear, actionable terms. Translate complex data into business-focused insights and recommendations.
• Deliver analytics solutions iteratively in an Agile environment. Mentor teams to enhance analytics fluency and support self-service capabilities.
• Provide data-driven analysis, visualizations, and AI-enabled insights to support corporate priorities, strategic initiatives, and informed decision-making.
• The province and the Contractor shall determine changes to Services and Materials as required. The province and the Contractor will determine changes to Services and Materials through the Artifacts.

• The resource will primarily work remotely but must be available for on-site meetings as required.
• Meetings may occur up to 3–4 times (or more) per fiscal month, but the actual frequency will depend on the specific initiative and will be determined on an on-demand basis.
• Meetings will take place in Edmonton, Alberta