Data Engineer

About Hubtel

Hubtel is a tech company on a mission to drive Africa forward by enabling everyone to find and pay for everyday essentials. Our vision is to be Africa's most useful company, building a platform that everyone can find, pay, and easily partake in the digital economy.

Key Expectations:  

• In this job, you will execute the following activities;  
• Develop, test, and maintain data pipelines.  
• Collect and integrate data from various sources.  
• Manage and design data warehouses and other storage solutions. 
• Implement ETL (extract, transform, load) processes. 
• Optimize data retrieval to develop dashboards for data visualization. 
• Prepare data for predictive and prescriptive modeling. 
• Automating manual data-related processes, optimizing data delivery, and re-designing data infrastructure for greater scalability. 
• Documenting data pipelines and architectures. 

• Your success and performance as a data engineer will be evaluated by your effectiveness at:  
• Constructing and maintaining robust, scalable data pipelines.  
• Successfully integrating new data sources into existing data systems. 
• Consistently ensuring high data quality and accuracy. 

• Implementing and maintaining effective data validation and error-checking processes. 
• Improving data processing speed and efficiency. 
• Regular optimization of ETL processes and data storage solutions. 
• Collaborating with data scientists, analysts, and other stakeholders. 
• Adherence to data governance, privacy policies, and legal compliance. 
• Contributing to the organization's goals through effective data management. 
    
• In this role, you will work with:  
• Product Managers, Infrastructure Engineers and others to build new data collection pipelines and identify performance issues, fix and improve existing ones.  
• Quality Assurance Engineers to ensure the reliability and accuracy of data pipelines and storage systems. 
• Information Security personnels to ensure data privacy 
• Machine Learning Engineers and stakeholders to understand predictive and prescriptive business requirements and translate them into data architecture. 
• External Vendors and Partners to manage integrations and data exchanges with external systems. 
    
• You will be supported with:  
• State-of-the-art working environment.  
• Additional weekly allowances for lunch.  
• Access to satellite offices across the country.  
• Work-from-home privileges.  
• Health insurance with options to add immediate family members.  

Must have: 

• Expertise in SQL and experience with relational databases like PostgreSQL 
• Working knowledge of MongoDB, Elasticsearch and caching systems like Redis.   
• Experience with data warehousing technologies like Amazon Redshift or Google BigQuery, Snowflake, or Microsoft Azure SQL Data Warehouse. 
• Familiarity with event streaming platforms like Kafka.  
• Proficiency in ETL (Extract, Transform, Load) tools such as AWS Glue. Working knowledge of Apache Nifi is a plus 
• Familiarity with data visualization tools like Tableau, Power BI, or Looker can be beneficial. 

Good to have: 

• A bachelor’s or master’s degree in Computer Science, Information Technology, Engineering, or a related field is often preferred. 
• Basic project management skills to manage tasks, timelines, and deliverables efficiently in an Agile environment.