Solutions Architect - Databricks

What You’ll Be Working On:

At Lumenalta, we partner with enterprise clients to build cutting-edge digital products that interact with hundreds of millions of customers, transactions, and data points. As a Databricks Solutions Architect, you will be pivotal in designing and implementing scalable, high-performance solutions to tackle the most demanding data challenges in various industries. You will have the opportunity to drive end-to-end architecture and help our clients unlock the full potential of their data using Databricks and other modern cloud technologies.

We are looking for someone who can thrive in a fast-paced, collaborative environment, with experience in industries such as FinTech, Transportation, Insurance, Media, or other complex, multifactor environments

Key Responsibilities:

• Solutions Design: Architect end-to-end scalable data solutions using Databricks, Azure, AWS, and other cloud-based services to meet client requirements.
• Data Strategy & Architecture: Develop robust data architectures, implement ETL pipelines, and establish data governance frameworks to ensure data accuracy and consistency.
• Technical Leadership: Lead the design and implementation of data platforms, define best practices, and mentor team members to elevate technical competencies within the organization.
• Advanced Analytics & Machine Learning: Create pipelines and workflows to support advanced analytics and machine learning initiatives, utilizing Databricks and other cloud-based services.
• Collaboration & Client Engagement: Act as a trusted advisor, working closely with client stakeholders to understand business needs, present architectural solutions, and implement strategies that deliver high-impact results.
• Performance Optimization: Identify bottlenecks and recommend solutions to optimize data workflows and architecture for both cost and performance.
• Innovation & Experimentation: Champion using cutting-edge data technologies and methodologies to drive innovation and experimentation within client projects.

Qualifications & Experience:

• 7+ years of experience in a senior data engineering or solutions architect role, with a strong focus on Databricks, Azure, or AWS cloud ecosystems.
• Proven track record of designing and implementing data architectures that support large-scale data pipelines and analytics.
• Strong proficiency in Python, PySpark, and SQL for data processing and manipulation.
• Extensive experience in creating ETL pipelines from scratch, handling large datasets, and developing solutions that align with business goals.
• Hands-on experience with data warehousing concepts, data modeling, and building data marts.
• Industry experience in financial services, logistics, or other complex domains is highly desirable.
• Fluency in verbal and written English, with the ability to communicate complex technical concepts to non-technical stakeholders.
• Personality traits: Analytical, solution-oriented, proactive, team player, and continuously learning.