Strong hands-on experience in designing secure, scalable data architectures (data lakes, data warehouses, data hubs) and event-driven architectures
Expertise in designing and implementing ETL/data integration pipelines using Python/Java/Scala
Proficiency with cloud data platforms and services (AWS/Azure/GCP) and experience with Databricks and/or Snowflake
Solid data modeling, data governance, data quality, and knowledge of data privacy regulations (GDPR, HIPAA)
Requirements:
Translate business requirements into data requests, reports and dashboards
Design and implement end-to-end data architectures and automated data pipelines, including tools and technologies for data collection, cleansing, enrichment, and visualization
Coordinate with data scientists, analysts, and stakeholders; mentor junior team members and contribute to practice growth and data offerings
Ensure data security, privacy, governance, performance, reliability, and maintain documentation including data flow diagrams
Job description
Data Architect
Embark on an exciting journey into the realm of data engineering and architecture with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure. As a Data Architect you will be at the heart of the organization and support our clients to take control of their data and get value out of it by defining a reference architecture for our customers. This means that you will work closely with business leaders and information management teams to define and implement a roadmap on data architecture, data management, business intelligence or analytics solutions..If your passion for data analytics solutions that make a real-world impact, consider this your pass to the captivating world of Data Engineering! 🌍🔥
Requirements
Assessments of existing data components, Performing POCs, Consulting to the stakeholders
Proposing end to end solutions to an enterprise's data specific business problems, and taking care of data collection, extraction, integration, cleansing, enriching and data visualization
Ability to design large data platforms to enable Data Engineers, Analysts & scientistsStrong exposure to different Data architectures, data lake & data warehouse
Define tools & technologies to develop automated data pipelines, write ETL processes, develop dashboard & report and create insights
Continually reassess current state for alignment with architecture goals, best practices and business needsDB modeling, deciding best data storage, creating data flow diagrams, maintaining related documentation
Taking care of performance, reliability, reusability, resilience, scalability, security, privacy & data governance while designing a data architecture
Apply or recommend best practices in architecture, coding, API integration, CI/CD pipelines
Coordinate with data scientists, analysts, and other stakeholders for data-related needs
Help the Practice grow by mentoring junior Practice members, leading initiatives, leading Data OfferingsProvide thought leadership by representing the Practice / Organization on internal / external platforms
Responsibilities
Translate business requirements into data requests, reports and dashboards.
Strong Database & modeling concepts with exposure to SQL & NoSQL Databases
Strong data architecture patterns & principles, ability to design secure & scalable data lakes, data warehouse, data hubs, and other event-driven architectures
Expertise in designing and writing ETL processes in Python / Java / Scala
Understanding of Hadoop framework - Exposure to PySpark, Spark, Storm, HDFS, Hive
Strong hands-on experience with either Databricks or Snowflake; experience with both is desirable.
Knowledge of Master Data management and related tools
Strong exposure to data security and privacy regulations (GDPR, HIPAA) and best practices
Skilled in ensuring data accuracy, consistency, and quality
Experience with the AWS/Azure/GCP data engineering services
Knowledge of Azure services viz., ADF, Data Catalog, Databricks, Azure Synapse Analytics, ADLS Gen2, Azure Devops
Ability to implement data validation processes and establish data quality standards.
Experience in Linux
Proficiency in data visualization tools like Tableau, Power BI or similar to create meaningful insights
Desired
Experience working with data ingestion tools such as Fivetran, stitch, or Matillion
AWS IOT solutions
Apache NiFi, Talend, Informatica
Exposure to AI / ML technologies
BENEFITS
At 3Pillar, we offer a world of opportunity:
Imagine a flexible work environment – whether it's the office, your home, or a blend of both. From interviews to onboarding, we embody a remote-first approach.
You will be part of a global team, learning from top talent around the world and across cultures, speaking English everyday. Our global workforce enables our team to leverage global resources to accomplish our work in efficient and effective teams.
We’re big on your well-being – as a company, we spend a whole trimester in our annual cycle focused on wellbeing. Whether it is taking advantage of fitness offerings, mental health plans (country-dependent), or simply leveraging generous time off, we want all of our team members operating at their best.
Our professional services model enables us to accelerate career growth and development opportunities - across projects, offerings, and industries.
We are an equal opportunity employer. It goes without saying that we live by values like Intrinsic Dignity and Open Collaboration to create cutting-edge technology AND reinforce our commitment to diversity - globally and locally.
Join us and be a part of a global tech community! 🌍💼 Check out our Linkedin site and Careers page to learn more about what it’s like to be part of our #oneteam!
