Offer summary

Qualifications:

Bachelor's degree in Computer Science, Data Science, or related field., At least 3 years of experience with Python and PySpark for data transformation., Strong knowledge of Google Cloud Platform services such as BigQuery, GCS, and Pub/Sub., Experience with real-time data ingestion and API integration..

Key responsibilities:

Design and develop data pipelines using ETL and data modeling techniques.

Manage and orchestrate workflows with Airflow and Kubernetes.

Implement real-time data ingestion and processing solutions.

Collaborate with domain experts to ensure data quality and reliability.

Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Founded in 2014 as a digitally native full-service digital transformation services and consulting firm, we apply our expertise in customer experience transformation, data analytics, Artificial Intelligence (AI), platform and product engineering, cloud infrastructure, and security to help clients quickly innovate for growth, create digital products, build service platforms, and drive smarter, data-driven performance. Headquartered in Edison, New Jersey, we are powered by a diverse global team of world-class professionals across the U.S., the UK, Romania, Canada, Mexico and India, and are certified a Great Place to Work®. We help clients harness the transformative potential of the four superpowers of technology: cloud computing, Internet of Things (IoT), AI, and mobility. We bring deep expertise across the full spectrum of digital capabilities: • Accelerating customer experience transformation to drive growth, customer advocacy, and superior customer experience • Powering intelligent enterprises by harnessing the potential of data, analytics, and AI • Crafting products of relevance with a product mindset and high-performance engineering • Enabling enterprise agility with resilient cloud infrastructure and security To learn more, please visit https://www.brillio.com/ and follow us here or @brillioglobal.

Job description

Senior Data Specialist

Primary Skills
ETL Fundamentals, SQL, BigQuery, Dataproc, SQL (Basic + Advanced), Python, Data Catalog, Data Warehousing, Composer, Dataflow, Cloud Trace, Cloud Logging, Cloud Storage, Datafusion, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, TSQL, Stored Procedures

Job requirements
Azure Data Engineer

Strong with PySpark (esp. Spark SQL) for complex transformation pipelines
Handson with Airflow for orchestration and BigQuery SQL for querying and data modeling
Good experience in GCP (BigQuery, GCS, PubSub, Cloud Run, Functions,Cloud SQL)
Comfortable with realtime ingestion: Kafka, webhooks, filebased triggers
Solid API integration skills (RESTwebhooks), with ability to handle payloaddriven workflows
Experience working in Kubernetes (GKE) for deploying and scaling pipelines
Comfortable handling UIdriven configuration, YAMLbased setups, and modular frameworks
Exposure to schema transformation, data validation, hashing, and DQF logic
Domain familiarity with logisticshealthcare (CVS context is a big plus)
Strong ownership mindset — able to work under pressure and balance speed with reliability
Basic understanding of BASH, SFTP transfers, Networking, Access Management
Bonus: PostgreSQL, CICD, monitoring, dashboarding, or lightweight UI development
=================================
Python & PySpark (Spark SQL) – 3+ years
Airflow (or any orchestration tool) – 2+ years
Google Cloud Platform (BigQuery, GCS, PubSub, Cloud Run, Functions, Cloud SQL) – 3+ years
Realtime data ingestion (Kafka, webhooks, filebased) – 2+ years
API integration (RESTwebhooks) – 2+ years
Kubernetes (GKE preferred) – 1–2 years
BigQuery SQL & PostgreSQL – 2+ years
YAMLconfigdriven pipeline design – 2+ years
Schema transformation, hashing, DQF – 2+ years
CICD, observability, lightweight dashboards (GrafanaStreamlitFlask UI) – 1+ year
Logistics or healthcare domain exposure – nice to have

Know more about:DAI: https:www.brillio.comservicesdataanalytics Know what it’s like to work and grow at Brillio: https:www.brillio.comjoinus

Equal Employment Opportunity Declaration
Brillio is an equal opportunity employer to all, regardless of age, ancestry, colour, disability (mental and physical), exercising the right to family care and medical leave, gender, gender expression, gender identity, genetic information, marital status, medical condition, military or veteran status, national origin, political affiliation, race, religious creed, sex (includes pregnancy, childbirth, breastfeeding, and related medical conditions), and sexual orientation.

#LISR1

Senior Data Specialist R01553679

Offer summary

Qualifications:

Key responsibilities:

Job description

Required profile

Experience

Hard Skills

Other Skills

Data Analyst Related jobs

Data Analyst II Healthcare Analytics

Senior Digital Analyst

Program Analyst

Mid Level Data Analyst

Data Analyst III Healthcare Analytics