Match score not available

Unlock Premium Benefits Today!
🚀 Elevate your career with priority access.
Stand out to top recruiters with Jobgether Priority Access:
  • ✅ Top Match: We help you identify job offers where you're a perfect fit.
  • ✅ Exclusive Referral Service: Connect directly with recruiters as a Jobgether Certified Premium User.
  • ✅ Personalized Feedback: Receive feedback and expert guidance on applications, and have your profile manually reviewed.

Start Your Free Trial Now!

Start my free trial

Azure Data engineer

Remote: 
Full Remote
Experience: 
Senior (5-10 years)
Work from: 
United States

Resource Informatics Group, Inc logo
Resource Informatics Group, Inc SME https://www.rigusinc.com/
51 - 200 Employees
See all jobs

Job description

Position: Azure Data engineer
Duration: 12-month contract
Visa Constraints : None


Communication skiils should be great
  • Confirmed -- two positions still open
  • Updated MUST HAVES:
    1. Hands on rest api development using Python frameworks
    2. Azure expertise with hands on AKS/Kubernetes development
    3. Mongo db experience

Position Overview:
  • Develop data pipelines to ingest, load, and transform data from multiple sources.
  • Leverage Data Platform, running on Google Cloud, to design, optimize, deploy and deliver data solutions in support of scientific discovery
  • Use programming languages like Java, Scala, Python and Open-Source RDBMS and NoSQL databases and Cloud based data store services such as MongoDB, DynamoDB, Elasticache, and Snowflake
  • The continuous delivery of technology solutions from product roadmaps adopting Agile and DevOps principles
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences
  • Design and develop data pipelines, including Extract, Transform, Load (ETL) programs to extract data from various sources and transform the data to fit the target model
  • Test and deploy data pipelines to ensure compliance with data governance and security policies
  • Moving implementation to ownership of real-time and batch processing and data governance and policies
  • Maintain and enforce the business contracts on how data should be represented and stored
  • Ensures that technical delivery is fully compliant with Security, Quality and Regulatory standards
  • Keeps relevant technical documentation up to date in support of the lifecycle plan for audits/reviews.
  • Pro-actively engages in experimentation and innovation to drive relentless improvement e.g., new data engineering tools/frameworks
  • Implementing ETL processes, moving data between systems including S3, Snowflake, Kafka, and Spark
  • Work closely with our Data Scientists, SREs, and Product Managers to ensure software is high quality and meets user requirements
Required Qualifications
  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • 5+ years of experience as a data engineer building ETL/ELT data pipelines.
  • Experience with data engineering best practices for the full software development life cycle, including coding standards, code reviews, source control management (GIT, continuous integraions, testing, and operations)
  • Experience in programming language Python and SQL good to have Java, C#, C++, Go, Ruby, and Rust
  • Experience with Agile, DevOps & Automation [of testing, build, deployment, CI/CD, etc.], Airflow
  • Experience with Docker, Kubernetes, Shell Scripting
  • 2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
  • 3+ years experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
  • 2+ years experience working on real-time data and streaming applications
  • 2+ years of experience with NoSQL implementations (DynamoDB, MongoDB, Redis, Elasticache)
  • 2+ years of data warehousing experience (Redshift, Snowflake, Databricks, etc.)
  • 2+ years of experience with UNIX/Linux including basic commands and shell scripting
  • Experienced with visualization tools like SSRS, Excel, PowerBI, Tableau, Google Looker, Azure Synapse
2 rounds
  • 30 minutes (Hiring Manager)
  • 60 minutes (HM + peers)

Required profile

Experience

Level of experience: Senior (5-10 years)
Spoken language(s):
English
Check out the description to know which languages are mandatory.

Hard Skills

Amazon Web ServicesPython (Programming Language)Scala (Programming Language)Google Cloud Platform (GCP)Java (Programming Language)NoSQLPower BIDocker (Software)KubernetesMicrosoft AzureDevOps

Other Skills

  • Verbal Communication Skills
  • Collaboration
Are you interested?

Data Engineer Related jobs

See more Data Engineer jobs