Senior Data Engineer

Work set-up: 
Full Remote
Contract: 
Full time
Work from: 
Anywhere

SourceBae logo
SourceBae
See all jobs

Job description

This is a remote position.

6+ years’ work experience and bachelor’s degree in information science, Computer Science, Mathematics, Statistics or a quantitative discipline in science, business, or social science.

Hands-on engineer who is curious about technology, should be able to quickly adopt to change and one who understands the technologies supporting areas such as Cloud Computing (AWS, Azure(preferred), etc.), Micro Services, Streaming Technologies, Network, Security, etc. 3 or more years of active development experience as a data developer using Python-spark, Spark Streaming, Azure SQL Server, Cosmos DB/Mongo DB, Azure Event Hubs, Azure Data Lake Storage, Azure Search etc.
Design & develop data management and data persistence solutions for application use cases leveraging relational, non-relational databases and enhancing our data processing capabilities.
Build, test, and enhance data curation pipelines integration data from wide variety of sources like DBMS, File systems, APIs and streaming systems for various KPIs and metrics development with high data quality and integrity.

3+ years of experience working with source code control systems and Continuous Integration/Continuous Deployment tools.

Required profile

Experience

Spoken language(s):
English
Check out the description to know which languages are mandatory.

Hard Skills

Microsoft AzureApache SparkPython (Programming Language)Cloud ComputingData ManagementAzure Cosmos DBSQL AzureNon-Relational Data StoresData ProcessingPersistent StorageRelational DatabasesContinuous DeliveryAzure Data Explorer (Kusto)Application Programming Interface (API)Azure Data LakeAzure Event HubsContinuous DeliveryData CurationApache SparkMongoDBMicroservicesPersonal SecurityData StreamingCyberinfrastructure

Other Skills

  • Adaptability
  • Curiosity
Are you interested?

Data Engineer Related jobs

See more Data Engineer jobs