Match score not available

Data Engineer Spark/Scala

Remote:

Full Remote

Contract:

Full time

Experience:

Entry-level / graduate

Work from:

Spain

Offer summary

Qualifications:

At least 2 years experience with big data (Spark, Hadoop, Hive, Kafka), programming with Spark/Scala, different database structures including SQL, working in agile CI/DevOps paradigm, expertise in data integration and management with high volume.

Key responsabilities:

Ingesting and processing data with Spark and Scala

ToBeIT Information Technology & Services Startup https://tobeit.es/

11 - 50 Employees

See more ToBeIT offers

Job description

¡Hola!

Desde ToBeIT estamos buscando un Data Engineer Spark/Scala, para trabajar en una de las principales compañías de consultoría tecnológica 100% remoto.

Funciones:

Ingesta y procesamiento de datos con Spark y Scala.

Requisitos obligatorios:

At least 2 years experience working with big data (spark, hadoop, hive, kafka).

At least 2 year experience programming with Spark/Scala.

Experience with different database structures, including SQL (postgres, mysql, …)

Experience working in agile continuos integration/devops paradigm and tool set (git, jenkins, sonar, nexus, jira, splunk).

Experience and expertise across data integration and data management with high data volumes.

Requisitos deseables:

Experience with AWS ecosystem (AWS, EMR, s3, redshift, lambda, glue, athena)

NOSQL (cassandra, redis, elastic search).

Experience with data warehousing and visualisation tools.

Experience with NRT applications: Flink, spark streaming, hbase.

Experience with cloudera. (++ desirable)

Experience with machine learning. (++ desirable)"