DATA ENGINEER en Remoto para LANCEFLEET - Hireline LATAM
Encuentra más vacantes similares

DATA ENGINEER en LANCEFLEET

Sueldo oculto

Remoto: LATAM

Freelance

Nivel de Inglés: Nivel Avanzado

Hi, We are looking for Data Engineer.

As a Data Engineer, you will be developing a platform that models and predicts trends in the financial markets.

 

Main Responsabilities

·          Manage existing and create new Spark jobs (Scala)

·          Optimazing and performance tuning of Spark jobs

·          Manage Hive/Impala tables in CDP infrastructure

·          Support during creation and implementation of the architecture

·          Data analysis

·          Participation in Scrum ceremonies

·          Interaction with BA

Team :

·          The project involves around 90 various specialists (30 Data engineers, 10 data and business analysts, InterSystems cache developers, Java developers, Quantitative analysts/developers, etc.).


it is required

·          Technical expertise with Data tools and methodologies

·          Hands-on experience with Spark 2.0 or greater (+ Scala)

·          Programming experience with Scala

·          Experience working with Hadoop ecosystem (CDP/Cloudera Data Platform)

·          Proficiency in SQL

·          Spoken English


Experience working with:

·          Hive And Impala

·          Apache NiFi

·          Kafka

·          agile environment and understanding of various phases of the software development life cycle

·          Data modelling

·          Skills working with Airflow (preferred) or Oozie