Cloud Data Engineer

Prediktive - Latin America, LATAM

We are looking for a Cloud Data Engineer based anywhere in Latin America to work on a long term project for one of our clients, a Data Analytics and Business Intelligence services company based in Los Angeles.

Responsibilities

This role will be working with a team of 3 full stack engineers based in Los Angeles to help our Client build a new version of their existing Sales product that has ~10k users on both desktop and mobile. This role will focus on building the data pipelines that consume and transform the end customer's data received in CSV format and feed it downstream into various data sources including Google BigQuery, Google Firestore and Cloud Storage. Our Client is building the entire stack Cloud Native from front to back – including the data pipelines. On the data pipeline side our Client will be utilizing Google Cloud Platform for their Cloud Composer (managed Airflow), BigQuery and DataFlow (managed Apache Beam) products. All development for the data pipelines will be in Python and SQL.

The most exciting aspect of this position is that the candidate will learn how to build an entire stack Cloud Native and on Google’s latest platform products. Beyond the data pipelines work our Client needs to do initially there will also be opportunities for this role to build out data microservices and serverless functions, machine learning algorithms and services and data infrastructure automation.

Requirements

  • Advanced Level of English
  • Extended experience building ETL and/or data pipelines using Apache Airflow and Python
  • Advanced level Python for data engineering (not just Python for data science/analytics)
  • Strong SQL language skills for ETL and analytics
  • Experience with Google BigQuery a plus
  • Experience with Apache Spark, Apache Beam a huge plus
  • Familiarity working in a linux based cloud environment like Google Cloud Platform or AWS (Google preferred)


Posted On: Wednesday, October 24, 2018



Apply to this job
  • Basic Questions
  • 1=None 2=Beginner 3=Intermediate 4=Upper-Intermediate 5=Advanced