Data Engineer - Lead

DirectedLINK - Burbank, CA

Role is onsite 3-4 days a week

 TITLE: Lead Data Engineer

TYPE: Permanent / Full Time

LOCATION: Glendale (closer to Burbank), CA

INDUSTRY: Commercial Real Estate – Publicly Traded

 

ROLE

Our client, the leader in their market, is currently looking for a Lead Data Engineer to join their Machine Learning Data & Analytics practice. The Lead Data Engineer would help them build data products supporting analytics use cases by expanding and optimizing their data warehouse and data pipeline architecture. The ideal candidate is an experienced data pipeline builder with cloud experience who enjoys optimizing data systems and building them from the ground up through collaboration with business stakeholders and internal Data Analytics team members. This role will have significant ownership in the design and implementation of the future analytics data warehouse.

 

RESPONSIBILITIES

  • Build pipelines or ML design patterns via code that transforms raw or disparate data from multiple sources into a format that data analysts and data scientists can use to test and validate solutions. They will own the data lake and/or a data warehouse.
  • Technical stack leader/owner for data and analytics tools in QA/PROD and responsible for maintaining the eco-system and code branches.
  • Assures transfer to IT for enterprise adoption at the appropriate time.
  • Design and code (debug) full stack
  • Create/deploy design patterns that are efficient, resilient data ingress/egress pipelines
  • Create and maintain schema and staging files in data lake and reporting job aggregations
  • Perform lifecycle management of software
  • Refactor data science application/models to production; oversee the technical aspects of projects
  • Ensure optimal software performance.
  • Work closely with other data and analytics team members to optimize the company’s data systems and architecture
  • Design, prototype and build the infrastructure for data ELT from a variety of sources using technology
  • Monitor/Troubleshoot ELT jobs

 

 

 

QUALIFICATIONS

  • Bachelors in Computer Science or Computer Engineering or equivalent required.
  • 5-10 years of experience or any equivalent of experience and education
  • Team player with strong interpersonal skills
  • Proficient at design and operation of distributed systems for both storage and compute; demonstrated capability to troubleshoot performance and fix outage situations
  • C++/#, SQL expert, Python/JavaScript ; loves to parallelize ML operations
  • Conversant on networking - UDP, TCP and Application layer configuration and troubleshooting. Streaming/Batch, Lamda, REST API
  • Knows how to estimate the Big O


Posted On: Thursday, August 25, 2022



Apply to this job

or