sata-intelligence

Senior Data Engineer

Data Intelligence Technologies - Chantilly, VA

Summary

The successful candidate will leverage their development skills and experience to support the successful ingestion, cleansing, transformation, loading, and display of significant amounts of data.

Duties, Tasks & Responsibilities

  • Designing and implementing large-scale ingest systems in a Big Data environment
  • Optimizing all stages of the data lifecycle, from initial planning, to ingest, through final display and beyond
  • Designing and implementing data extraction, cleansing, transformation, loading, and replication/distribution
  • Developing custom solutions/code to ingest and exploit new and existing data sources
  • Working with Sponsor development teams to improve application performance
  • Organizing and maintaining Data Layer documentation, so others are able to understand and use it
  • Collaborating with teammates, other service providers, vendors, and users to develop new and more efficient methods

Required Experience, Skills, & Technologies

  • TS/SCI clearance with appropriate poly
  • Strong Java development experience coupled with significant SQL/database experience and data analysis and parsing experience
  • Strong experience with the full data lifecycle, from ingest through display, in a Big Data environment
  • Strong experience with Java-related technologies, such as JDK, J2EE, EJB, JDBC, and/or Spring, and experience with RESTful APIs
  • Experience with Hadoop, Hbase, MapReduce
  • Experience developing and performing ETL tasks in a Linux environment

Desired Experience, Skills & Technologies

  • Experience with Elasticsearch
  • Experience with Kafka and Zookeeper
  • Experience with NiFi


Posted On: Thursday, May 20, 2021



Apply to this job
  • Pre - Screen Questionnaire (FSP)
  • *
  • *
  • *
  • *
  • *
  • *