DevOps/Business Intelligence Engineer

Manifest Solutions - Dublin, OH

Manifest Solutions is currently seeking a Devops/Business Intelligence Engineer for a position in Dublin, OH.

  • Build, evolve, and scale state-of-the-art AWS infrastructure powering data.
  • Improve ML scaling infrastructure for data ETL, model training and lifecycle, MLOps, batch and run-time processing automation, and inference.
  • Automate deployment processes from the data department for various internal and external use cases.
  • Build reusable production data pipelines for implemented machine learning models, data APIs, and applications.
  • Select, deploy, configure, and maintain enterprise CI/CD tools
  • Define and develop test, release, and support processes for DevOps.
  • Recommend deployment architectures that meet strategic coals.
  • Review, verify and validate code to be deployed.
  • Identify and deploy security measures, perform vulnerability assessment, and risk management.
  • Manage several technical project deliverables to the business
  • Aid in selection of CI/CD tooling for deployment

Skills and Qualifications

  • Expertise in building and managing large volume data processing pipelines (both streaming and batch) platform is a must.
  • Excellent troubleshooting skills
  • Ability to manage the infrastructure and data pipelines needed to bring solution to production.
  • Hands-on distributed systems compute experience using Spark/Dataproc, Kafka, Hive or equivalent.
  • Minimum of 2 years’ experience with languages: Python, JavaScript, java, bash/shell
  • Proficiency in, at least, one modern programming language such a Java, Scala,C++, C#, Go.
  • 1-2 years of experience in developing data infrastructure and operaions in the Cloud (AWS preferred).
  • Experience with CI/CD tools (e.g., Jenkins or equivalent), version control (Git), orchestration/ Job Scheduling tools (Airflow, nifi, etc.).
  • Experience in building highly available (HA) production-grade solutions in AWS.
  • Minimum 3 years' experience building AWS cloud native services using EC2, S3, ECS, SQS, API Gateway, Lambda, etc.
  • Experience with Infrastructure as code (Cloudformation/Terraform).
  • CS background

Desired Skills:

  • Experience with Deep Learning frameworks (Tensorflow, Keras and/or Pytorch)
  • Managing workflows with Airflow
  • Data Warehouse Architectures like S3, Redshift, Glue, Athena.
  • Spring Boot
  • Docker image creation, maintenance, development
  • AWS Lambda with Python / Java / Go.

Posted On: Tuesday, October 12, 2021

Apply to this job