We are seeking a highly skilled Data Engineer to design, build, and maintain robust data pipelines and infrastructure that empower our organization to make data-driven decisions. In this role, you will work closely with cross-functional teams to ensure the efficient flow, accessibility, and reliability of data. If you are passionate about optimizing data systems and creating scalable solutions, this is the opportunity for you.

Key Responsibilities:

1. Data Pipeline Development:

   • Design, implement, and maintain data pipelines to collect, process, and store data from multiple sources.
   • Optimize data workflows for performance, scalability, and reliability.

2. Data Integration and Transformation:

   • Integrate raw data from various sources, ensuring data quality and consistency.
   • Develop and maintain ETL (Extract, Transform, Load) processes.

3. Database and Data Warehouse Management:

   • Design, build, and manage scalable databases and data warehouses.
   • Optimize database performance for high-volume and high-velocity datasets.

4. Collaboration and Support:

   • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
   • Provide technical support for data-related issues and resolve discrepancies promptly.

5. Data Governance and Security:

   • Implement data governance practices to ensure data accuracy, compliance, and accessibility.
   • Ensure the security of data systems by implementing best practices and compliance standards.

6. Monitoring and Maintenance:

   • Monitor data systems and pipelines for errors or performance issues.
   • Develop automated monitoring solutions to proactively address potential bottlenecks.

Qualifications:

1. Education and Experience:

   • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
   • 5-7 years of experience in data engineering or a related role.

2. Technical Skills:

   • Proficiency in programming languages such as Python, Java, or Scala.
   • Strong expertise in SQL and database technologies (e.g., PostgreSQL, MySQL, MongoDB).
   • Experience with big data tools (e.g., Hadoop, Spark) and cloud platforms (e.g., AWS, Azure, Google Cloud).
   • Familiarity with data pipeline tools such as Apache Airflow, Kafka, or Snowflake.

3. Knowledge and Competencies:

   • In-depth understanding of data architecture, data modeling, and data integration techniques.
   • Experience with distributed systems and microservices architecture.
   • Knowledge of data security, governance, and compliance best practices.

4. Soft Skills:

   • Strong problem-solving and analytical skills.
   • Effective communication skills to work collaboratively with cross-functional teams.
   • Self-motivated and able to prioritize tasks in a fast-paced environment.

Preferred Qualifications:

• Experience with real-time data streaming technologies.
• Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
• Certifications in cloud platforms (e.g., AWS Certified Data Analytics, Azure Data Engineer).

What We Offer:

• Competitive salary and benefits package.
• Opportunities for professional growth and certification.
• A collaborative and inclusive work environment.
• The chance to play a key role in protecting and managing our organization's valuable data assets.

Posted On: Friday, January 17, 2025