Data Engineer with AWS, Redshift, Tableau, Python and Lambda.
The Consortium, Inc.
TECHNICAL SKILLS
Must Have
- AWS - Athena
- AWS - S3
- Glue
- hands-on development of reporting applications
- msExcel
- RedShift
- SQL
- Tableau Desktop /Creator
Nice To Have
- AWS Lambda
- AWS SNS/SQS
- Tableau Integration
Team: Interflow /DAP Reporting: DAP Reporting is responsible for reports, analytics data on the digital test administration. Interflow works on generating reports for all the digital test administration. These reports are used to understand the health of the administration and report stats for leadership. This team is responsible for providing live reports to check on the status of the exams and provide canned post admin reports to analyze the admins in detail.
Profile: Data Analyst will work closely with Architects and leads in the Interflow team, key business stakeholders including program staff to support the organizations effort in the areas of data Analysis and information management. Role should have strong experience in writing super complex SQL queries to extract data for reports. Candidate should have experience working with large set of data. These reports are very critical for the company, and we are looking for an expert who is capable of handling, consuming and extracting large sets of data for analysis and reports.
SQL
Tableau Desktop /Creator
Tableau API Integration
AWS - S3
Glue
AWS - Athena
Redshift
AWS - Lambda
AWS - SNS/SQS
msExcel
Python
QuickSight
Any AI Tools
The Data Engineer will be responsible for building reporting products and standard datasets, using an array of diverse technologies, including Tableau and AWS technologies.
What you’ll do
- Gather, analyze, and interpret data to solve specific use cases. Develop and participate in the review of requirements, data mappings, database specifications documentation and other artifacts and clearly communicate to both the business and technical team members the interpretation of the data.
- Demonstrate the ability to access, trace, analyze, and remediate data issues leveraging SQL and applicable AWS tools such as Athena and Redshift.
- Good analytical skills and experience in handling large sets of data
- Expertise to understand complex queries, proof test, and tweak for the intended use. Critical analysis skills to extract data and analyze the data for inconsistencies and issues.
- Design and manage information systems, conduct analysis, and generate accurate and comprehensive reports on operational data.
- Very strong in documentation of data artifacts, design and reports details.
- Support Architects, Leads and product owners to ensure that all aspects of the information analysis and requirements gathering process are completed with the highest degree of accuracy and quality, including the development and socialization of key project artifacts.
- Support ad hoc data requests as required as part of DevOps team.
- Review, extract, and analyze data and information on system processes and procedures.
- Experience developing testing strategies and identifying comprehensive test scenarios based on business requirements.
- Demonstrated experience with AWS Lambda, NodeJS, SNS/SQS, S3, IAM, CloudWatch, RDS, DynamoDB, Redshift and Athena.
- Willingness and ability to perform in multiple roles on a team, including testing and production support in addition to data analysis.
- Strong ability to understand and internalize the big picture and broader implications.
- Communicate and understand business goals and requirements, and work to create data solutions that add value to the business.
- Support team with functional, regression and end to end testing efforts with a focus on flow of data ensuring that features deliver the expected functionality with high quality.
- Self-starter with ability to set priorities, work independently and attain goals.
- Develop data-driven reporting solutions from concept to deployment.
- Strong SQL skills and ability to work with different data sources.
- Focus on designing and developing effective user-friendly reporting assets including interfaces and outputs.
- Cultivate and maintain knowledge of College Board products, data systems and information assets.
- Work with a highly proficient team using Tableau/Tableau Server, SQL, Relational/Columnar Databases, Data Modeling, MS Office
- Develop scripts to extract data in Athena, Timestream and Redshift.
- Automate the data extract pull and able to visualize these on charts/graphs/Tableau
- Exhibit good communication and practical decision-making skills, a believer in good feedback and documentation.
About you
- BA/BS required (major in an analytical field desired)
- A minimum of 5 to 10+ years work-related experience.
- Experience in hands-on development of reporting applications for the Web in a professional environment
- The Ethos of continuous improvement and interest in learning new things.
More about you
- Strong analytical thinking and structured problem-solving ability
- Ability to handle multiple projects and assignments simultaneously and effectively in a cross-functional team environment.
- Versed on the agile methodology and best practices.
- Excellent interpersonal and collaboration skill with the ability to work with a diverse set of colleagues, across functions, from different organizations, disciplines, etc.
- Self-starter, ability to set priorities, work independently and attain goals
Posted On: Wednesday, June 12, 2024