Data Engineer
True Source IT, LLC
- Minneapolis, MN
True Source IT is searching for a Data Engineer to join a rapidly expanding team and company. This is a new position created to build out a new data team with very high viability with the senior leadership team.
If you have a strong foundation of skills in python development and working with data in relational database environment and would like to explore an opportunity with endless room for growth - please reach out today!
Description of position:
The Ideal Candidate
- Passion for data. You get excited about opportunities to discover, collect, and structure useful data.
- Detail oriented. You are rigorous in your pursuit of perfection with a clear eye for process.
- Technically savvy. You understand the different ways data can be stored, accessed, and analyzed. And you have the scripting skills to use it for creative and innovative products.
Key Responsibilities
- Design, build, manage, and own a growing and complex database, both relational and non-relational.
- Develop processes to monitor and ensure data integrity.
Requirements
- Architect, build, and maintain scalable ETL processes.
- Assess our infrastructure for current and potential data quality issues and provide solutions.
- Strong engineering skills supported by a relevant bachelor’s degree or industry experience.
- Extensive knowledge of data access and data storage techniques.
- Can combine multiple sources of data from APIs, RSS feeds, and human input into a single, structured data store while dealing with issues of duplication, cross-referencing, relational structure, and non-relational/denormalized storage.
- 2+ years of Python experience.
Preferred Skills
- Experience with cloud offerings such as AWS, Azure, or Google Cloud.
- Hadoop experience along with knowledge of the HDFS ecosystem of technologies such as Hive, Shark, Pig & Map Reduce.
- Experience with column-oriented stores (HBase, Cassandra), graph-oriented stores.
- Experience with JavaScript, Bash, and PowerShell.
- Experience with Linux/Unix and Windows servers.
Posted On: Friday, November 30, 2018