Big Data Engineer

Our team is looking to engage a resource to help support the development of a PoC for Retail Data Sets and Analytics:

• Creating a data sandbox in AWS for retail data set testing.
• Performing Proof-Of-Concept (PoC) to test technical viability of new retail data propositions (example use cases: CLV, Returns, Sustainability Metrics etc)
• Providing technical feasibility of the implementation of future technologies in our infrastructure and data sandbox

Requirements

Ideal Candidate Background:

• Familiar with development languages & platforms and tools including Python, R, Scala, Java, SQL, Linux, Hadoop
• Proficient at frameworks & design patterns, e.g. Lambda and Kappa, etc
• Experience in defining and developing high-volume, horizontally scalable data architectures & event driven ingestion.
• 5+ years of professional experience, hands-on experience using Java, Scala, Python with Hadoop and related technologies.
• 3+ years of experience using Linux systems (scripting, set up, and overall knowledge of the various packages/tools).
• Demonstrated experience using Amazon cloud environment
• Ability to work independently and solve problems using Open-source technologies
• Creative, eager to learn, with a can-do mentality.
• Experience using Hadoop environments in the cloud
• Working experience in AWS API scripts, and building automated tasks.
• Proven analytical, problem-solving and troubleshooting skills.
• Solid oral and written communication skills in English.
• Team spirit with a delivery/results-driven mindset.
• Retail Industry background/experience.
• Working experience with Python and bash scripting.
• Experience with API management systems
• BI Dashboarding experience to present results