Our client is unique to the food and beverage industry with a two-tiered business model generating multiple streams of revenue. Having been around for over a decade they have locations around the US and are continuing to expand. We are looking for a Senior Data Consultant to join the team and make an immediate impact from day one. You will work with the Senior Director of Enterprise Data and focus on the design and build-out of their data pipeline solution. This is a fully remote contract position and for the right candidate this may turn into a full-time role!
Your Role
- Work with senior leadership to take ownership of the design and build-out of data pipelines
- Develop and execute data pipeline testing processes and validate business rules and policies
- Process large amounts of structured and unstructured data, including integrating data from multiple sources (Azure Data Warehouse and Azure Data Factory)
- Solve complex data-driven scenarios
- Communicate with IT teams and the business to create data-driven solutions
Your Skills
- Extensive experience designing, building, testing and deploying data pipelines using PySpark
- 5+ years experience with Azure Data Factory and Azure Databricks
- Can prove yourself quickly and decisively
- Hands-on experience in PySpark/Spark handling complex data
- Advanced python experience
- Cloud solution experience
- Strong problem solving skills
- Strong written and verbal communication skills
- Leadership experience a plus!
- Certifications a plus!
