We have a fantastic opportunity with a fast growing Data & Analytics Consultancy who provide services and solutions in Data & Analytics, Cloud Data Migration, Data Strategy and AI. Formed in 2019, the business doubled in size last year and are aiming to do the same again in 2024.
They assist their clients to be mature in their data footprint. Data and analytics are the engine that propels their clients business forward, with reliable and well-managed data being a critical component in achieving their client’s overall strategy. We are fully committed to delivering a world-class data and analytics strategy for their clients and are now looking for an experienced Data Consultant to join them in fulfilling this commitment. The successful applicant will work both across internal business functions, and external client projects.
Requirements:
- Past experience in delivering data projects
- In depth experience in writing complex SQL queries using joins, aggregates, set operators, window functions etc.
- Strong hands-on experience in analysing data on large datasets(Terabytes)
- Extensive experience in Dimensional datamodelling including complex entity relationships and historical data entities
- Experience in building and delivering data marts, data warehouses, data lake and delta lake solutions.
- Development of data ingestion pipelines and robust ETL frameworks. Implementation of data cleansing and data quality features in ETL pipelines.
- Must have strong professional experience of data engineering on Azure
- Experience in documenting low level ETL designs
- Implementation of data streaming solutions
- Extensive Data Engineering experience using Azure Synapse/Azure Databricks, Python and PySpark Skills
- Understanding of Synapse/Spark architecture
- Spark SQL and Performance Tuning
- Delta Lake
- Spark Structured Streaming
- Hands on experience developing modern data platforms
Azure:
- Azure Synapse
- Azure Databricks
- Azure Data Factory
- Azure Data Lake
- Azure DevOps
