Data Engineer - #971954
PA Consulting Group
We are hiring across a variety of grades from Consultant Analyst through to Senior Consultant. Due to the nature of client work for this role, you will need to be a sole British national, eligible to work on secure client sites.
You will ideally have;
- A minimum of 2 years’ experience using AWS and Azure cloud technologies for tasks like ETL pipeline development, data warehousing, data lake creation, and data movement.
- Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks.
- A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing.
- Proficiency in the design and deployment of production data pipelines, involving languages like Java, Python, Scala, Spark, and SQL.
You should also have some, if not all, of the following;
- Capability in scripting, data extraction via APIs, and the composition of SQL queries.
- Practical experience in integrating data engineering components into production systems, along with expertise in data cleaning, data wrangling, data visualisation, and reporting.
- Proficiency in handling substantial volumes of structured and unstructured data, including the integration of data through AWS and Azure cloud-based ingestion and curation processes.
- Knowledge of data mining, machine learning, and natural language processing is considered an advantage.
- Familiarity with Agile methodologies and participation in Scrum ceremonies.
- Competence in the design and construction of solutions tailored for the AWS and Azure cloud environments, which may involve expertise in Platform-as-a-Service components, serverless architecture, and container technologies.
We know the skill-gap and ‘somewhat need to tick every box’ can get in the way of meeting brilliant candidates, so please don’t hesitate to apply – we’d love to hear from you.
Apply today by completing our online application!