Data Engineer - #971954

PA Consulting Group


Date: 3 weeks ago
City: Belfast
Contract type: Full time
Work schedule: Full day
PA Consulting Group

Qualifications

We are hiring across a variety of grades from Consultant Analyst through to Senior Consultant. Due to the nature of client work for this role, you will need to be a sole British national, eligible to work on secure client sites.


You will ideally have;



  • A minimum of 2 years’ experience using AWS and Azure cloud technologies for tasks like ETL pipeline development, data warehousing, data lake creation, and data movement.

  • Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks.

  • A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing.

  • Proficiency in the design and deployment of production data pipelines, involving languages like Java, Python, Scala, Spark, and SQL.


You should also have some, if not all, of the following;



  • Capability in scripting, data extraction via APIs, and the composition of SQL queries.

  • Practical experience in integrating data engineering components into production systems, along with expertise in data cleaning, data wrangling, data visualisation, and reporting.

  • Proficiency in handling substantial volumes of structured and unstructured data, including the integration of data through AWS and Azure cloud-based ingestion and curation processes.

  • Knowledge of data mining, machine learning, and natural language processing is considered an advantage.

  • Familiarity with Agile methodologies and participation in Scrum ceremonies.

  • Competence in the design and construction of solutions tailored for the AWS and Azure cloud environments, which may involve expertise in Platform-as-a-Service components, serverless architecture, and container technologies.


We know the skill-gap and ‘somewhat need to tick every box’ can get in the way of meeting brilliant candidates, so please don’t hesitate to apply – we’d love to hear from you.


Apply today by completing our online application!


How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Senior React Developer

Recruit NI,
1 hour ago
MCS Group is excited to be working with an impressive local company that specialises in the design and development of software and web applications. This is an exciting time to join the company as they look to expand their development...

Audit Trainee

Recruit NI,
2 hours ago
Your new companyHays are delighted to be working exclusively for a boutique firm based in Belfast city centre for the role of a Trainee Accountant – Chartered Accountants Ireland. The local firm have been in business for over 20 years...

Internal Auditor Assistant Graduate (ACA/CIA/CMIIA) - Belfast - August 2024

RSM UK,
14 hours ago
As one of the world's largest networks of audit, tax and consulting firms, RSM delivers big ideas and premium service to help middle-market businesses thrive. We are a fast-growing firm with big ambitions -- we have a clear goal to...