Data Engineer - SEO level) – 6 months - £575pday – SC - hybrid)
Our client is seeking an experienced Data Engineer to work on a hybrid basis up to 2 days per week in either London, Manchester or Bristol with once a month in London if not based in London.
You will be eligible for BPSS & SC clearance
You’ll be a technical data expert in GOV .UK and the voice of authority with regards to data infrastructure. You’ll be a key point of contact for our use of Google Cloud and the adoption of new technologies to support the.
To Support the design and implementation of numerous complex data flows to connect operational systems, data for analytics and business intelligence (BI) systems use of data within GOV .UK driving innovation and best practice.
You will have:
Essential: BigQuery, Data form and Airflow
Nice to have: Terraform, Python and GitHub, GCP, Comfortable with ambiguity
• Experience of working with good data engineering principals, translating user requirements and raw data into effective, scalable, robust engineering solutions in line with build standards and data regulations, ensuring code is production ready.
• Significant practical experience developing production data solutions using Python and SQL, using Git-based workflows, code review and CI/CD practices to manage and deploy production code.
• The ability to work as part of a multidisciplinary team to plan and prioritise work, sometimes working independently and sometimes pairing with developers/data practitioners
• A strong practical background of using Google Cloud, including technologies such as BigQuery, Dataform and Composer.
• The ability to identify areas of innovation in data tools and techniques, and turn them into practical solutions for implementation
• Experience in using Infrastructure as Code (IaC) principles and tools such as Terraform or equivalent cloud infrastructure provisioning technologies.
* Minimum of 5 years in a data related profession, at least 2 of them being within an engineering profession