Lead Data Engineer

Lead Big Data Engineer

If you have a sixth sense for data science, there’s a digital revolution underway in the UK that needs the talents of people who are at home analysing, managing, designing and predicting complex datasets and breathing life into AI systems. We need a Lead Big Data Engineer to join our innovative UK Advanced Analytics team tasked with creating and managing Big Data infrastructure and tools, typically designing and building big data pipelines and platforms.

From public service transformation to cutting-edge commercial projects, our work has a wide reach, helping make the everyday easier, for everyone. When you start your CGI story, not only will you be improving people’s lives, you can be sure we’ll do the same for you.

Alongside a competitive salary, we offer you our share scheme (3% + 3% matching) making you a member not just an employee. You also have the option to benefit from private medical and dental insurance, flexible retirement options, childcare vouchers and a cycle to work scheme.

As for the future? We work as one team, and are a Top 100 employer. Be a successful part of our story and we’ll support you in taking your career anywhere you want it to go.

Your future duties and responsibilities

CGI have an exciting opening for a Lead Big Data Consultant to work on the collecting, storing, processing, and analysing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the business.

As a senior consultant and Big Data expert you will build ETL/ELT best practices in a big data environment, featuring big data pipelines, real time streaming using Kafka and leveraging high levels of proficiency across distributed computing principles.

You will be able to select and integrate any Big Data tools and frameworks required to provide requested capabilities, implementing ETL/ELT process, working closely with Cloud big data architecture (AWS, Azure, GCP) and be an SME in relation to knowledge of big data tools/platforms, data management tools and necessary infrastructure changes.

This represents an exciting opportunity to help build CGI’s UK Advanced Analytics Capability as it takes flight out of our growing Emerging Technology practice.

Required qualifications to be successful in this role

As the successful candidate you will offer a demonstrable track record in building scalable big data solutions with a view to act as a trusted technology advisor, with core knowledge across a variety of tools and platforms in big data landscape, including appreciation of data management/governance and security.

Necessary skills:

1. Python, Spark for data pipelines
2. Appreciation of ETL/ELT, Lambda architecture, Hadoop, data security & GDPR controls
3. Strong data engineering skills on the Azure Cloud Platform is essential. Other cloud platforms are desirable but not essential.
4. Streaming frameworks like Kafka
5. Understanding of Data Warehousing, Data Modelling techniques
6. Appreciation of database technologies such as noSQL, graph, in-memory databases
7. Attitude to be excited with new technology experimentation in a lab style setup

Nice to have:

1. Snowflake cloud DW
2. Some experience on visualisation tools like Power BI or others, not required at expert level
3. Understanding of Elasticsearch, Hadoop stack, Airflow, Apache ni-fi, Apache Beam, Storm
4. Understanding of Docker, Kubernetes, CI/CD

If you have strong mandatory skills, we will support training and certification on other cloud platforms and technologies using our partnerships with technology providers.

Suffice to say we’re also looking for well-developed interpersonal skills - clear, concise – with a passion for latest business innovations and their application to clients’ challenges.

You will need to be keen to learn & develop and CGI will provide you the support and training to help achieve this.

#INDCGI

Build your career with us.

It is an extraordinary time to be in business. As digital transformation continues to accelerate, CGI is at the center of this change—supporting our clients’ digital journeys and offering our professionals exciting career opportunities.

At CGI, our success comes from the talent and commitment of our professionals. As one team, we share the challenges and rewards that come from growing our company, which reinforces our culture of ownership. All of our professionals benefit from the value we collectively create.

Be part of building one of the largest independent technology and business services firms in the world.

Learn more about CGI on our website.

No unsolicited agency referrals please.

CGI is an equal opportunity employer.