Big Data Engineer

Job description

Whilst you may have any of our UK offices as a base location, you must be fully flexible in terms of assignment location, as these roles may involve periods of time away from home during the week at short notice.
The Big Data Analytics team is part of the Insights and Data Global Practice and has seen strong growth and continued success across a variety of projects and sectors.  We continue to grow and need to add to our talented team with other, experienced, Big Data Analytics SME’s. We very much try to encourage a ‘leave your grade at the door’ mentality so everyone feels comfortable contributing to our innovation.  We also have a great sense of community, we encourage sharing of ideas, we sponsor meet ups for your peers and have a large calendar of social events throughout the year.
If you are keen on working on some truly cutting edge programmes, learning new technologies and techniques and joining a team with like minded big data architects, engineers and analysts, then click the link below and apply now.
We are looking to bring in a wide range of experience and expertise across grades.  If you join us, you would be involved with the full life cycle of designing and delivering modern analytical data solutions, using a wide range of Open Source and COTS products.  Our projects are varied, sometimes you may be asked to help define a client’s data transformation roadmap, other times you may be rolling your sleeves up and creating some innovative solution for a complex problem. 
You will work within or lead an engineering team to ;
design, develop or interface into new or existing data feeds, in order to manipulate and transform data into desired target architectures / applications
manage all aspects of day to day delivery in an Agile or DevOps environment
design, develop or interface into new or existing data feeds, in order to manipulate and transform data into desired target architectures / applications
manage all aspects of day to day delivery in an Agile or DevOps environment
You will work with clients to identify a data transformation roadmap
Internally, you will help identify improved ways of working mentor junior and share knowledge 
This will be dependent upon the grade, but if you can demonstrate some or all of these characteristics then we’d really like to talk to you
- Strong software engineering/development background (in Java or C# or COTS Products).
Data manipulation (XML processing, customised ETL solutions) and data merging experience
Data Transformation using ETL COTS tooling.
Experience of engineering solutions to cope with Big (volume) and Fast (real/near real time) requirements
Experience developing, interfacing or designing data centric applications.
Experience of middleware integration applications, either commercial (i.e. Mulesoft) or Open Source
Experience of DevOps type operations – use of source control (GitHub, Stash), Build tools (Puppet, Jenkins, etc), continuous integration, test driven development (i.e. Cucumber, Lettuce etc)
Experience of Cloud Infrastructure usage and set up
 
Any Experience of:
Hadoop ecosystem (Cloudera, Hortonworks, IBM, AWS, MicroSoft & Google)
Hadoop administration, set up , security and tuning
Data ingestion
Kafka, Flume, Spark
SQL on Hadoop tools
Hadoop administration, set up , security and tuning
Data ingestion
Kafka, Flume, Spark
SQL on Hadoop tools
Hawq and Greenplum
ETL tools like Pentaho, Informatica BDE, Talend
Elastic Search& SOLR
NoSQL and other databases like MongoDB, Cassandra, Neo4J
Professional development. Accelerated career progression. An environment that encourages entrepreneurial spirit. It’s all on offer at Capgemini. And although collaboration is at the core of the way we work, we also recognise individual needs with a flexible benefits package you can tailor to suit you.
 
At Capgemini, we help organisations across the world become more agile, more competitive and more successful. Smart, tailored, often-groundbreaking technical solutions to complex problems are the norm. But so, too, is a culture that’s as collaborative as it is forward thinking. Working closely with each other, and with our clients, we get under the skin of businesses and to the heart of their goals. You will too.
Capgemini is proud to represent nearly 130 nationalities and its cultural diversity. Our holistic definition of diversity extends beyond gender, gender identity, sexual orientation, disability, ethnicity, race, age and religion. Capgemini views diversity as everything that makes us who we are as an organization, including our social background, our experiences in life and work, our communication styles and even our personality.  These dimensions contribute to the type of diversity we value the most: diversity of thought.
We want to make sure that we find the right people to work in our teams, and we know that working full-time isn’t necessarily right for everyone. So we’d love to hear from you if you feel you’re a great fit for this role, and would like to work flexibly. As an example, some of our team members work four days a week, but travel across the UK during their working days. Or you might prefer to work three days a week (in a job share scenario) with travel limited to Greater London. If you are the right person for this role, we’ll find the right working approach for you.
Find out more and apply