Senior Big Data Engineer - Hadoop.

Senior Big Data Engineer required by leading Government arm in Central London. Acting as Senior/Lead Engineer, you will be critical part of the data architecture team working closely with the Enterprise Data Architect. As Big Data Engineer / Data Migration specialist you will be required to work with multiple development teams and existing vendors to understand legacy and new data structures.

Over the next 18-24 months you will apply your wealth of government knowledge and skills in in Hadoop / HDFS, HBase, Kafka, Kerberos, Drools, Graph DBs, Big data architecture, Real time data processing, Data Science, REST, TDD , BDD (specifically Cucumber), Microservices architecture, GitHub / GitLab, use of branching and merging strategies, writing clean code etc. etc. to ensure successfully delivery of this key project. To be successful you must have demonstrable hands-on experience of:

• Kafka, Big Data, Hadoop, HBase, Map Reduce, Storm, Java, JMS.
• designing and implementing data migration, data transformation, data quality, modelling, testing and post production reviews.
• mapping source and target data models, identify gaps, data cleansing, schema modelling (Relational/XML/JSON).
• delivering digital solutions that collect and manage personal and/or sensitive information with appropriate controls and protection.
• collaboratively working, coaching and sharing knowledge with Public Sector client teams, particularly those with limited agile development experience.
• design, implementation and migration of relational databases to Big data based data stores utilising Amazon AWS.
  

Daily rate of up to £700pd on offer. Security Clearance is ideal although can be applied for on your behalf. This is a 18-24 month contract outside of IR35.