We are looking for a Big Data Engineer to join a team working on a greenfield, Apache Spark based project. You will be expected to have a solid Java (and/or Scala) programming background, and recent wide ranging experience on technologies commonly known as "Big Data".
This should include experience on successful projects in areas such as: data transformation (ETL), "fast data", data analysis and mining, business intelligence and data visualisation.
In addition to practical experience, you should have in-depth knowledge of theory, including: relative merits of data store types: relational, document, graph, columnar; lambda & kappa architectures; search, OLAP and other analysis; distributed computing concepts: CAP theorem, quorum election, ACID vs BASE, data parallelism, etc.
Role Responsibilities for the Big Data Engneer
- To build innovative, outstanding software that meets business requirements and exceeds non-functional expectations - Ensure that the team meets the technical output requirements and applicable standards including test coverage - To work closely with the Technical Architects and the Project Manager to ensure that the software meets delivery time frames and architectural vision - Deep understanding of relevant technical skills, coupled with desire to be involved with defining technical standards and best practices for the development team - Understand and seek to understand further the business requirements - Work cooperatively with user experience designers where appropriate - Support QA testers and amend defects throughout the project lifecycle
- Deep understanding of some from each category - Data processing tools: Apache Storm, Apache Spark, Apache Flink, Apache Samza - Hadoop ecosystem: HDFS, Pig, Hive, YARN, Zookeeper, Drill, Impala - Data store types, eg relational: Oracle, MySQL, SQL Server; columnar: Cassandra, Vertica, Druid; document & K-V: Mongo, Riak, Reddis - Search: Elastic Search, Lucene - Strong core Java and/or Scala - BI & data visualisation, eg: Tableau, Qlik, OLAP cubes, Pentaho - Thorough understanding of development best practice, OOA, design patterns, GoF, MVC - Experience with TDD, BDD, Agile Methodologies (Scrum, Lean), JUnit, TestNG.
If you are considering a move from your current role please apply online or if would like to find out about other opportunities please contact Scot Fyfe on ************************ or phone *************
Do you know anyone who might be looking for a new role? You could benefit from our candidate referral scheme. Contact me on the above contact details for more information.
Outsource. Our People. Your Success.
Outsource UK is one of the country's largest and most successful independent recruitment consultancies, specialising in the IT, Digital, Financial Services and Engineering sectors.
We recruit talented people for contract and permanent opportunities, offer a consultative approach and have a reputation for providing a superior service to both clients and candidates.
The business focuses on building long lasting relationships based on reliability and trust. We do this by hiring and retaining a great team of recruitment consultants who listen and understand our client's and candidate's needs.
There is no need to provide bank account details or payment to any person or organisation when applying for vacancies. If these details are requested for any vacancy you see with us, please report it to us via our contact page.
Apply above for Big Data Engineer jobs in Birmingham.