Data Engineer

• Degree in Computer Science or related discipline;
• Minimum 3-5 years of experience in Data Engineering;
• Good hands-on experience in both SQL and NoSQL databases (like MariaDB, Oracle, MongoDB ) and Object-Relational Mapping (ORM) frameworks (e.g. Hibernate);
• Experience with CI / CD practices and tools ( Bitbucket, Jenkins, Artifactory, Veracode etc.);
• Experience in Apache Kafka applications, Java, Sprint Boot and API (Microservices);
• Experience building data pipelines with Apache NiFi in production scale and data streaming applications using Apache Spark and Kafka Streams;
• Experience with a variety of data sources and sinks (API, MQ, Files, Databases, Hot lakes, Big data systems etc.).

• Experience in financial industry;
• Familiarity with Agile development methodologies.

• Create, build and maintain the data infrastructure required for Extraction, Transformation and Loading of data from different sources;
• Delivering high-quality data and data models;
• Provide high-level support of Data Analytics/Automation for Compliance and Business Team/stakeholders;
• Liaise with relevant stakeholders to identify and assess suitability of data compliance / data models and to ensure data meets business requirements;
• Coordinate with Data Scientists after building and maintain data dictionaries/requirements for data models;
• Build & maintain data dictionaries / data requirements of implemented data models and coordinate with Data Scientist(s) in developing model narratives;
• Work closely with the Business Analyst in receiving/understanding business feedback in order to incorporate feedback into model performance;
• Identify areas which require analytics support or future model build and include those models in development pipeline;
• Work hand-in hand with Data Scientist(s) and Business Analyst, and undertake the end-to-end data model development.

Sciente Consulting