Responsibilities: *Design, develop, and maintain scalable data pipelines using Kafka, KSQL, KStream, and Confluent Cloud; · Optimize and tune data processing systems for performance and efficiency; *Troubleshoot and resolve data-related issues.
*Build strong relationships with senior client stakeholders, helping them to understand how they can leverage Big Data Technologies to solve their unique business problems
*Support the early life definition of projects e.g. shaping definition of scope and input into business cases e.g. Estimation and Impact Analysis
*Translate critical requirements into scalable data solutions, being responsible for designing multiple data architectures
*Guide the full Data Solution project lifecycle - including discovery, requirements analysis, information architecture design, implementation, testing and deployment
*Take part in Agile delivery team ceremonies, including planning, retrospectives etc.
* Work with data technology partners/vendors to ensure best fit solutions are delivered to our clients.
Requirements:
* JSON, ParQue, Xml
*Proven experience as a Data Engineer with expertise in Snowflake connector for Kafka. *Hands-on experience with KSQL, KStream, and Confluent Cloud.
*Strong programming skills in languages such as Java, Python or Scala.
*Experience with data modeling, ETL processes, and data warehousing.
*Familiar with any cloud platforms (AWS or Azure)
*Experience and understanding of modern data architectures and patterns (e.g. Lambda architecture, Streaming, Data Lake architectures)
*Experience of Business Intelligence, Analytics and Reporting technologies (e.g. SSAS, PowerBI) – Knowledge but not a hands-on experience on building reports.
* In-depth experience of data modelling, database design, and architecture – has designed and developed modern, scalable, maintainable, high-quality databases & data services for large-scale data analytics projects. · Strong overall knowledge of application capabilities, integration, data design, methodologies and industry best practices
Customer-centric approach – able to explain technical concepts to both technical and non-technical client stakeholders.
*Experience working with Customer Data-Marts.
*Comfortable working in in an international context, within virtual teams and can interact easily with international stakeholders.
*Experience of working within an Agile delivery framework (e.g. Scrum, DSDM).
*Leadership skills; able to take a leading technical role in a data/engineering project.
#J-18808-Ljbffr
