Data Operations Engineer

Job Description BA Markets wants to professionalise and streamline its activities with regards to data streaming. Therefore, a new agile team has been created to build up a technical platform for BA Markets users to get a hub for all required streaming services. The team will develop the service suite largely internally but will also rely on managed vendor services, such as Databricks. The streaming technology used is Kafka. Many BA Markets users are technically quite advanced so the central focus of this role is to ensure that the data operations platform is scalable and reliable. Key responsibilities include designing, building, testing and maintaining a robust data pipeline using Kafka and other relevant tools.