Upvanta sp. z o.o.
1 month ago
Data Platform Developer
Sign up to save this job, get alerts, and apply with an optimized CV.
Company information
- Company
- Upvanta sp. z o.o.
- Location
- Polska, dolnośląskie, Wrocław Poland
- Posted
- 1 month ago
Job description
About the project For our client, a company from the banking sector implementing modern projects in the area of Data & Technology, we are looking for an experienced Data Platform Developer to join the team developing a scalable data platform based on an event-driven architecture. We are looking for someone who is comfortable in the world of Apache Kafka and Java, has experience in building microservices, and understands issues related to data integration, DevOps, monitoring, and production environments. Your scope of responsibility: * Designing and developing solutions based on event-driven architecture using Apache Kafka. * Creating microservices in Java / Spring Boot that handle Kafka events. * Working with Kafka Streams and kSQL. * Designing and versioning data schemas: Avro, Protobuf, JSON Schema. * Configuring and developing Kafka Connect, including source/sink connectors. * Integrating Kafka with MongoDB, S3, Apache Iceberg, and other databases and systems. * Implementing data transformations using Single Message Transforms (SMT) and custom converters. * Developing a GraphQL API layer that exposes data from MongoDB. * Automating the configuration of topics, Kafka Connect connectors, kSQL streams, and Kafka Streams applications. * Implementing monitoring and observability solutions – Prometheus, Grafana, OpenTelemetry. * Diagnosing issues related to replication, latency, and data processing. * Optimizing Apache Kafka configuration, including partitions, retention, and replication mechanisms. * Collaborating with Data Engineers, DevOps, and Analysts in an Agile environment. * Documenting solutions and sharing knowledge with the team. What we expect? Must-have: * Minimum 3 years of practical experience in production environments. * Apache Kafka – knowledge of brokers, topics, consumers, producers, logs, and replication mechanisms. * Fluent knowledge of Kafka Streams and kSQL. * Kafka Connect – experience in configuring and developing connectors, both off-the-shelf and custom. Requirements: * Java and Spring – very good knowledge of the Spring framework, particularly Spring Boot, Spring Cloud, Spring Security, Spring Data. * MongoDB – experience in designing document schemas, indexing, and query optimization. * GraphQL – experience in implementing GraphQL services, defining schemas, and resolvers. * Apache Iceberg – basic knowledge of the table format and metadata management. * Java and Python – practical knowledge of the languages. * Monitoring and observability – Prometheus, Grafana, OpenTelemetry. * Security – knowledge of TLS, SASL, ACL, and encryption of data at rest and in transit. * Agile – experience working in Scrum/Kanban and knowledge of Jira and Confluence.
Required skills
- java
- monitoring
- jira
- python
- scrum
- kanban
- agile
- spring boot
- s3
- devops
- prometheus
- grafana
- mongodb
- tls
- confluence
- retention
- microservices
- data integration
- graphql
- banking
- data platform
- apache kafka
- data processing
- event-driven architecture
- metadata management
- protobuf
- spring cloud
- kafka streams
- json schema
- query optimization
- indexing
- opentelemetry
- replication
- spring security
- apache iceberg
- latency
- acl
- avro
- partitions
- production environments
- spring data
- data encryption
- kafka connect
- data & technology
- resolvers
- data at rest
- schema definition
- sasl
- data platform developer
- ksql
- source connectors
- sink connectors
- single message transforms (smt)
- custom converters
- replication mechanisms
- document schemas
- table format
- data in transit
Interested in this position?
Create your free account and tailor your CV to match this job.