Mid Data Engineer / ETL, Apache NiFi / PostgreSQL (k/m)

Workplace: Warsaw

Technologies we use

Required

• Apache
• PostgreSQL
• ETL
• SQL
• Data modeling
• REST API
• Python

Operating System

• Linux

About the project

We are looking for a Mid-level Data Engineer to join the Ideamotive team. You will work on projects for our clients in regulated sectors, including the energy industry. Your responsibilities will include developing an existing production platform and building new solutions from scratch. These systems are used for collecting, processing, and sharing data.

Your responsibilities

• Building and developing data flows in Apache NiFi.
• Designing and developing PostgreSQL databases.
• Preparing REST APIs over the database in collaboration with the frontend team.
• Optimizing SQL queries for large data volumes.

Our requirements

• Several years of experience working with relational databases and ETL processes.
• Practical knowledge of Apache NiFi allowing for independent flow design.
• Good knowledge of PostgreSQL and data modeling concepts.
• Experience in optimizing SQL queries.
• Ability to prepare REST APIs over the database (tool configuration is sufficient, no programming in Java or .NET required).
• Basic knowledge of Python for scripting.
• Familiarity with the Linux environment and basic bash.
• Self-reliance in action.
• English language at a minimum B2 level.

Nice to have

• Experience with Azure Data API Builder or Azure API Management.
• Knowledge of the Amazon S3 protocol.
• Knowledge of the power industry, accounting, or controlling.

Benefits

• remote work option
• flexible working hours
• integration meetings

• If, after reading this announcement, you feel that this is a role where you can genuinely build something – it's very likely that we are looking for you.

Ideamotive

What is Ideamotive?

An Agile company providing IT tech team extension services for corporate clients (mainly in Poland).

Our company has been recognized by Forbes for 3 consecutive years as one of the most dynamically developing IT organizations in Poland and has been listed by the Financial Times 1000.

The delivery team consists of 60 people, the core business team of 12 people, and we are aiming for growth, so a "can do" approach and a focus on action are essential here.

We have a very cohesive, engaged team, we enjoy what we do.

Read about our values: https://www.ideamotive.co/about

If such an atmosphere aligns with your expectations, apply! Let's see what story we can write together.

INFORMATION OBLIGATION OF IDEAMOTIVE SP. Z O.O. (for candidates for cooperation, i.e., persons applying for cooperation with the Company based on a civil law contract, e.g., a mandate contract, b2b)This document contains, among others, information regarding the purposes of processing Your personal data by Ideamotive Sp. z o.o. (hereinafter: the "Controller"), the period of their processing by the Controller, the rights to which You are entitled, possible recipients of Your personal data, contact details for matters concerning the processing of Your data by the Controller.The following information is provided in connection with the obligations arising from Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (hereinafter: "GDPR").1. The controller of your personal data is Ideamotive Sp. z o.o. with its registered office in Warsaw (postal code 00-819), at ul. Złota 61/101, entered into the Register of Entrepreneurs by the District Court for the Capital City of Warsaw in Warsaw, XII Commercial Division of the National Court Register under number KRS 0000529079, holding NIP 5272722655, REGON 147483183.2. Contact with the Controller is possible:1) by mail, at the correspondence address: ul. Złota 61/101, 00-819 Warsaw;2) via e-mail at: [email protected]. Your personal data, depending on the personal data collected during the recruitment process, as well as the consents expressed, are processed for the following purposes:Purpose of processing personal dataLegal basis for processing personal dataData retention period for a given processing purpose1Conducting the recruitment process.art. 6 sec. 1 lit. b GDPRPersonal data will be processed until the completion of the recruitment process to which the application/CV was submitted*. *unless consent is given for the processing of personal data for future recruitment, mentioned below.Processing of personal data referred to in art. 9 sec. 1 GDPR (so-called special categories of data), if you include such data in your application/CV.Art. 9 sec. 2 lit. a GDPR In this case, personal data may be processed until the consent is withdrawn, and if the consent is not withdrawn until the completion of the recruitment process – the data will be processed until the completion of the recruitment process to which the application/CV was submitted, or if consent is given for the processing of such data for future recruitment – for a period of three years from the date of expressing the aforementioned consent.The expressed consent can be withdrawn at any time. Withdrawal of consent does not affect the lawfulness of data processing until the consent is withdrawn.Processing of personal data for future recruitment, if you have given your consent.art. 6 sec. 1 lit a GDPR In this case, personal data may be processed until the consent is withdrawn, and if the consent is not withdrawn – for a period of three years from the date of expressing the consent.The expressed consent can be withdrawn at any time. Withdrawal of consent does not affect the lawfulness of data processing until the consent is withdrawn.Fulfillment of the following legally justified interests of the controller:1) ensuring the security of the Controller, its property, and the property of other persons located on the premises, in buildings or rooms used by the Controller, as well as the safety of these persons - if you will enter the premises, building or rooms covered by the Controller's video surveillance.art. 6 sec. 1 lit f GDPR In the case of video surveillance, personal data are processed for a period of 3 months from the date of recording.4. Your personal data may be obtained directly from you during recruitment or from a recruitment agency/recruitment portal if you have submitted an application/CV through them.5. The Controller may process the following categories of your personal 1) identification data, e.g., first name, last name, residential address;2) contact details, e.g., correspondence address, phone number, e-mail address;3) employment history data;4) data concerning education, training and qualifications;5) video surveillance data;6) additional data provided in the application/CV (e.g., hobbies, interests).6. Authorized employees and associates of the Controller; entities with whom the Controller has concluded a data processing entrustment agreement or to whom disclosure of your personal data is in accordance with applicable law may have access to your personal data. Taking the above into account, recipients of your personal data may be the following entities or categories of entities:1) institutions or bodies authorized to request access to or receive personal data on the basis of legal provisions, e.g., the President of the Personal Data Protection Office, the Police;2) entities providing services to the Controller (law firms, auditors, entities servicing the Controller's IT systems or providing other IT services, entities providing security services for facilities used by the Controller);3) the Controller's contractors, if the recruitment is conducted in connection with a project carried out for the Controller's contractor or as part of other cooperation with such a contractor;4) Polish Post, courier companies.7. In the event that, in connection with the processing of your personal data, it becomes necessary to transfer your personal data outside the European Economic Area (EEA) to countries not belonging to the EEA, whose level of data protection has not been recognized by the European Commission as adequate, the Controller will transfer your personal data only to the extent permitted by law, e.g., by applying appropriate safeguards in the form of standard data protection clauses adopted by the European Commission or in cases where the conditions specified in art. 49 sec. 1 GDPR are met. Copies of any safeguards mentioned above or information about their availability can be obtained by contacting the Controller at the addresses indicated in point 2 above.8. You have the right to:1) access your personal data and copies thereof;2) the right to rectify (correct) your data;3) the right to data portability for data processed automatically and based on consent or a contract;4) the right to erasure of data in situations specified in art. 17 GDPR, in situations where data processing is not carried out for the purpose of fulfilling an obligation arising from a legal provision;5) the right to restrict data processing;6) the right to object to data processing (in the case of personal data processing based on art. 6 sec. 1 lit. f GDPR);7) the right to withdraw the consent given for the processing of personal data, if the legal basis for the processing of personal data is consent. You can withdraw the given consent at any time by contacting the Controller at the addresses indicated in point 2 above. Withdrawal of consent does not affect the lawfulness of data processing until the consent is withdrawn.9. You have the right to lodge a complaint with a supervisory authority – the President of the Personal Data Protection Office.10. The provision of your personal data is voluntary, but it is necessary to participate in the recruitment process.11. Your personal data will not be processed in an automated manner that could result in automated decision-making, including decisions based on profiling.