FOURSYS
9 months ago
Full Data Engineer
Sign up to save this job, get alerts, and apply with an optimized CV.
Company information
- Company
- FOURSYS
- Location
- Brasil, Sudeste, Estado de São Paulo, São Paulo Brazil
- Posted
- 9 months ago
Job description
Responsibility Build and optimize data pipeline; Develop integration components, online and batch with datalake, transactional systems and/or external systems and other consumers (e.g. FICO); Interaction with technical teams DataOps, MLOps, Cloud, Architecture, product systems; Fluid communication with multidisciplinary team (business, infrastructure, operations, architecture and governance Knowledge Technical Knowledge of distributed computing (Spark/Hadoop/Databricks); Knowledge of data processing languages such as SQL, Python, R or Scala; Experience in working with big data technologies such as Hadoop, Spark, Hive, Pig, Presto, Cassandra, MongoDB, PostgreSQL, Oracle, MySQL, MariaDB, Amazon Redshift, Google BigQuery, Snowflake, Azure Synapse Analytics, Databricks, AWS Lake Formation, GCP Bigtable, Azure Cosmos DB; Experience in working with data visualization tools such as Tableau, Power BI, QlikView, D3.js, Matplotlib, Seaborn, Plotly, Bokeh; Knowledge of cloud platforms such as Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), IBM Cloud, Oracle Cloud, Alibaba Cloud, Rackspace, OpenStack; Experience in working with containerization technologies such as Docker, Kubernetes, Red Hat OpenShift; Knowledge of DevOps tools such as Jenkins, GitLab CI/CD, Travis CI, CircleCI, GitHub Actions; Experience in working with machine learning frameworks such as TensorFlow, PyTorch, Scikit-learn, Keras, LightGBM, CatBoost; Knowledge of data governance and compliance regulations such as GDPR, HIPAA, PCI-DSS, CCPA; Ability to work in a fast-paced environment with multiple priorities and deadlines; Strong analytical and problem-solving skills; Excellent communication and collaboration skills; Bachelor's degree in Computer Science, Information Technology or related field; Master's degree preferred.
Required skills
- mysql
- docker
- databricks
- snowflake
- sql
- power bi
- python
- kubernetes
- pytorch
- oracle
- jenkins
- github actions
- gdpr
- hadoop
- hive
- presto
- spark
- cassandra
- postgresql
- microsoft azure
- mongodb
- amazon web services (aws)
- tableau
- tensorflow
- ccpa
- mariadb
- d3.js
- circleci
- scala
- oracle cloud
- pci-dss
- r
- hipaa
- qlikview
- bokeh
- scikit-learn
- rackspace
- matplotlib
- seaborn
- gitlab ci/cd
- azure synapse analytics
- pig
- keras
- openstack
- azure cosmos db
- google cloud platform (gcp)
- red hat openshift
- plotly
- lightgbm
- google bigquery
- travis ci
- alibaba cloud
- amazon redshift
- ibm cloud
- aws lake formation
- catboost
- gcp bigtable
Interested in this position?
Create your free account and tailor your CV to match this job.