Sign up to save this job, get alerts, and apply with an optimized CV.

Log in Sign up free

Full Data Engineer

Job description

Responsibility Build and optimize data pipeline; Develop integration components, online and batch with datalake, transactional systems and/or external systems and other consumers (e.g. FICO); Interaction with technical teams DataOps, MLOps, Cloud, Architecture, product systems; Fluid communication with multidisciplinary team (business, infrastructure, operations, architecture and governance Knowledge Technical Knowledge of distributed computing (Spark/Hadoop/Databricks); Knowledge of data processing languages such as SQL, Python, R or Scala; Experience in working with big data technologies such as Hadoop, Spark, Hive, Pig, Presto, Cassandra, MongoDB, PostgreSQL, Oracle, MySQL, MariaDB, Amazon Redshift, Google BigQuery, Snowflake, Azure Synapse Analytics, Databricks, AWS Lake Formation, GCP Bigtable, Azure Cosmos DB; Experience in working with data visualization tools such as Tableau, Power BI, QlikView, D3.js, Matplotlib, Seaborn, Plotly, Bokeh; Knowledge of cloud platforms such as Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), IBM Cloud, Oracle Cloud, Alibaba Cloud, Rackspace, OpenStack; Experience in working with containerization technologies such as Docker, Kubernetes, Red Hat OpenShift; Knowledge of DevOps tools such as Jenkins, GitLab CI/CD, Travis CI, CircleCI, GitHub Actions; Experience in working with machine learning frameworks such as TensorFlow, PyTorch, Scikit-learn, Keras, LightGBM, CatBoost; Knowledge of data governance and compliance regulations such as GDPR, HIPAA, PCI-DSS, CCPA; Ability to work in a fast-paced environment with multiple priorities and deadlines; Strong analytical and problem-solving skills; Excellent communication and collaboration skills; Bachelor's degree in Computer Science, Information Technology or related field; Master's degree preferred.

Required skills

mysql docker databricks snowflake sql power bi python kubernetes pytorch oracle jenkins github actions gdpr hadoop hive presto spark cassandra postgresql microsoft azure mongodb amazon web services (aws) tableau tensorflow ccpa mariadb d3.js circleci scala oracle cloud pci-dss r hipaa qlikview bokeh scikit-learn rackspace matplotlib seaborn gitlab ci/cd azure synapse analytics pig keras openstack azure cosmos db google cloud platform (gcp) red hat openshift plotly lightgbm google bigquery travis ci alibaba cloud amazon redshift ibm cloud aws lake formation catboost gcp bigtable

Sign up to apply

Create a free account to apply for this job and get access to:

  • AI-powered CV optimization for this specific job
  • Save jobs and create custom alerts
  • See your CV match score for each job
Create free account Log in

Company information

Company
FOURSYS
Location
Brasil, Sudeste, Estado de São Paulo, São Paulo
Brazil
Posted
7 months ago
View all jobs at FOURSYS

Find similar jobs

Explore more opportunities like this one.

Jobs in Brazil

Interested in this position?

Create your free account and tailor your CV to match this job.

Create free account Log in