Data Engineer

Latam Data Engineer

CriticalRiver Inc. is a trusted technology consulting company for comprehensive consulting, implementation, and managed services across the globe. The company’s highly experienced consultants are experts at understanding client needs and delivering strategic solutions that leverage the latest technologies and industry best practices.

We are currently looking for a Data Engineer in Latam for our Direct Client.

Job Description:

• You will be part of the Data Infrastructure team and will provide support to Flexport employees/engineering teams.
• Develop data pipelines using Flexport Data Orchestration platforms such as Airflow/Dagster.
• Support existing data pipelines, triage and resolve runtime issues for the Data Infrastructure components.
• Manage data infrastructure using Terraform based pipelines.
• Test, reproduce and verify failing conditions of incoming reports
• Follow the defined process and runbooks to resolve known issues within prescribed SLAs.
• Document findings and resolutions to keep the knowledge base up to date. You should have:
• At least 3 years of experience in developing with the data pipelines.
• Good analytical, technical, research, and logical skills
• Good communication and interpersonal skills
• Must have knowledge of Python and Shell scripting
• Good knowledge of AWS components - EKS, IAM, Kinesis, S3, SQS, Lambda
• Good knowledge of CI/CD processes, troubleshooting build errors, understanding stack trace.
• Good to have understanding of Terraform and Helm charts

Job Requirements:

• strong AWS and Python skills. AWS focused.
• Must have Airflow or Dagster hands on experience building/developing data pipelines. Needs to be able to support existing data pipelines, triage and resolve runtime issues for the data infrastructure components.
• On the AWS side, EKS (Kubernetes), IAM, Kinesis, S3, SQS, Lamba are must haves
• Knowledge of CI/CD process and troubleshooting build errors and understanding stack trace.
  Terraform and Helm Charts are mandatory.