Data Engineer

1 2024-11-30

Responsibilities

  • Build and maintain scalable data pipelines to process both structured and unstructured data.
  • Design and implement data architectures (Data Lake, Data Mesh, Data Warehouse) to support batch and streaming data processing.
  • Integrate diverse data sources into the platform, ensuring high-quality, reliable data.
  • Work with cross-functional teams (data scientists, analysts, business teams) to understand and meet data needs.
  • Leverage cloud platforms (AWS/GCP/Azure) and big data frameworks (Hadoop, Spark, Kafka) to ensure scalability.
  • Develop data dictionaries, ensure data quality, and support governance practices.
  • Identify opportunities to optimize platform performance and automate processes.
  • Create and maintain clear technical documentation for data models and platform usage.

Requirements

Must have:

  • Proven experience in designing and building data platforms and pipelines.
  • Expertise in handling both relational (PostgreSQL) and NoSQL (MongoDB) databases.
  • Hands-on experience with big data technologies (Hadoop, Spark, Kafka).
  • Familiarity with data architectures (Data Lake, Data Mesh, Data Warehouse), and batch/streaming data processing.
  • Strong knowledge of programming languages (Java, Python, SQL).
  • Experience with cloud platforms (AWS, GCP, Azure) and containerization tools (Docker, Airflow).

Nice-to-have:

  • Healthcare/MedTech domain experience.
  • Knowledge of data privacy and security standards in healthcare.
  • Experience with data visualization tools and building data dictionaries.

What we offer

  • Attractive salary based on your performance.
  • Annual 13th month salary.
  • Dedication bonus will be paid once a year.
  • Premium healthcare insurance, Annual health checks up.
  • Hybrid working (1-day WFH per week).
  • Breakfast is available at office in the early morning and snacks in the late afternoon.
  • Team building allowance.
  • Annual Company team building trip.
  • Clubs (Football, Badminton, Biking, Running, Music band).
  • Exclusive training programs for all staff in technical, soft skills and process.
  • English class.
  • Technical clubs.
  • Marriage allowance, having newborn baby allowance, bereavement allowance.

BACK TO CAREERS