Data Engineer
1
2024-11-30
Responsibilities
- Build and maintain scalable data pipelines to process both structured and unstructured data.
- Design and implement data architectures (Data Lake, Data Mesh, Data Warehouse) to support batch and streaming data processing.
- Integrate diverse data sources into the platform, ensuring high-quality, reliable data.
- Work with cross-functional teams (data scientists, analysts, business teams) to understand and meet data needs.
- Leverage cloud platforms (AWS/GCP/Azure) and big data frameworks (Hadoop, Spark, Kafka) to ensure scalability.
- Develop data dictionaries, ensure data quality, and support governance practices.
- Identify opportunities to optimize platform performance and automate processes.
- Create and maintain clear technical documentation for data models and platform usage.
Requirements
Must have:
- Proven experience in designing and building data platforms and pipelines.
- Expertise in handling both relational (PostgreSQL) and NoSQL (MongoDB) databases.
- Hands-on experience with big data technologies (Hadoop, Spark, Kafka).
- Familiarity with data architectures (Data Lake, Data Mesh, Data Warehouse), and batch/streaming data processing.
- Strong knowledge of programming languages (Java, Python, SQL).
- Experience with cloud platforms (AWS, GCP, Azure) and containerization tools (Docker, Airflow).
Nice-to-have:
- Healthcare/MedTech domain experience.
- Knowledge of data privacy and security standards in healthcare.
- Experience with data visualization tools and building data dictionaries.
What we offer
- Attractive salary based on your performance.
- Annual 13th month salary.
- Dedication bonus will be paid once a year.
- Premium healthcare insurance, Annual health checks up.
- Hybrid working (1-day WFH per week).
- Breakfast is available at office in the early morning and snacks in the late afternoon.
- Team building allowance.
- Annual Company team building trip.
- Clubs (Football, Badminton, Biking, Running, Music band).
- Exclusive training programs for all staff in technical, soft skills and process.
- English class.
- Technical clubs.
- Marriage allowance, having newborn baby allowance, bereavement allowance.