fbpx

Career141

Career141 logo with 20 year anniversary mark
Great place to work certification 2024

Team Lead – Data engineer

Summary

Sri Lanka

On-Site

LKR

-

Full-time

Category

Information Technology

Share job

Roles & Responsibilities

Data Pipeline Development:

  • Oversee the design, build, and maintenance of scalable data pipelines to ingest, process, and store large volumes of structured and unstructured data.
  • Implement data quality checks and monitoring to ensure the reliability and accuracy of data.
  • Optimize and troubleshoot existing data pipelines to improve performance and reduce costs.

API Development:

  • Guide the development and maintenance of APIs to facilitate seamless data access and integration across various applications and systems.
  • Ensure APIs are secure, scalable, and efficient.
  • Collaborate with software engineers to integrate APIs into applications and services.

Data Transformation:

  • Supervise data transformation and enrichment processes to convert raw data into meaningful and actionable formats.
  • Develop ETL (Extract, Transform, Load) processes to consolidate data from multiple sources into a data warehouse or data lake.
  • Implement data anonymization and masking techniques to protect sensitive information.

KPI Identification:

  • Work closely with stakeholders to understand business goals and identify key performance indicators (KPIs) that align with these objectives.
  • Develop and maintain a comprehensive set of KPIs to track performance and measure success.

Data-Driven Insights:

  • Analyze large datasets to uncover trends, patterns, and insights that can inform business decisions.
  • Collaborate with data scientists and analysts to develop predictive models and algorithms.

Team Leadership:

  • Lead, mentor, and manage a team of data engineers to deliver high-quality data solutions.
  • Foster a collaborative and innovative team environment.
  • Ensure team members have the resources and support needed to perform their roles effectively.

 

 

Pre Requisites

  • Bachelor’s degree in Computer Science, Data Science, Information Technology, or a related field.
  • 5+ years of experience as a Data Engineer or in a similar role, with at least 2 years in a leadership or team lead position.
  • Proficiency in programming languages such as Python, Java, or C#.
  • Strong SQL skills and experience with relational databases (e.g., MySQL, PostgreSQL).
  • Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and containerization tools (e.g., Docker, Kubernetes).
  • Knowledge of API development frameworks (e.g., Flask, Django) and RESTful principles.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration abilities.
  • Proven ability to lead and manage a team effectively.

Apply now

Please enable JavaScript in your browser to complete this form.
Currently Working
Click or drag a file to this area to upload.

Other

Talent Architect

LKR

25000

-

200000

Sri Lanka

Other

On-Site

January 7, 2025

Apparel

Head of Internal Audit

LKR

500000

-

600000

Sri Lanka

Apparel

On-Site

December 31, 2024

Information Technology

Senior Manager Data Protection

LKR

550000

-

650000

Sri Lanka

Information Technology

On-Site

December 31, 2024

Apparel

Head of MEP and Maintenance

USD

3500

-

5500

Bangladesh

Apparel

On-Site

December 31, 2024