Data Engineer

iLabs is a global software product engineering company headquartered in Sri Lanka, with deep roots in the US Silicon Valley. We deliver world-class solutions in Web, eCommerce, Mobile, AI/ML, and Cloud technologies, serving industries such as fintech, edtech, medtech, martech, and hospitality. Guided by our vision “to become a global powerhouse in information technology to push humanity forward” we focus on delivering innovative, impactful solutions that empower businesses and create meaningful change in the world.

With a global talent network, we build agile remote teams for leading tech companies worldwide, including Silicon Valley pioneers. Our in-house ventures include Cloud of Goods, a fast-growing eCommerce rental marketplace, and Xenia, a customizable web platform for modern businesses.

At iLabs, we’re on a mission to advance lifestyles through technology and empower our partners to scale smarter and faster. Our culture is driven by creativity, innovation, ownership, teamwork, and global impact; giving you the opportunity and freedom to challenge the norm, spark change, and make a real difference.

If you’re ready to break boundaries and create your defining moment, we’re here to make it happen. Be part of something bigger. Join iLabs

Responsibilities

• Design, build, and maintain scalable and reliable data pipelines for batch and real-time workloads.

• Develop and manage data integration, storage, and processing solutions that support analytics and business needs.

• Ensure data quality, reliability, and performance across the data platform.

• Build and maintain APIs and services that make data accessible to internal teams and applications.

• Write SQL, DDL, and Python code for pipeline development, data validation, troubleshooting, and performance tuning.

• Define and follow best practices for data modeling, documentation, backup, and recovery.

• Work with software engineers, DevOps, ML engineers, and data scientists to deliver on organizational goals.

• Mentor junior team members and contribute to code reviews and engineering standards.

Shift: 9.00am - 6.00pm

Location: Battaramulla (On-Site)

Requirements

• BS/MS in Computer Science, Engineering, or a related field.

• 3+ years of experience in a data engineering role.

• Strong experience with lakehouse architectures and Delta Lake.

• Hands-on experience with streaming and CDC technologies such as Kafka and Debezium.

• Proficiency with workflow orchestration tools such as Apache Airflow.

• Experience with distributed query engines such as Trino/Presto and Hive.

• Strong Python skills.

• Advanced SQL, with a strong grasp of data warehousing, relational database theory, and NoSQL databases.

• Experience building APIs with FastAPI, Django, or Flask.

• Hands-on experience with AWS.

• Comfortable working in Linux environments.

• Excellent communication, interpersonal, and organizational skills.

Nice to Have

• Experience with Databricks.

• Exposure to GCP or Azure (e.g., Azure Data Factory).

• Experience with Spark or other large-scale data processing frameworks.

• Docker and Kubernetes experience.

• Knowledge of data modeling and design patterns.

• Web scraping experience (Selenium, Beautiful Soup, or similar).

• Familiarity with CI/CD and monitoring tools.