大数据开发工程师
加入我们!为什么选择Talan?连续第四年,Talan西班牙分公司再次被评为“最佳工作场所”!今年我们还庆祝在波兰的第二项认证,这是一项重大里程碑。Talan是专注于通过技术实现创新和转型的国际咨询集团,拥有5000名员工和6亿欧元的年营业额。
加载中...
Lead Data Engineer – Chennai (Data Platform & Big Data Focus)
Build the foundation of AI — engineer the data systems that power enterprise intelligence
Location: Chennai, India
Experience: 5+ years in Data Engineering
Problem solvers who don’t just move data but build scalable, reliable data platforms that drive intelligent business decisions.
Role Overview
As a Lead Data Engineer, you will design, build, and scale data platforms that power AI-driven products and analytics solutions. You will work closely with data scientists, product managers, and engineering teams to enable seamless data flow, storage, and processing for enterprise use cases.
What makes you right for this role
Data Platform Development – Design and build scalable data pipelines and data lake architectures for high-performance analytics.
End-to-End Engineering – Develop robust data ingestion, transformation, and processing systems from raw data to production-ready datasets.
Cloud-Native Development – Architect and deploy data solutions on AWS, Azure, or GCP with strong DevOps and automation practices.
Big Data Expertise – Work with distributed data processing frameworks like Spark, Hadoop, and Hive to handle large-scale data workloads.
Collaboration – Partner with cross-functional teams to deliver reliable and impactful data solutions.
Best Practices – Ensure data quality, governance, security, and performance through standardization and continuous improvement.
The person you’re looking for
Strong experience in data engineering with proficiency in Python, Scala, or Java.
Hands-on expertise in building scalable data pipelines and distributed systems.
Good understanding of data lake architecture, data warehousing, and relational databases (Oracle, SQL, DB2, Teradata).
Experience with Big Data technologies such as Hadoop, Spark, Hive, and HBase.
Familiarity with workflow orchestration tools like Airflow.
Experience with cloud platforms (AWS, Azure, or GCP).
Strong problem-solving mindset with the ability to take ownership and lead initiatives.
Passionate about data, innovation, and solving real-world enterprise challenges.
Chennai-based with flexibility to collaborate with global teams and stakeholders.
5年以上数据工程经验
精通Python/Scala/Java
具备大数据处理能力(Hadoop/Spark等)
熟悉云平台(AWS/Azure/GCP)
具备数据管道和分布式系统构建能力
熟悉数据湖架构、数据仓库和关系数据库(Oracle、SQL、DB2、Teradata)
熟悉工作流编排工具(如Airflow)
Crayon Data是一家专注于技术、信息和互联网行业的公司,致力于通过数据平台和大数据技术推动企业智能化发展。
注册并登录后即可查看
加入我们!为什么选择Talan?连续第四年,Talan西班牙分公司再次被评为“最佳工作场所”!今年我们还庆祝在波兰的第二项认证,这是一项重大里程碑。Talan是专注于通过技术实现创新和转型的国际咨询集团,拥有5000名员工和6亿欧元的年营业额。
Optum Insight通过改善健康数据和信息的流动,打造更互联的系统。我们消除摩擦,推动医疗提供方与支付方之间的协同,最终惠及消费者。我们的行业深度专业知识和创新技术帮助组织降低成本,同时提升风险管理和收入增长。
大数据开发工程师(Pyspark/Scala)职位负责参与新或修订应用程序系统的建立和实施,与技术团队协调。
Binance 是全球领先的区块链生态系统,背后是按交易量和注册用户数最大的加密货币交易所。我们被 3 亿多人在 100 多个国家信任,以行业领先的安保、用户资金透明度、交易引擎速度、深度流动性以及 unmatched 的数字资产产品而闻名。Binance 的产品涵盖从交易和金融到教育、研究、支付、机构服务、Web3 特性等。我们利用数字资产和区块链的力量,构建包容性的金融生态系统,以推进金钱的自由并改善全球人们的金融接入。