As a Lead Data Engineer, you will design and develop enterprise-level data pipelines and services. As part of the DaaS development team within the Data and AI Platform organization based in Bangalore, India, your initial responsibility will be the end-to-end development of the Data Distribution Management System, migrating applications from Mainframe. In the future, you will explore new opportunities at Visa by developing and driving data services and products, leveraging the potential of machine learning and artificial intelligence, particularly Generative AI.
Essential Functions:
Lead the analysis, design, development, and implementation of various initiatives, with end-to-end ownership to deliver business functionalities.
Develop high-quality code, participate in code reviews, and mentor junior developers to ensure timely deliveries.
Ensure the teams deliverables meet or exceed the prescribed defect SLA by delivering zero-defect code.
Champion security best practices by owning component security and collaborating with cybersecurity teams to implement and verify secure coding techniques.
Collaborate with partners from business and technology organizations to develop key deliverables for Data Services and Products, including scalability, optimization, operations, availability, and roadmap.
Effectively communicate status, issues, and risks in a precise and timely manner.
Develop new products iteratively by building quick Proofs of Concept (POCs) and converting ideas into real products.
Be highly hands-on, leading and developing large-scale multi-tenant software components on the platform in an Agile-based methodology to provide self-service capabilities.
Actively participate in all phases of the software development lifecycle: analysis, technical design, planning, development, testing/CICD, release, and post-production/escalation support.
Apply appropriate software engineering patterns to build robust and scalable systems.
Mentor and provide technical guidance to junior data engineers, fostering their professional growth and ensuring adherence to best practices.
Be the champion on productivity improvement using Generative AI in all aspects of SDLC.
Basic Qualifications
14+ years of work experience with a bachelor s degree.
12+ years with an Advanced Degree (e.g., Masters, PhD).
Leadership: At least 3-5 years of experience leading engineering teams.
Technical Skills:
Full Stack Software Development for large-scale, mission-critical applications.
Mastery in distributed big data systems such as Spark, Hive, Kafka streaming, Hadoop, Airflow.