Target's leadership truly empowers personal and professional growth, fostering an environment where we care, grow and win together.
Lead Data Engineer
Job Id: R0000384123
About us:
Working at Target means helping all families discover the joy of everyday life. We bring that vision to life through our values and culture. Learn more about Target here.
About the Role:
As a Lead Data Engineer, you will serve as the technical anchor for the engineering team, responsible for designing and developing scalable, high-performance data solutions. You will own and drive data architecture that supports both functional and non-functional business needs, ensuring reliability, efficiency, and scalability.
Your expertise in big data technologies, distributed systems, and cloud platforms will help shape the engineering roadmap and best practices for data processing, analytics, and real-time data serving. You will play a key role in architecting and optimizing data pipelines using Hadoop, Spark, Scala/Java, and cloud technologies to support enterprise-wide data initiatives.
Additionally, experience with API development for serving low-latency data and Customer Data Platforms (CDP) will be a strong plus.
Key Responsibilities:
- Architect and build scalable, high-performance data pipelines and distributed data processing solutions using Hadoop, Spark, Scala/Java, and cloud platforms (AWS/GCP/Azure).
- Design and implement real-time and batch data processing solutions, ensuring data is efficiently processed and made available for analytical and operational use.
- Develop APIs and data services to expose low-latency, high-throughput data for downstream applications, enabling real-time decision-making.
- Optimize and enhance data models, workflows, and processing frameworks to improve performance, scalability, and cost-efficiency.
- Drive data governance, security, and compliance best practices.
- Collaborate with data scientists, product teams, and business stakeholders to understand requirements and deliver data-driven solutions.
- Lead the design, implementation, and lifecycle management of data services and solutions.
- Stay up to date with emerging technologies and drive adoption of best practices in big data engineering, cloud computing, and API development.
- Provide technical leadership and mentorship to engineering teams, promoting best practices in data engineering and API design.
About You:
- 7+ years of experience in data engineering, software development, or distributed systems.
- Expertise in big data technologies such as Hadoop, Spark, and distributed processing frameworks.
- Strong programming skills in Scala and/or Java (Python is a plus).
- Experience with cloud platforms (AWS, GCP, or Azure) and their data ecosystem (e.g., S3, BigQuery, Databricks, EMR, Snowflake, etc.).
- Proficiency in API development using REST, GraphQL, or gRPC to serve real-time and batch data.
- Experience with real-time and streaming data architectures (Kafka, Flink, Kinesis, etc.).
- Strong knowledge of data modeling, ETL pipeline design, and performance optimization.
- Understanding of data governance, security, and compliance in large-scale data environments.
- Experience with Customer Data Platforms (CDP) or customer-centric data processing is a strong plus.
- Strong problem-solving skills and ability to work in complex, unstructured environments.
- Excellent communication and collaboration skills, with experience working in cross-functional teams.
Why Join Us?
- Work with cutting-edge big data, API, and cloud technologies in a fast-paced, collaborative environment.
- Influence and shape the future of data architecture and real-time data services at Target.
- Solve high-impact business problems using scalable, low-latency data solutions.
- Be part of a culture that values innovation, learning, and growth.
Competitive benefits
We are proud to provide benefits that support you, your family and your future.
Health and well-being
Target in India (TII) prioritizes our people by offering healthcare support, fitness programs, teleheath benefits (i.e., screenings and consultations) and 24/7 confidential mental well-being telecounseling support.
Financial well-being
Your financial well-being is bright with TII's comprehensive flexible insurance program, learning assistance program, day care support and much more.
Paid time off
TII encourages work-life balance with paid time off like privilege, bereavement and parental leaves that offer support in all stages of life.
Competitive pay
TII knows our people are everything and proudly provides equitable and competitive pay.
Other benefits
From digitalized cafeteria solutions to transportation services to broadband reimbursement, enjoy special everyday perks.
Creating a culture of joy
We bring out the best in each other every day.
Inclusivity
We value diverse voices and approaches. We act with authenticity and respect. We create equitable experiences for all.
Connection
We build trusted relationships. We collaborate across business functions. We recognize and celebrate progress.
Drive
We do what is right for Target, our team and guests. We deliver results that matter. We continually learn by valuing progress over perfection.
Grow with Target
We are fully invested in your personal and professional growth because our people are our power.
Team news
Stories of our Target team members in action.
Want to receive job alerts?
Get notified when more jobs like this are posted.
Please provide your first name.
Please provide your last name.
Please provide your email address.
Email address must be formatted correctly.
Location must be selected from autocomplete suggestions
By submitting your information, you acknowledge that you have read our Career Privacy Notice and consent to receive email job alerts and other career-related communications from Target.