Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy, and consent to receive emails from Rise
Jobs / Job page
Lead Data Engineer (Committer/Contributor - Spark, Kafka, Kubernetes, Flink, Druid, Yugabyte, Pinot, Starrocks, temporal) image - Rise Careers
Job details

Lead Data Engineer (Committer/Contributor - Spark, Kafka, Kubernetes, Flink, Druid, Yugabyte, Pinot, Starrocks, temporal)

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

The candidate must have:

  • Lead and participate in the design and implementation of our Analytics infrastructure to align with the vision of Visa Data Platform Infrastructure.
  • Design and implement technical solutions to support the ecosystem of Analytics Infrastructure.
  • Responsible for the implementation of ongoing Hadoop infrastructure including monitoring, tuning and troubleshooting.
  • Design, implement and maintain security, data capacity, node forecasting and planning.
  • Provide hardware architectural guidance, plan and estimate cluster capacity, and create roadmaps for the Hadoop cluster deployment.
  • Actively participate in all phases of software development lifecycle: analysis, technical design, planning, development, testing/CICD, release, post production/escalation support
  • Work on a highly scalable, available and resilient multi-tenant Platforms that can host large scale and highly critical applications.
  • Innovate and Re-pivot Problems with Models and Higher Dimension Concepts to  Support Current and Potential Use Case(s).
  • Develop large scale multi-tenant software components on the Platform in an Agile based methodology to provide self-service capabilities.
  • Collaborating with partners from business and technology organizations, develop key deliverables for Data Platform Strategy - Scalability, optimization, operations, availability, roadmap.
  • Build partnerships with other technology teams to drive efficiency in their use of platforms and services that PaaS provide.
  • Expertise in applying the appropriate software engineering patterns to build robust and scalable systems.
  • Ability to act as a Tech lead, guide and mentor junior members in the scrum team.  Stays current with new and evolving technologies.
  • Take ownership of Platform/PaaS architecture and drive it to the next level of effectiveness to support current and long term requirements.
  • Builds strong commitment within the team to support the appropriate team priorities.

This is a hybrid position. Expectation of days in office will be confirmed by your Hiring Manager.

Qualifications

Bachelor's degree in Computer Science, or related technical discipline.
With 12+ years of software development experience in building PaaS or Application frameworks.
Good to be as contributor/committer in one of the Bigdata technologies – Spark,, Kafka, Kubernetes, Flink, Druid,Yugabyte, Pinot, Starrocks,t emporal.
Proficiency in engineering practices and writing high quality code, with expertise in either one of Java or Python or Go.
Experience in building REST services and API’s following best practices of service abstractions, Micro-services and Orchestration frameworks.
Experience building generic services and instrumentation of libraries for wide use across an organization / company.
Experience in Agile methodology and CICD - tool Integration, automation, configuration management in GIT.
Excellent verbal and written communication and presentation skills, analytical and problem-solving skills
Appreciation of diverse LOBs(Line of business) and their platform needs combined with deep technical expertise are required for the role.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Average salary estimate

$140000 / YEARLY (est.)
min
max
$120000K
$160000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

Similar Jobs
Photo of the Rise User
Visa Hybrid Bellevue, Washington, United States
Posted 12 days ago

Lead the development of innovative, scalable payment solutions as a Full Stack Software Engineer at Visa, a world leader in payments technology.

Photo of the Rise User
Posted 12 days ago

Lead the development and growth of embedded payments integrations as part of Visa’s Global API and Partner Ecosystems team in a hybrid Product Manager role.

Photo of the Rise User
Citi Hybrid Irving Texas United States
Posted 7 days ago
Inclusive & Diverse
Rise from Within
Mission Driven
Diversity of Opinions
Work/Life Harmony

Lead data governance and strategy initiatives at a top financial institution, managing data compliance and risk to enhance enterprise data quality and integrity.

Posted 12 hours ago

Leading TetraScience's Scientific Data Engineering team, the Tech Lead will architect AI-native data solutions and champion delivery excellence.

Photo of the Rise User
Wayve Hybrid Sunnyvale, California, United States
Posted 12 hours ago

Lead the data-centric pretraining initiatives for cutting-edge embodied AI systems at Wayve, shaping the future of autonomous vehicle intelligence.

Photo of the Rise User
Posted 10 days ago

Weave seeks a seasoned Senior Analytics Engineer to design and optimize data models that drive actionable insights and business growth in a hybrid work setting.

Photo of the Rise User

A purpose-driven CRM & Data Systems Specialist role at World Relief focused on optimizing data systems to advance humanitarian and refugee support efforts.

Photo of the Rise User
Paddle Hybrid No location specified
Posted 8 days ago

Lead Paddle’s analytics engineering team to build scalable data solutions that drive informed business decisions across global markets.

Photo of the Rise User
Plaid Hybrid San Francisco
Posted 6 days ago

Lead the development of trusted, scalable product-data infrastructure as a senior Business Intelligence analytics engineer at Plaid.

Photo of the Rise User
Posted 11 days ago

Lead and mentor a multidisciplinary data engineering team to develop high-performance cloud-native data platforms at General Motors.

Photo of the Rise User
American Express Hybrid New York, New York, United States
Posted 14 days ago
Inclusive & Diverse
Empathetic
Collaboration over Competition
Growth & Learning
Transparent & Candid
Medical Insurance
Dental Insurance
Mental Health Resources
Life insurance
Disability Insurance
Child Care stipend
Employee Resource Groups
Learning & Development

Lead finance data governance efforts at American Express to ensure trusted data supports critical business processes and regulatory compliance.

Photo of the Rise User
Posted 8 days ago

Lead clinical database development and management initiatives at Pfizer's Clinical Data and Information Sciences group to ensure high-quality and timely clinical data delivery.

Acadian Asset Management, LLC Hybrid Boston, Massachusetts, United States
Posted 4 days ago

Acadian Asset Management is seeking a Senior Data Platform Engineer to design and build scalable data platforms that drive investment strategies in a hybrid work environment.

Photo of the Rise User
Posted 10 days ago

Contribute to data analytics and engineering projects as a Data Strategy & Insights Engineering Co-Op at Avery Dennison while sharpening your skills within a supportive internship program.

Photo of the Rise User

Lead and build the Finance Analytics function at Palo Alto Networks, driving advanced financial insights and strategic analytics to empower data-driven decisions.

Visa Inc. operates as a payments technology company worldwide. The company facilitates commerce through the transfer of value and information among consumers, merchants, financial institutions, businesses, strategic partners, and government entiti...

12855 jobs
MATCH
Calculating your matching score...
FUNDING
DEPARTMENTS
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, hybrid
DATE POSTED
April 1, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!
LATEST ACTIVITY
Photo of the Rise User
7 people applied to Data Scientist at Tubi
I
Someone from OH, Reynoldsburg just viewed Full Time High Ticket DM Appointment Setter at Impact Clients
Photo of the Rise User
Someone from OH, Canton just viewed Summer Internship - Multiple Departments at BPCM