Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy, and consent to receive emails from Rise
Jobs / Job page
Senior Data Engineer in Azure using Databricks for Scala/Python image - Rise Careers
Job details

Senior Data Engineer in Azure using Databricks for Scala/Python

Your roleDo you like building complex, secure platforms with a touch of a button? Are passionate about developing automated infrastructure as code that is successfully rolled out across a global implementation? Do you have what it takes to build robust solution that aide data engineers in delivering their data pipelines?UBS , the Group Compliance & Regulatory Governance (GCRG) Technology team is looking for a hands-on Data Engineer on Azure leveraging Databricks for Scala/Python to:• engineer reliable data pipelines for sourcing, processing, distributing, and storing data in different ways, using Databricks and Airflow• craft complex transformation pipelines on multiple datasets producing valuable insights that inform business decisions, making use of our internal data platforms and educate others about Best Practices for analytics big data• develop, train, and apply data engineering techniques to automate manual processes, and solve challenging business problems and ensure the quality, security, reliability, and compliance of our solutions by applying our digital principles and implementing both functional and non-functional requirements• build observability into our solutions, monitor production health, help to resolve incidents, and remediate the root cause of risks and issues• leverage Airflow to build complex branching Data Driven pipelines and leverage Databricks to build the spark layer of data pipelines• leverage Python and Scala for low level complex data operations, codify best practices, methodology and share knowledge with other engineers in UBSYour teamYou will be working as part of the Group Compliance Regulatory Governance Technology stream that focuses on Data Analytics and Reporting. Our crew is using the latest data platforms to further the group's data strategy to realize the true potential of data as an asset through utilizing data lakes, data virtualization, for use with advanced analytics, AI/ML. The crew also ensure the data is managed with strategic sourcing and data quality tooling. Your team will be responsible for building the central GCRG data lake, developing data pipelines to strategically source data from master and authoritative source, creating data virtualization layer, building connectivity for advanced analytics and elastic search capabilities with the aid of cloud computing.Diversity helps us grow, together. That's why we are committed to fostering and advancing diversity, equity, and inclusion. It strengthens our business and brings value to our clients.Your expertise• Bachelor's or master's degree in computer science or any similar engineering is highly desired• ideally 5+ years of total IT experience in SWD or engineering and ideally 3+ years of hand-on experience designing and building scalable data pipelines for large datasets on cloud data platforms• ideally 3+ years of hand-on experience in distributed processing using Databricks, Apache Python/Spark, Kafka & leveraging Airflow scheduler/executor framework• ideally 2+ years of hand-on experience programming experience in Scala (must have), Python & Java (preferred)• experience with monitoring solutions such as Spark Cluster Logs, Azure Logs, AppInsights, Graphana to optimize pipelines and knowledge in Azure capable languages, Python, Scala or Java• proficiency at working with large and complex code base management systems like: Github/Gitlab, Gitflow as a project commiter at both command-line and IDEs levels using: tools like: IntelliJ/AzureStudio• experience working with Agile development methodologies and delivering within Azure DevOps, automated testing on tools used to support CI and release management• expertise in optimized dataset structures in Parquet and Delta Lake formats, with ability to design and implement complex transformations between datasets• expertise in optimized Airflow DAGS and branching logic for Tasks to implement complex pipelines and outcomes and expertise in both traditional SQL and NO-SQL authorshipAbout usUBS is the world's largest and the only truly global wealth manager. We operate through four business divisions: Global Wealth Management, Personal & Corporate Banking, Asset Management and the Investment Bank. Our global reach and the breadth of our expertise set us apart from our competitors..We have a presence in all major financial centers in more than 50 countries.Join usAt UBS, we embrace flexible ways of working when the role permits. We offer different working arrangements like part-time, job-sharing and hybrid (office and home) working. Our purpose-led culture and global infrastructure help us connect, collaborate, and work together in agile ways to meet all our business needs.From gaining new experiences in different roles to acquiring fresh knowledge and skills, we know that great work is never done alone. We know that it's our people, with their unique backgrounds, skills, experience levels and interests, who drive our ongoing success. Together we're more than ourselves. Ready to be part of #teamUBS and make an impact?
UBS Glassdoor Company Review
3.9 Glassdoor star iconGlassdoor star iconGlassdoor star icon Glassdoor star icon Glassdoor star icon
UBS DE&I Review
No rating Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon
CEO of UBS
UBS CEO photo
Sergio P. Ermotti
Approve of CEO

Average salary estimate

Estimate provided by employer
$140000 / ANNUAL (est.)
min
max
$120K
$160K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

Similar Jobs
Photo of the Rise User

An opportunity to lead the University of Maine System’s data integration strategy as a Senior Architect specializing in Boomi.

Posted 8 days ago

Seeking a Sr. Data Engineer to build and maintain robust data pipelines supporting federal government analytics at CGS.

Photo of the Rise User
Citi Hybrid New York New York United States
Posted 13 days ago
Inclusive & Diverse
Rise from Within
Mission Driven
Diversity of Opinions
Work/Life Harmony

Lead strategic IT business analysis and technical delivery for Citi’s Olympus Data Fabric initiatives to transform data governance and risk across global financial markets.

Photo of the Rise User
NBCUniversal Hybrid 7580 Golf Channel Drive, Orlando, FL
Posted 3 days ago

Lead data engineering and analytics teams at Fandango, driving cutting-edge data infrastructure and marketing technology products in a fully remote, strategic leadership role.

Genies, Inc. Hybrid Los Angeles, California, United States
Posted 10 days ago

Lead the design and management of scalable data pipelines and architectures at Genies, an innovative AI and gaming technology firm.

Photo of the Rise User
American Express Hybrid Phoenix, Arizona, United States
Posted 14 days ago
Inclusive & Diverse
Empathetic
Collaboration over Competition
Growth & Learning
Transparent & Candid
Medical Insurance
Dental Insurance
Mental Health Resources
Life insurance
Disability Insurance
Child Care stipend
Employee Resource Groups
Learning & Development

Lead financial data sourcing and regulatory reporting automation initiatives as Manager - Financial Systems at American Express.

Photo of the Rise User
Boeing Hybrid USA - Seattle, WA
Posted 12 days ago

The Boeing Company invites a Senior Data Architect to lead and innovate scalable and AI-driven data architecture solutions across their enterprise platforms.

Photo of the Rise User
Recursion Hybrid Salt Lake City, Utah, United States
Posted yesterday

Lead and mentor a data infrastructure team at Recursion to scale and innovate data platforms critical for next-generation drug discovery.

Photo of the Rise User
Acrisure Innovation Hybrid Atlanta, Georgia, United States
Posted 2 days ago

Acrisure is hiring a visionary Chief Data Officer to transform data into a strategic asset and lead global data initiatives within a rapidly expanding fintech and insurance company.

Photo of the Rise User
Posted 11 days ago

Lead Informatica data governance and integration efforts using IDMC, cloud platforms, and ETL/ELT best practices.

Photo of the Rise User
Posted 6 days ago

Experienced data leader needed to spearhead Govini’s data strategy and product development for national security-focused analytics.

Photo of the Rise User

Support Allegheny Health Network in capturing detailed oncology patient data accurately for registry compliance in a full-time remote role.

Support Pitzer College’s data integration and reporting initiatives by managing cross-platform solutions and training users as a Reporting and Integration Analyst.

From gaining new experiences in different roles to acquiring fresh knowledge and skills – at UBS we believe that you should never stop growing and learning because life never stops teaching. We know that it's our people – with their unique backgro...

23 jobs
MATCH
Calculating your matching score...
FUNDING
DEPARTMENTS
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, hybrid
DATE POSTED
November 23, 2024

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!