Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy, and consent to receive emails from Rise
Jobs / Job page
Software Engineer II (Python and Data pipelines) image - Rise Careers
Job details

Software Engineer II (Python and Data pipelines)

At Scribd (pronounced “scribbed”), our mission is to spark human curiosity. Join our team as we create a world of stories and knowledge, democratize the exchange of ideas and information, and empower collective expertise through our three products: Everand, Scribd, and Slideshare. 

We support a culture where our employees can be real and be bold; where we debate and commit as we embrace plot twists; and where every employee is empowered to take action as we prioritize the customer.

When it comes to workplace structure, we believe in balancing individual flexibility and community connections.  It’s through our flexible work benefit, Scribd Flex, that employees – in partnership with their manager – can choose the daily work-style that best suits their individual needs. A key tenet of Scribd Flex is our prioritization of intentional in-person moments to build collaboration, culture, and connection. For this reason, occasional in-person attendance is required for all Scribd employees, regardless of their location.

So what are we looking for in new team members? Well, we hire for “GRIT”. The textbook definition of GRIT is demonstrating the intersection of passion and perseverance towards long term goals. At Scribd, we are inspired by the potential that this can unlock, and ask each of our employees to pursue a GRIT-ty approach to their work. In a tactical sense, GRIT is also a handy acronym that outlines the standards we hold ourselves and each other to.  Here’s what that means for you: we’re looking for someone who showcases the ability to set and achieve Goals, achieve Results within their job responsibilities, contribute Innovative ideas and solutions, and positively influence the broader Team through collaboration and attitude.

At Scribd (pronounced “scribbed”), our mission is to spark human curiosity. Join our team as we create a world of stories and knowledge, democratize the exchange of ideas and information, and empower collective expertise through our three products: Everand, Scribd, and Slideshare. 


We support a culture where our employees can be real and be bold; where we debate and commit as we embrace plot twists; and where every employee is empowered to take action as we prioritize the customer.


When it comes to workplace structure, we believe in balancing individual flexibility and community connections.  It’s through our flexible work benefit, Scribd Flex, that employees – in partnership with their manager – can choose the daily work-style that best suits their individual needs. A key tenet of Scribd Flex is our prioritization of intentional in-person moments to build collaboration, culture, and connection. For this reason, occasional in-person attendance is required for all Scribd employees, regardless of their location.

  

So what are we looking for in new team members? Well, we hire for “GRIT”. The textbook definition of GRIT is demonstrating the intersection of passion and perseverance towards long term goals. At Scribd, we are inspired by the potential that this can unlock, and ask each of our employees to pursue a GRIT-ty approach to their work. In a tactical sense, GRIT is also a handy acronym that outlines the standards we hold ourselves and each other to.  Here’s what that means for you: we’re looking for someone who showcases the ability to set and achieve Goals, achieve Results within their job responsibilities, contribute Innovative ideas and solutions, and positively influence the broader Team through collaboration and attitude.


About the team:

The ML Data Engineering team is at the heart of metadata extraction and enrichment for all of our brands, managing and processing hundreds of millions of documents, billions of images, and serving millions of users. We operate at an unparalleled scale, handling diverse datasets, including UGC documents, ebooks, audiobooks, and more. Our goal is to build robust systems that drive content discovery, trust, and structured metadata across our platforms.


Role Overview:

We are seeking a Software Engineer II with a strong background in data engineering, software development, and scalable systems. As part of the ML Data Engineering team, you will work on designing, building, and optimizing systems that extract, enrich, and process metadata at scale. You’ll collaborate closely with machine learning teams, product managers, and other engineers to ensure the smooth integration and processing of vast amounts of structured metadata.


Tech Stack:

Our team uses various technologies. The following are the ones that we use on a regular basis: Python, Scala, Ruby on Rails, Airflow, Databricks, Spark, HTTP APIs, AWS (Lambda, ECS, SQS, ElastiCache, Sagemaker, Cloudwatch, Datadog) and Terraform.

Responsibilities

  • Design and develop data pipelines to extract, enrich, and process metadata from millions of documents, images, and other content types.

  • Collaborate with cross-functional teams, including ML engineers and product managers, to deliver scalable, efficient, and reliable metadata solutions.

  • Build and maintain systems that operate at a massive scale, handling hundreds of millions of documents and billions of images.

  • Optimize and refactor existing systems for performance, scalability, and reliability.

  • Ensure data accuracy, integrity, and quality through automated validation and monitoring.

  • Participate in code reviews, ensuring best practices are followed and maintaining high-quality standards in the codebase.

  • Manage and maintain data pipelines, security and infrastructure.

Requirements

  • 4+ years of experience in backend software engineering, with hands-on work in developing data pipelines and building and deploying your own infrastructure

  • Proficient in one or more programming languages, such as Python, Ruby or similar

  • Experience working with a public cloud provider (AWS, Azure, or Google Cloud)

  • Hands-on experience with building, deploying, and optimizing solutions using ECS, EKS or AWS Lambdas

  • Experience with queueing and streaming technologies like SQS, Sidekiq, Kafka or Kinesis

  • Experience working with systems at scale such as External APIs, and data transformations

  • Proven ability to test and optimize systems for performance and scalability.

  • Bachelor’s in CS or equivalent professional experienceBonus points if you have experience working with Machine Learning systems

At Scribd, your base pay is one part of your total compensation package and is determined within a range. Our pay ranges are based on the local cost of labor benchmarks for each specific role, level, and geographic location. San Francisco is our highest geographic market in the United States. In the state of California, the reasonably expected salary range is between $126,000 [minimum salary in our lowest geographic market within California] to $196,000 [maximum salary in our highest geographic market within California]. 


In the United States, outside of California, the reasonably expected salary range is between $103,500 [minimum salary in our lowest US geographic market outside of California] to $186,500 [maximum salary in our highest US geographic market outside of California]. 


In Canada, the reasonably expected salary range is between $131,500 CAD[minimum salary in our lowest geographic market] to $174,500 CAD[maximum salary in our highest geographic market]. 


We carefully consider a wide range of factors when determining compensation, including but not limited to experience; job-related skill sets; relevant education or training; and other business and organizational needs. The salary range listed is for the level at which this job has been scoped. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for a competitive equity ownership, and a comprehensive and generous benefits package.


Benefits, Perks, and Wellbeing at Scribd

*Benefits/perks listed may vary depending on the nature of your employment with Scribd and the geographical location where you work.

• Healthcare Insurance Coverage (Medical/Dental/Vision): 100% paid for employees

• 12 weeks paid parental leave

• Short-term/long-term disability plans

• 401k/RSP matching

• Onboarding stipend for home office peripherals + accessories

• Tuition Reimbursement

• Learning & Development programs

• Quarterly stipend for Wellness, Connectivity & Comfort

• Mental Health support & resources

• Free subscription to Scribd + gift memberships for friends & family

• Referral Bonuses

• Book Benefit

• Sabbaticals

• Company wide events

• Team engagement budgets

• Vacation & Personal Days

• Paid Holidays (+ winter break)

• Flexible Sick Time

• Volunteer Day

• Company-wide Employee Resource Groups and programs that foster an inclusive and diverse workplace.


Want to learn more about life at Scribd? www.linkedin.com/company/scribd/life


---------------------------------------------------------------------------------------------------------------------------

We want our interview process to be accessible to everyone. You can inform us of any reasonable adjustments we can make to better accommodate your needs by emailing accommodations [@] scribd.com about the need for adjustments at any point in the interview process.


Scribd is committed to equal employment opportunity regardless of race, color, religion, national origin, gender, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law. We encourage people of all backgrounds to apply, and believe that a diversity of perspectives and experiences create a foundation for the best ideas. Come join us in building something meaningful.

---------------------------------------------------------------------------------------------------------------------------


Remote employees must have their primary residence in:  Arizona, California, Colorado, Connecticut, DC, Florida, Georgia, Hawaii, Maryland, Massachusetts, Michigan, Missouri, New Jersey, New York, Ohio, Oregon, Tennessee, Texas, Utah, Washington, Ontario (Canada), British Columbia (Canada), or Mexico

 #LI-Remote

Benefits, Perks, and Wellbeing at Scribd

*Benefits/perks listed may vary depending on the nature of your employment with Scribd and the geographical location where you work.

  • Healthcare Insurance Coverage (Medical/Dental/Vision): 100% paid for employees

  • 12 weeks paid parental leave

  • Short-term/long-term disability plans

  • 401k/RSP matching

  • Onboarding stipend for home office peripherals + accessories

  • Learning & Development allowance

  • Learning & Development programs

  • Quarterly stipend for Wellness, WiFi, etc.

  • Mental Health support & resources

  • Free subscription to Scribd + gift memberships for friends & family

  • Referral Bonuses

  • Book Benefit

  • Sabbaticals

  • Company-wide events

  • Team engagement budgets

  • Vacation & Personal Days

  • Paid Holidays (+ winter break)

  • Flexible Sick Time

  • Volunteer Day

  • Company-wide Employee Resource Groups and programs that foster an inclusive and diverse workplace.

Want to learn more about life at Scribd? www.linkedin.com/company/scribd/life

---------------------------------------------------------------------------------------------------------------------------

We want our interview process to be accessible to everyone. You can inform us of any reasonable adjustments we can make to better accommodate your needs by emailing accommodations [@] scribd.com about the need for adjustments at any point in the interview process.

Scribd is committed to equal employment opportunity regardless of race, color, religion, national origin, gender, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law. We encourage people of all backgrounds to apply, and believe that a diversity of perspectives and experiences create a foundation for the best ideas. Come join us in building something meaningful.

---------------------------------------------------------------------------------------------------------------------------

Remote employees must have their primary residence in:  Arizona, California, Colorado, Connecticut, DC, Florida, Georgia, Hawaii, Maryland, Massachusetts, Michigan, Missouri, New Jersey, New York, Ohio, Oregon, Tennessee, Texas, Utah, Washington, Ontario (Canada), British Columbia (Canada), or Mexico

 #LI-Remote

Scribd Glassdoor Company Review
No rating Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon
Scribd DE&I Review
No rating Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon
CEO of Scribd
Scribd CEO photo
Unknown name
Approve of CEO

Average salary estimate

$149750 / YEARLY (est.)
min
max
$103500K
$196000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

Similar Jobs
Photo of the Rise User
Posted 12 days ago

Join Scribd as a Senior Backend Engineer, where you will play a key role in protecting digital content and leading security initiatives.

Photo of the Rise User

As a Senior Manager of Risk Operations at Scribd, you will lead strategic initiatives to enhance payments risk management and fraud prevention.

Photo of the Rise User
Posted 12 days ago
Mission Driven
Collaboration over Competition
Inclusive & Diverse
Growth & Learning
Maternity Leave
Paternity Leave
Medical Insurance
Dental Insurance
Vision Insurance
Mental Health Resources
Life insurance
Disability Insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Paid Time-Off

Join Airbnb's Viaduct team as a Staff Software Engineer to drive innovative solutions in their data access infrastructure.

Photo of the Rise User
Posted 4 days ago

Be part of Entrust's innovative team as a Senior Software Developer, contributing to cutting-edge identity-centric security solutions.

Photo of the Rise User
Posted 2 days ago

Jobgether seeks an experienced Senior Front-End Developer skilled in Vue.js to work remotely and contribute to innovative web applications.

Join our team as a Senior Frontend Engineer to drive innovation in high-quality user interface development.

As a Frontend Software Engineer at Google Labs AI, you will drive innovation in generative AI for user-facing features.

Photo of the Rise User

Join Thomson Reuters as a Senior Software Engineer to innovate legal tech solutions for the Japanese market.

Posted 5 days ago

Take part in shaping the future of energy as a Lead Java Developer with Ignitis Group in Vilnius.

Posted 6 days ago

Take the lead as a Senior Solutions Engineer at Orgvue, driving innovative solutions for top-tier partners in a flexible remote setting.

Photo of the Rise User
Posted 10 months ago
Photo of the Rise User
Inclusive & Diverse
Rise from Within
Mission Driven
Diversity of Opinions
Work/Life Harmony
Transparent & Candid
Growth & Learning
Fast-Paced
Collaboration over Competition
Take Risks
Friends Outside of Work
Passion for Exploration
Customer-Centric
Reward & Recognition
Feedback Forward
Rapid Growth
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Paternity Leave
Fully Distributed
Flex-Friendly
Some Meals Provided
Snacks
Social Gatherings
Pet Friendly
Company Retreats
Dental Insurance
Life insurance
Health Savings Account (HSA)
Photo of the Rise User
Inclusive & Diverse
Rise from Within
Mission Driven
Diversity of Opinions
Work/Life Harmony
Transparent & Candid
Growth & Learning
Fast-Paced
Collaboration over Competition
Take Risks
Friends Outside of Work
Passion for Exploration
Customer-Centric
Reward & Recognition
Feedback Forward
Rapid Growth
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Paternity Leave
Fully Distributed
Flex-Friendly
Some Meals Provided
Snacks
Social Gatherings
Pet Friendly
Company Retreats
Dental Insurance
Life insurance
Health Savings Account (HSA)

Spark Human Curiosity

43 jobs
MATCH
Calculating your matching score...
FUNDING
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, hybrid
DATE POSTED
April 12, 2025

Subscribe to Rise newsletter

Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!
LATEST ACTIVITY
Photo of the Rise User
Someone from OH, North Ridgeville just viewed Sales Associate (Sur La Table) at CSC Generation
Photo of the Rise User
7 people applied to Frontend Engineer at MoralesHR
Photo of the Rise User
Someone from OH, Euclid just viewed Technical Account Manager at ZeroFOX
Photo of the Rise User
Someone from OH, Euclid just viewed Technical Account Manager (Enterprise) at Rippling
Photo of the Rise User
Someone from OH, Euclid just viewed Software Engineer (Node.js & AWS) at Litify
Photo of the Rise User
Someone from OH, Euclid just viewed Technical Program Manager at DeepSource Technologies
Photo of the Rise User
Someone from OH, Euclid just viewed Solution Engineer, Amazon Connect at NeuraFlash
G
Someone from OH, Dublin just viewed Outside Sales Representative at Go Flooring, LLC.
M
Someone from OH, Cincinnati just viewed Remote Data Entry Operator at MUTW, LLC