Software Engineer II (Backend + Data pipelines)

Position Overview

At Scribd Inc., our mission is to spark human curiosity by democratizing the exchange of ideas and knowledge across our suite of products including Everand, Scribd, Slideshare, and Fable. As part of the ML Data Engineering team, you will build scalable, high-performance systems to extract, enrich, and process metadata from millions of documents, images, and audio content. In the role of Software Engineer II, you will collaborate with ML engineers, product managers, and cross-functional partners to integrate machine learning models and LLM-based services into production pipelines, tackling complex, data-driven challenges at a global scale. Our tech stack includes Python, Scala, Ruby on Rails, Airflow, Databricks, Spark, HTTP APIs, AWS (Lambda, ECS, SQS, ElastiCache, Sagemaker, Cloudwatch, Datadog), and Terraform.

Key Responsibilities

• Design and build scalable systems to extract, enrich, and process metadata from millions of documents, images, and audio content.
• Leverage LLMs to integrate capabilities such as summarization, classification, extraction, and enrichment into metadata pipelines.
• Collaborate with ML engineers, product managers, and cross-functional teams to deliver efficient and reliable solutions.
• Optimize and refactor existing systems for performance, scalability, and reliability.
• Ensure data accuracy and integrity through automated validation and monitoring.
• Participate in code reviews and maintain high-quality standards in the codebase.
• Manage and maintain data pipelines, security, and infrastructure.

Required Qualifications

• 5+ years of professional software engineering experience.
• Proficiency in Python, Scala, Ruby, or similar programming languages.
• Experience designing and building distributed systems at scale.
• Hands-on experience with AWS services (ECS, EKS, or AWS Lambda) and infrastructure-as-code tools like Terraform.
• Experience with public cloud providers such as AWS, Azure, or Google Cloud.
• Familiarity with data processing frameworks like Spark or Databricks for large-scale workloads.
• Proven ability to test, profile, and optimize systems for performance and reliability.
• Bachelor’s degree in Computer Science or equivalent professional experience.

Preferred Qualifications

• Experience working with LLMs or integrating ML models into production systems.

Benefits & Perks

• Compensation: Competitive base pay determined by local market rates, including eligibility for equity ownership.
• 100% paid Healthcare Insurance (Medical/Dental/Vision).
• 12 weeks paid parental leave along with short-term and long-term disability plans.
• 401k/RSP matching and an onboarding stipend for home office peripherals and accessories.
• Learning & Development allowances, quarterly wellness stipends, and mental health support.
• Paid time off including vacation, personal days, holidays (with winter break), and flexible sick time.
• Additional perks such as referral bonuses, book benefits, sabbaticals, team engagement budgets, and free subscription to Scribd products.
• Access to cutting-edge AI tools to boost productivity and drive bold innovation.