company logo

Staff Software Engineer - LLM Prompt Quality

Sully.ai.com

Office

Remote

Full Time

What You'Ll Do

  • We are seeking an exceptional Senior Full Stack Engineer to join our team and play a pivotal hands-on role in shaping the current and future capabilities of our product.
  • Work closely with the co-founders and be responsible for building core components and elevating our product to the next level.
  • Be an expert prompt engineer who deeply studies the latest strategies for prompting new models and getting the best performance out of them.
  • Use your innovative thinking and application of new ideas for prompt iteration and optimization for supporting new models, iterating on user feedback, etc.
  • Full-stack engineering, touching all parts of the stack and building end-to-end features.

What You'Ll Bring

  • Expertise in evaluating and improving output quality, accuracy and consistency of LLMs, both off-the-shelf and fine-tuned
  • Experience building and/or using prompting frameworks for prompt hosting, versioning and application
  • Proven track record in fast-paced, startup environments and collaborating with global teams
  • Advanced skills in software development methodologies, programming languages, and system architecture
  • Experience in customer-facing roles for requirements gathering and updates
  • Knowledge of GenAI, LLMs 

Tech Stack

  • Frontend: ReactJS, Bootstrap, Tailwind CSS, or similar frameworks
  • Backend: Node.js, Express.js
  • Databases: NoSQL and SQL
  • DevOps: CI/CD pipelines, cloud services (GCP, Azure, AWS)
  • Bonus: Experience with Applied GenAI, LLMOps, and LLM evaluations
  • Why Join Sully.ai?
  • 🔥 Shape the Future of Healthcare: Build category-defining partnerships that enable doctors to focus on saving lives.
  • 📈 Early-Stage Impact: Join early and play a critical role in shaping our partnership roadmap and overall company growth.
  • 🌎 Remote-First Culture: Work with a talented, mission-driven team in a flexible, remote environment.
  • 💰 Competitive Compensation: Enjoy a competitive salary, equity, and the opportunity to make a real difference.
  • 🏆 Solve Scalability Challenges: Tackle complex challenges in a rapidly growing company, driving impactful change in healthcare.

Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment. 

Staff Software Engineer - LLM Prompt Quality

Office

Remote

Full Time

September 21, 2025

company logo

Sully.ai

sully_ai