This job was posted more than 40 days ago and might be expired.
Prophecy logo

Staff AI/ML Engineer

Posted 2 months ago

OfficeSan Francisco, California, United StatesSE250k - 350k USD

About Prophecy

The leader in AI-native data preparation and analysis, Prophecy is revolutionizing how the world’s top enterprises turn data chaos into reliable insights. We introduce the AI-native data lifecycle (generate, refine, deploy) where our industry leading AI agents and humans work hand-in-hand in visual and document interfaces to analyze, transform and prepare data, to ship trusted insights at enterprise scale.

Don’t miss the rocket ship—join Prophecy and build the next data revolution.

Must-Have Skills:

  • Hands-on LLM/agent building (e.g., LangChain/Graph, CrewAI) and tuning to quality benchmarks.
  • Experience with semantic search, RAG, and vector databases.
  • Experience with prompt engineering and optimization
  • Agentic Use Cases: Hands-on experience building and deploying agents in at least one of the following scenarios:
    • Workflow Orchestration: Automating multi-step processes (e.g., ETL pipelines, supply chain optimization, or CRM workflows like Salesforce Agentforce).
    • Code Generation/Assistance: Developing or debugging code autonomously (e.g., similar to Devin AI or GitHub Copilot extensions).
    • Data Analysis/Transformation: Querying, manipulating, or analyzing data across sources (e.g., topic extraction, document analytics in vector DBs like Weaviate).
    • Personalized Assistance: Tailoring recommendations or plans (e.g., e-commerce, education, or finance agents).
    • Autonomous Decision-Making: Real-time decisions in domains like trading or healthcare (e.g., crypto trading, medical workflow optimization).
    • Content Creation: Generating text, art, or media (e.g., social media automation, presentation creation).
    • Multi-Agent Systems: Collaborative agents for simulations or transactions (e.g., policy-constrained evaluation, machine-to-machine commerce).
  • Versatile software developer: fluency in Python, REST APIs, microservices in public cloud; some experience with Go, AWS, k8s, java, Scala.
  • Builder mentality: Demonstrated experience taking ideas to production.

What Will Make You Stand Out

  • Expertise in building and managing Knowledge Graphs, including entity extraction, linkage, and ontology design.
  • Experience integrating Knowledge Graph with AI systems for retrieval, reasoning, and agent context (e.g., enriching with LLM).
  • ML/LLM work in code generation (e.g., Codex, text-to-SQL), semantic extraction, or knowledge graphs (e.g., Neo4j, Neptune).
  • Experience with big-data engines like Spark.
  • Compiler development for languages like SQL, Python, or Scala.
  • Optimization of ML models for low-latency, high-throughput production use.
  • Contributions to open-source AI/ML projects (e.g., Hugging Face, PyTorch).
  • Expertise in retrieval systems or vector databases (e.g., Pinecone, Weaviate).
  • Skill in evaluating tech and driving build/buy decisions

Seniority: Staff or Principal

Location: This is a Hybrid role with 2-3 days a week in office. However, this can vary week to week.

Experience: 6+ years of Software Engineering experience minimum with 2+ of these being in AI/ML

Compensation: $250,000–$350,000 + Additional Equity

Reflected is the base pay range offered for this position. Pay may vary depending on factors including but not limited to achievements, skills, experience, or work location. The range listed is just one component of the compensation package offered to candidates.

Benefits and Perks

  • Prophecy covers 99% of employee health insurance premiums and 75% for dependents
  • We offer $200 per month towards remote work, wellness, gyms, massages, facials, and more!
  • Flexible PTO
  • Professional development allowance
  • Company sponsored Long Term Disability and Life Insurance, FSA/HSA, dental, vision, and more
  • Ability to have your fingerprint on an innovative platform
  • End-to-end ownership of your projects.

*Benefits and perks may vary per country

Prophecy is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, national origin, age, disability, or veteran status.

Job details
Workplace
Office
Location
San Francisco, California, United States
Experience
SE
Salary
250k - 350k USD
per year

Transform raw data into insights with AI pipelines

Employees
175
Industry
Software Development
Headquarters
Palo Alto, California
Founded
2017
Company location
3790 El Camino Real, Unit #688, Palo Alto, California 94306, US
Specialties
AI, Visual Pipelines, Databricks, Data Prep, Data Transformation, Data Integration, Apache Spark, SQL, Scala, React, Data Engineering, ETL, and ELT

Key team members

Bill Vita

Bill Vita

Steve Ross

Steve Ross

George Mathew

George Mathew

Sandra Chim

Sandra Chim

Apply smarter with Jobr

Jobr aggregates jobs directly from company career portals — no middlemen. Our team applies on your behalf with AI-tailored resumes, reviewed by a human before submission.

Direct from company career pages
AI-personalised cover letters
Human review before every submit
Application tracking & follow-ups