Software Engineer – Python Developer Tools
Posted 3 months ago
About the job
FriendliAI is hiring a Python Engineer to build developer tools for our users and internal engineers. The software developed by the engineer will be the primary way developers integrate with our inference and agent platform. Your work will remove friction for internal teams and external users. You’ll design ergonomic & stable APIs, reliable releases to PyPI, and drive top-tier developer experience across documentation, examples, and tooling. You’ll collaborate with frontend engineers on end-to-end workflows and partner with product & engineering teams.
Key Responsibilities
Own the Python SDK lifecycle. You will design APIs and implement the client side in the SDK.
Build and maintain a cross-platform CLI with a modern interface, including helpful error messages and good UX.
Manage packaging and distribution pipelines.
Develop and maintain internal developer tools related to DevOps.
Create examples, templates, and guides that help developers effectively utilize our software bundles.
Qualifications
3+ years of professional Python engineering building libraries, SDKs, or developer tools used in production.
Demonstrated SDK/CLI ownership. Familiarity with API ergonomics and versioning, deprecation policies, telemetry, and debugging customer issues.
Strong Python fundamentals, including asyncio, typing, packaging, and testing.
Web API fluency in REST and gRPC.
Experience working with Python monorepos.
Clear written communication skills and capable of turning complex features into clean APIs and concise docs.
Preferred Experience
Maintainer or significant OSS contributor in Python libraries (tooling, SDK, CLI, etc.).
Experience with Python AST and Meta-programming, Packaging
Performance work (profiling, streaming, backpressure) or multi-platform build experience.
Cross‑language exposure (TypeScript/Node, Go).
Containers & local dev tooling (Docker); familiarity with Kubernetes basics.
Experience with LLM/agent SDKs or inference workflows.
Benefits
Flexible working hours
Daily lunch and dinner provided; unlimited snacks and beverages
Supportive and highly collaborative work environment
Health check-up support and top-tier equipment/hardware support
A front-row seat to the generative AI infrastructure revolution
Competitive compensation, startup equity, health insurance, and other benefits.
About FriendliAI
FriendliAI is building the world’s best AI inference platform that makes large language and multi-modal models fast, efficient, and deployable at scale. We power high-throughput, low-latency AI workloads for organizations worldwide and integrate directly with Hugging Face, giving developers instant access to over 500,000 open-source models.
We are a small, fast-moving team doing work that matters at one of the most exciting moments in the history of technology. With our world-class inference engine, we are building a platform that the AI industry can actually rely on.
FriendliAI is The Frontier AI Inference Cloud. Built by the researchers who invented the continuous batching technique that is now industry standard, FriendliAI provides AI engineers with a highly optimized engine that constantly evolves to efficiently run state-of-the-art open-weight and custom models at production scale. By maximizing GPU utilization, FriendliAI delivers speeds up to 3x faster than vLLM, and 50% to 90% cost savings relative to closed model APIs. FriendliAI empowers engineers to deploy frontier AI with uncompromising speed, model ownership, and enterprise-grade reliability.
Key team members
Ryan Pollock
Brian Yoo
Byung-Gon Chun
Elizabeth Shinwon Yoon
Jobr aggregates jobs directly from company career portals — no middlemen. Our team applies on your behalf with AI-tailored resumes, reviewed by a human before submission.