Senior AI Back-End Engineer
What you’ll do & how you’ll make your mark
Design & scale async REST/WebSocket APIs with Python 3.11+ + FastAPI, using dependency-injection, type hints, and clean vertical-slice architecture.
Implement multi-agent workflows with Semantic Kernel (handoff, sequential, concurrent) to route traffic among specialised LLM agents.
Integrate LLM providers (OpenAI GPT-4.1/mini, Google Gemini 2.5 Flash) behind a provider-agnostic layer for A/B and cost-aware routing.
Deliver Retrieval-Augmented Generation with vector stores such as Azure AI Search, pgvector, or Chroma.
Expose tool-using agents via OpenAI Assistants (Code-Interpreter) for data-analysis / file-manipulation tasks.
Evolve schemas with SQLModel / SQLAlchemy 2 & Alembic; tune Postgres for high-concurrency async access.
Maintain robust CI/CD (Bitbucket Jenkins) that lint, type-check, test, package (Docker), and deploy.
Instrument services with structlog JSON logs, OpenTelemetry traces, and cost/latency metrics; hold p95 < 100 ms.
Champion AI-assisted development (GitHub Copilot, Cursor) and share pragmatic problem-solving practices with the team.
Who you are & what you’ll need to succeed.
5 + yrs building production APIs in Python; 2 + yrs with FastAPI (or similar async stack).
Deep knowledge of async I/O, Pydantic v2, DI, and observability.
Hands-on with Semantic Kernel or comparable agent frameworks.
Practical RAG implementations using Azure AI Search, pgvector, or Chroma.
Strong Postgres skills, including SQLModel/SQLAlchemy 2 and Alembic migrations.
Proven integrations or Side Projects with LLM APIs (OpenAI, Gemini) and structured-output design.
Dependency management via Poetry and virtual-env isolation.
End-to-end CI/CD ownership (build → scan → test → deploy).
Excellent analytical and problem-solving ability.
Remote work readiness with daily overlap of at least 09:00 – 13:00 EST.
Nice to have
Event/message queues (RabbitMQ, Azure Service Bus, Kafka).
Observability stacks (Grafana, LangFuse) for LLM cost governance.
Join us to build the agent-powered backbone of our AI platform—robust, model-agnostic, and ready for millions of users.
Why you’ll love us.
Work-life balance. Our work is thrilling and meaningful, but we know balance is key to living well.
We celebrate one another’s differences. We’re proud of our culture of diversity and inclusion. We foster a culture of belonging. Our company and customers benefit when employees bring their authentic selves to work. We have programs that bring us together on important issues and provide learning and development opportunities for all employees. We have 20 + affinity groups where you can network and connect with Newfolders globally.
We care about you. We are a family, and we care about you and your family’s physical and mental health by providing competitive HMO benefits – 175k MBL with one free dependent upon one year of service! We also give out Punctuality Bonus, Generous Vacation policy, and much more!
Where can we take you? We’re fans of helping our employees learn different aspects of the business, be challenged with new tasks, be mentored, and grow their careers. Unfold new possibilities with #teamnewfold!
#NetworkSolutions
This Job Description includes the essential job functions required to perform the job described above, as well as additional duties and responsibilities. This Job Description is not an exhaustive list of all functions that the employee performing this job may be required to perform. The Company reserves the right to revise the Job Description at any time, and to require the employee to perform functions in addition to those listed above.
Pigment
Coinbase
DocPlanner
Lean Tech
Wellhub
Markmonitor
Markmonitor
Markmonitor