UStreet Logo UStreet
⏩ UStreet Logo

Various Roles (Engineering, Quantitative Research, Investment Advisor, Product, Marketing)

πŸ’° $120,000 - $200 🌍 New York City πŸ“… 12/14/2022

Apply

Software Engineer (AI/LLM Product)

πŸ’° $150,000 - $180 🌍 New York City πŸ“… 02/06/2025

Apply

Job Description

**About the Role**
We are seeking a skilled Software Engineer to help build and deploy our AI-
driven Large Language Model (LLM) product. The ideal candidate has experience
with production-grade systems, particularly in AI and NLP, and will contribute
to the full development cycle of our solution.

**Responsibilities:**

* Develop, maintain, and optimize LLM-based systems using Python.
* Design and implement efficient, scalable web services for LLM functionality and integration.
* Collaborate with data scientists, product managers, and designers to refine product requirements.
* Deploy and manage low-latency applications on cloud platforms (AWS, Azure, or GCP).
* Develop secure, efficient APIs to support integrations with external platforms.

**Requirements:**

* Software Development: Proficiency in Python, with 5-7 years of software engineering experience.
* LLM Solution Patterns: Familiarity with LLM techniques such as Retrieval-Augmented Generation (RAG), vector databases, hybrid search, agent development, and prompt engineering, along with experience using related LLM APIs (OpenAI, Anthropic, AWS Bedrock) and SDKs (LangChain, DSPy).
* Cloud Platforms: Experience deploying and managing applications on AWS or Azure.
* DevOps: Familiarity with CI/CD tools for scalable deployments.
* Problem-Solving: Strong analytical and troubleshooting skills.
* Start-Up Experience: Preference for candidates with startup experience.
* Plotly Dash: Experience building applications in Dash Plotly is a bonus.