Principal Software Engineer
About the role
Senior Software Engineer
Full-Time · Remote (U.S.)
About Velastegui Ventures
We build enterprise AI infrastructure that lets regulated organizations query their unstructured and structured data in natural language. Our platform combines retrieval-augmented generation, federated search, and self-hosted model inference to deliver citation-backed, auditable answers — deployed inside the customer's own cloud boundary. We're growing the engineering team to scale this platform through its first enterprise deployments and into a multi-tenant product.
About the Role
You'll design, build, and operate the backend of our Enterprise Knowledge and Natural Language Query Platform: ingestion, retrieval, inference, and the governance layer that makes AI defensible for regulated customers. This is a hands-on senior role with real architectural ownership — you'll ship on the platform as it stands today while helping design the next generation of it. We're looking for someone comfortable operating anywhere from 5 to 15 years into their career, provided the depth is there.
Where the platform is today, and where it's going
Today, ingestion runs on SQS with Ray-Serve workers, retrieval uses Amazon Bedrock and Bedrock Knowledge Bases inside the customer's AWS boundary, and the platform is deployed via a GitOps supply chain (ArgoCD, Cosign, Kyverno) into customer-owned EKS.
Over the next 12–18 months we're evolving toward a Kafka-based streaming backbone with CDC, self-hosted LLM inference (vLLM / SGLang), self-hosted vector and graph retrieval, and federated search across semantic, lexical, and knowledge-graph modalities. You'll work on both sides of that transition.
The first 6 months
You'll help stand up our first BYOC deployment into an enterprise client on the current SQS + Bedrock stack, own one or two of the six data-source connectors end-to-end, and drive the ingestion pipeline's incremental-sync design.
Expect direct contact with the customer's platform and compliance teams. In parallel, you'll help shape the Kafka-based connector framework and self-hosted inference path that lands on the platform later in the year.
What You'll Do
- Design and operate backend services across an event-driven microservices architecture — ingestion, retrieval, inference, and the connector framework that onboards new data sources.
- Ship on the current SQS + Ray-Serve + Bedrock stack while helping design and land the Kafka + CDC + self-hosted-inference generation of it.
- Extend retrieval quality across semantic, lexical, and (eventually) graph modalities, including fusion and re-ranking.
- Grow the AI serving path: embedding, generation, re-ranking, model routing, and the registries and evals that let us promote models safely.
- Build observability and evaluation into every service you own — tracing, metrics, and quality/drift signals, not just system health.
- Partner with security and compliance on the controls that make SOC 2 and (where applicable) HIPAA and GDPR defensible: encryption, access control, audit lineage, data residency.
- Support enterprise deployments alongside customer platform teams — IaC rollout, cutover, rollback, and the day-two handoff.
Required
- 5+ years building and operating production backend systems, with meaningful ownership of distributed architecture.
- Strong proficiency in at least one of Go, Rust, or Python, and comfort working across a polyglot codebase.
- Solid grounding in distributed systems: asynchronous messaging, event-driven design, and the failure modes that come with them. Direct experience with a streaming or queue technology (Kafka, SQS, RabbitMQ, or similar) and the concepts
behind Change Data Capture.
- Working knowledge of PostgreSQL and at least one non-relational store (vector, document, or graph).
- Fluency with AWS (or equivalent), containers (Docker/Kubernetes), and infrastructure-as-code (Terraform or similar).
- Real interest in — ideally hands-on experience with — applied AI/ML systems: embeddings, vector search, RAG, or LLM serving. This is an AI infrastructure role; curiosity here isn't optional.
- Communication skills to work directly with customers, compliance stakeholders, and product.
Nice to Have (any of these move you up the stack)
- Managed AI services and hosted retrieval (Amazon Bedrock, Bedrock Knowledge Bases, OpenAI / Anthropic APIs) — relevant to the current stack.
- Self-hosted LLM serving (vLLM, SGLang, llama.cpp) or OpenAI-compatible gateways — relevant to where we're going.
- Vector databases and hybrid semantic/lexical retrieval (Qdrant, Weaviate, Pinecone, OpenSearch hybrid).
- Graph or knowledge-graph modeling (Neo4j or similar).
- Large-scale data processing (Ray, Spark, Databricks) and lakehouse patterns.
- OpenTelemetry-based observability and LLM tracing/eval tooling.
- Enterprise IAM (SSO/SAML/OIDC/SCIM) and multi-tenant SaaS.
- Shipping in SOC 2 / HIPAA / GDPR environments, or prior forward-deployed engineering work.
Compensation & Logistics
- Cash compensation: [$210,000 – $250,000] based on experience and location. No equity component.
- Remote within the U.S. Expect an on-call rotation as we support production customers.
- Background check required; the role handles data from customers in regulated industries.
Why Velastegui Ventures
- Ship into a real enterprise deployment in your first year, not a hypothetical roadmap.
- Own architecture on a platform built ground-up for regulated, enterprise-scale AI — not retrofitted from a chatbot demo.
- Small team, direct customer contact, senior autonomy.
Responsibilities
- Design and operate backend services across an event-driven microservices architecture
- Ship on the current SQS + Ray-Serve + Bedrock stack while helping design the Kafka + CDC + self-hosted-inference generation
- Extend retrieval quality across semantic, lexical, and graph modalities
- Grow the AI serving path including embedding, generation, re-ranking, and model routing
- Build observability and evaluation into every service owned
- Partner with security and compliance on controls for SOC 2, HIPAA, and GDPR
- Support enterprise deployments alongside customer platform teams
Qualifications
- 5+ years building and operating production backend systems
- Strong proficiency in Go, Rust, or Python
- Solid grounding in distributed systems and experience with streaming or queue technology
- Working knowledge of PostgreSQL and at least one non-relational store
- Fluency with AWS, containers, and infrastructure-as-code
- Real interest in applied AI/ML systems
- Communication skills to work directly with customers and compliance stakeholders
Benefits
- Ship into a real enterprise deployment in your first year
- Own architecture on a platform built for regulated, enterprise-scale AI
- Small team, direct customer contact, senior autonomy
Skills mentioned
About Velastegui Ventures
Velastegui Ventures transforms uncertainty into predictable advantage. We architect and deploy robust AI systems that ensure maximum ROI by grounding models in deep, verifiable business knowledge, delivering measurable and deterministic outcomes.