Sr. Software Engineer II - AI Tooling and Interfaces
RockerboxAbout the role
Home/Jobs/Sr. Software Engineer II - AI Tooling and Interfaces - Rockerbox
Sr. Software Engineer II - AI Tooling and Interfaces - Rockerbox
DV
NYC
6+ years
Today
$128.9K–232.5K/yr
Full-time
Onsite
Skills Required
LLM
RAG
Embeddings
retrieval
agent orchestration
Python
SQL
Kubernetes
container-based infrastructure
orchestration
memory layers
AI data quality
observability
Description
DV’s Rockerbox team is building the next generation of marketing intelligence, with a focus on AI systems, automations, and decisioning engines that drive real business outcomes. This role is centered on turning high-volume data into production AI tooling and interfaces.
Company: Rockerbox
Role: Sr. Software Engineer II - AI Tooling and Interfaces
Location: NYC Global HQ
Experience
6+ years of experience in software engineering, data engineering, or large-scale distributed systems
Hands-on experience integrating LLMs into production systems
Strong proficiency in Python and SQL
Experience with Kubernetes and container-based infrastructure and deployment
Comfortable working from ambiguity to execution
Strong communication skills to explain tradeoffs, scope decisions, and technical strategy clearly
Responsibilities
Work closely with engineers, product managers, and data teams to identify and prioritize AI opportunities across the organization
Translate product requirements into AI-driven solutions that directly impact the client experience
Build end-to-end automations using LLMs, internal data, and external signals to eliminate repetitive tasks and unlock new client-facing capabilities
Design and implement agentic workflows and orchestration pipelines that automate complex, multi-step processes
Design retrieval, orchestration, and memory layers that make AI agents smarter over time
Establish best practices for AI data quality, observability, and safety
Additional Responsibilities
Build systems purpose-built for AI agents, automations, and decisioning engines
Help deliver systems that drive real outcomes for clients and internal teams
Nice To Have
Bonus components may include bonus/commission, equity, and benefits
More Skills
AI systems, vector stores, data engineering, large-scale distributed systems, storage, metadata, reliability, latency, failure modes, safety
Prepare for this role
Recommended resources to build the skills for this position. Sponsored.
Top 50 Embeddings Interview Questions
Zenaique
Curated embeddings questions covering models, similarity, and retrieval.
Top 15 Embeddings Interview Questions (Quick)
Zenaique
A shorter embeddings interview prep set for quick review.
Top 50 RAG Interview Questions
Zenaique
Curated RAG interview questions and answers from Zenaique.
More LLM jobs
AI Engineer
iProgrammer
Pune
Today
Engineer III, Artificial Intelligence
Thermo Fisher Scientific
Bengaluru
Today
Engineer/Associate Engineer – AI & Automation Engineer
Micron Technology
Hyderabad - Phoenix Aquila
Today
AI Engineer | LLM Engineer
Nice Software Solutions Pvt. Ltd.
Pune
Today
Application SRE AI Solutions Engineer
PepsiCo
Gurugram
Today
GenAI Developer
Infosys
Bengaluru
Today
Responsibilities
- Work closely with engineers, product managers, and data teams to identify and prioritize AI opportunities across the organization
- Translate product requirements into AI-driven solutions that directly impact the client experience
- Build end-to-end automations using LLMs, internal data, and external signals to eliminate repetitive tasks and unlock new client-facing capabilities
- Design and implement agentic workflows and orchestration pipelines that automate complex, multi-step processes
- Design retrieval, orchestration, and memory layers that make AI agents smarter over time
- Establish best practices for AI data quality, observability, and safety
Qualifications
- 6+ years of experience in software engineering, data engineering, or large-scale distributed systems
- Hands-on experience integrating LLMs into production systems
- Strong proficiency in Python and SQL
- Experience with Kubernetes and container-based infrastructure and deployment
- Comfortable working from ambiguity to execution
- Strong communication skills to explain tradeoffs, scope decisions, and technical strategy clearly
Benefits
- Bonus components may include bonus/commission, equity, and benefits
Skills mentioned
About Rockerbox
TopGenAIJobs is a curated job board for the generative AI ecosystem — LLM engineers, ML researchers, RAG developers, prompt engineers, AI product managers, and the full stack of roles building the next generation of AI products. Every listing is hand reviewed before going live. For candidates: free to search, filter by skill (LangChain, PyTorch, AWS, etc.), location, and work mode. Save jobs, get alerts, prepare with curated learning resources for each role. For employers: post free, boost for premium placement when you want extra visibility. Reach a candidate pool that's specifically there to work on AI. Visit topgenaijobs.com to browse the latest roles.
H-1B sponsorship history
Historical employer filing data was found for Rockerbox. The employer record includes 5 historical certified applications. This is employer-level history, not a guarantee that this role currently offers sponsorship.