Job Description
Principal Software Developer
Job Location (Short):  Hyderabad, India
Workplace Type:  Hybrid
Req Id:  3168

Responsibilities

Role Overview

We are looking for a Senior AI Engineer to join the Octave InConcert AI product development team within Octave’s Engineering Information Management ecosystem. This role focuses on building production-grade LLM-powered agentic systems, including industrial AI assistants, RAG/Graph RAG retrieval systems, and document intelligence pipelines operating on complex engineering datasets (e.g., P&IDs, technical documents, asset metadata). In addition to LLM-based solutions, the role also contributes to classical machine learning and deep learning use cases such as computer vision for engineering drawings and predictive modelling.

Key Responsibilities
•    Design, develop, and deploy agentic LLM systems, including:
o    Tool usage and integrations
o    Multi-step workflows
o    Agent skills and MCP integrations
•    Build and optimize retrieval pipelines, including:
o    Chunking and embedding strategies
o    Hybrid search systems
o    Knowledge graphs and GraphRAG approaches
•    Ensure LLM quality and reliability, including:
o    Evaluation datasets and benchmarking
o    Regression testing
o    Human-in-the-loop validation
•    Industrialize AI solutions under enterprise constraints:
o    Cost and latency optimization
o    Security, governance, and data sovereignty
o    Observability and guardrails
•    Lead proof-of-concepts (PoCs) and feasibility studies and collaborate with stakeholders
•    Contribute to broader ML/DL initiatives as required
•    Drive AI-first development practices, leveraging agent-based coding tools to:
o    Accelerate development workflows
o    Maintain agent-friendly code, specs, and issue definitions
•    Stay updated with the latest advancements in LLMs, agents, and GenAI ecosystems, and share knowledge across the organization

Education / Qualifications

Must-Have Qualifications

•    Bachelor’s or Master’s degree in computer science or a related field
•    5+ years of Python development experience, including:
o    Strong software engineering fundamentals
o    Experience building LLM applications in production environments
•    Hands-on experience with:
o    Agentic frameworks (e.g., LangGraph, PydanticAI, OpenAI Agents SDK)
o    Model Context Protocol (MCP)
•    Expertise in RAG architectures:
o    Vector databases (e.g., Elasticsearch, Azure AI Search)
o    Embeddings and re-ranking techniques
•    Experience with LLM evaluation frameworks:
o    Automated evaluation pipelines
o    Handling non-deterministic systems
•    Experience deploying AI solutions in:
o    Cloud/container environments (Docker, Kubernetes)
o    Azure experience preferred
•    Familiarity with AI-assisted development tools:
o    GitHub Copilot, Cursor, Claude Code, or similar
•    Strong communication skills with the ability to:
o    Explain technical trade-offs
o    Collaborate with business and product stakeholders

Strongly Desired Skills

•    Knowledge graphs and GraphRAG:
o    Entity relationship extraction
o    Graph databases (e.g., Neo4j)
•    Experience with classical ML/DL pipelines:
o    PyTorch, scikit-learn
o    Predictive modeling and NLP
•    Document intelligence and OCR:
o    Layout extraction
o    Engineering document processing (e.g., Azure Document Intelligence)
•    Experience in:
o    LLM observability and guardrails
o    AI governance and compliance (e.g., EU AI Act, data residency)
•    Exposure to frontend frameworks (e.g., React) for rapid prototyping
Experience

•    6–9 years of overall IT experience, including: 
o    5+ years in AI/ML
o    2+ years in LLM/GenAI application development

About Octave

Octave provides mission-critical software that empowers organizations to make informed decisions across every stage of the asset lifecycle - Design, Build, Operate and Protect - where performance, safety, and reliability are non-negotiable and failure is not an option.

Turning complex operational data into actionable intelligence, Octave connects expertise, real-world conditions and enterprise-scale insight to improve performance, resilience and incident response where it matters most.

Octave has more than 7,000 employees in 45 countries. Learn more at octave.com and follow us on LinkedIn.

Why work for Octave?

All in. Always forward. That's the way we do things around here. We put trust in our people because we believe it's the best way to unleash potential, bring ideas to life, and keep moving ahead. And it's why we're committed to creating an environment that's truly supportive, providing you with the resources you need to support your ambitions, no matter who you are or where you are in the world.

Everyone is welcome

At Octave, we believe that diverse and inclusive teams are critical to the success of our people and our business. Here, everyone is welcome. As an inclusive workplace, we don't discriminate. In fact, we embrace differences and are fully committed to creating equal opportunities, an inclusive environment, and fairness for all. 

Respect is the cornerstone of how we operate, so speak up and be yourself. You're valued here.