LLM & RAG

ATR GPT — Enterprise AI Assistant

Context: Enterprise Project· Role: AI Engineer / Architect· Status: Enterprise Internal System

ATR GPT is an enterprise RAG assistant helping 900+ employees access information distributed across 20+ departmental knowledge sources, through a policy-search mode and a general assistant mode.

Business Problem

Employees searched scattered documents and departmental repositories, and relied on direct communication with subject-matter experts to find information — a slow process that created knowledge silos across the organization.

Users

Employees across departments who need answers grounded in internal knowledge, without knowing which team or document holds them.

Constraints

Sensitive internal data 20+ heterogeneous sources Multi-provider requirement Hybrid semantic + keyword memory

Solution

I architected a FastAPI RAG platform backed by PostgreSQL with the pgvector extension for hybrid semantic-memory retrieval. A mode router directs each request to Oracle Cloud Infrastructure (OCI) GenAI for policy-document search or Anthropic Claude for general assistant conversation, with OpenAI used separately for image generation — chosen per request based on task and data sensitivity.

Architecture

ATR GPT architecture: web interface, FastAPI backend, mode router branching to OCI GenAI, Claude and OpenAI, converging on PostgreSQL with pgvector
20+ Knowledge Sources
FastAPI + pgvector Retrieval
Mode Router (OCI GenAI · Claude · OpenAI)
Web Delivery

Your Contribution

Designed
the RAG system architecture and hybrid knowledge-retrieval strategy.
Integrated
20+ departmental knowledge sources into one retrieval layer.
Built
the FastAPI backend and a custom web interface.
Developed
a mode router spanning OCI GenAI, Claude and OpenAI, plus the PostgreSQL/pgvector memory layer.
Supported
enterprise deployment and ongoing operation.

Technology Stack

Python FastAPI RAG PostgreSQL + pgvector OCI GenAI Claude API OpenAI API

Results

900+
employees served
20+
knowledge sources integrated
3
AI providers routed by mode
1
cross-department access point

Challenges & Trade-Offs

Mode routing vs. a single fixed model

Routing policy-search requests to OCI GenAI and general assistant requests to Claude trades the simplicity of one fixed model for the flexibility of matching each request to the provider best suited to it — at the cost of maintaining a mode-routing layer instead of a single integration.

Confidentiality

Enterprise project. This page uses architecture diagrams and anonymized descriptions rather than internal interfaces or company data.