The system leverages GCP Vector Search for accurate responses and streamlines technical support and client interactions.
Business Scope
The business scope focuses on improving client services and operational efficiency through the deployment of an AI chatbot. Key impacts include:
- Employee Productivity: Accelerating project turnaround times and enabling clients to obtain answers about specific queries or logs quickly.
- Technician Efficiency: Reducing time spent searching for specific errors in log files, which accelerates the identification and resolution of issues.
- Request De-escalation: Enhancing the speed at which technicians can address and resolve main problems found in log files, leading to faster problem resolution.
- Client Services: Boosting overall service efficiency and responsiveness, leading to improved client satisfaction.
Our Contribution
- GCP Integration: Integrated GCP Chat Bison API with Langchain to leverage advanced conversational capabilities and metadata generation.
- Pipeline Development: Created a pipeline to facilitate the interaction between Chat Bison and Langchain, enabling effective metadata handling from the vector database.
- LLM Observability: Utilized Langfuse to gather user feedback and refine the pipeline and LLM responses for continuous improvement.
- API Endpoint Development: Developed and deployed a REST API using FastAPI and Uvicorn, ensuring seamless communication with Google Cloud Run for reliable chatbot interactions.
