Kevin C.
I love sharing my learning journey in the technology land and hopefully you can also takeaway some interesting tidbits from mine for your own learning and inspire many others to pass on these knowledges. Enjoy and happy learning & sharing!
AWS Serverless AI Chatbot - Improve Dev Learning Experience with RAG & Claude 2.1
Hack Day #22, 20th Dec, 2023 Kevin C Chen
New Experience?
AWS Cloud Native
GenAI
App
Natural
Conversation Experience
RAG without retraining LLM
FM
AI that respond with dev knowledge
Retrieves relevant information from company data sources and enriching the prompt with that data to deliver more relevant and accurate responses without training LLM
DEMO
Result - New Learning Experience with AI
-
Natural Conversational Experience
- Enable rich interactions
- For both devs and new hires to learn about the anything
-
Help with Precision
- Intelligent enterprise search across different content and easily connect to relevant data
- Powered by AI with domain specific data
-
Serverless Compute on AWS
- Cloud native serverless architecture
- Rapid experimentation with different LLM to evaluate and compare
-
Integration Opportunities
- Many platform & product integration options
- Allow business-specific data and documents ingestion
Happy Developers!
AWS Cloud Native
GenAI
App
Natural
Conversation Experience
RAG without retraining LLM
FM
🥳
AWS AI Chatbot - R&D Knowledge Assistant
By Kevin C.
AWS AI Chatbot - R&D Knowledge Assistant
This is a project I did at work for 2023 Dec Hack Day competition in 24 hours. The goal was to improve developer's learning/onboarding experience from the existing dev team's knowledge vault (e.g. internal documentation website, wiki...etc), which used to be involved with a lot of reading, to a conversational experience with the AI bot powered by AWS using RAG (Retrieval Augmented Generation) technique (to help AI deliver more relevant and accurate responses without training LLM), serverless like lambda with LangChain, AWS Kendra, Amazon Bedrock (Titan & Claude 2 FMs), CloudFront, Cognito, API gateway, S3, DynamoDB, CloudWatch for metric/troubleshooting...etc.
