GenAI - ChatGPT, CO-PILOT and Beyond

Senior Software Engineer
Volunteer - VGLUG FOUNDATION

K. Sathish Kumar

High-level view of GenAI Architecture

Tokenization

"India is my country. Backbone of India is Agriculture"

Title Text

One-Hot Encoding

India      → [1,0,0,0,0,0,0,0]
is         → [0,1,0,0,0,0,0,0]
my         → [0,0,1,0,0,0,0,0]
country    → [0,0,0,1,0,0,0,0]
.          → [0,0,0,0,1,0,0,0]

Embedings

Modern LLMs: 1024+

Vectors

One-Hot x Embedings

For - Agriculture

One-Hot - [0, 0, 0, 0, 0, 0, 0, 1]

Final Vector - [0.85, 0.75, 0.4, 0.5]

Transformer

Prediction

Models Overview

LLMs

Stable Diffusion

Bark

StarCoder

Make LLM to work for US

Initial Idea

idea.md

Technical specification

tech_spec.md

Prompt Plan

plan.md

Start Code

Questions?

Thanks

https://www.linkedin.com/in/sathish-kumar-dev/

LLM

By sathish3418