Generative AI with Node JS in Hindi #21 What is Embedding
Embedding
Steps of video:-
- What is Embedding
- How it work with Ml
- Generate embedding with openAI
What is Embedding:-
- Convert Data (words or images, or anything) into numbers so a computer can understand their meaning.
- Vector help them to make relation between data, compare, categories etc
We can Store embedding in Vector Databases
Pinecone, Weaviate, Milvus, Qdrant, FAISS
Operations
- Insert
- Similarity Search
- Distance Metrics
- Update
- Delete
- Filter
Index.js Code
import OpenAI from "openai";
import dotenv from 'dotenv'
import { writeFileSync } from 'fs'
dotenv.config();
const client = new OpenAI({ apiKey: process.env.openAI_Key })
const data = ["cat", "dog", "apple"]
async function main() {
const response = await client.embeddings.create({
model: "text-embedding-3-small",
input: data
})
const manageEmbedding = response.data.map((item, index) => {
const itemKey = data[index]
return { [itemKey]: item.embedding }
})
writeFileSync("embedding.json1", JSON.stringify(manageEmbedding))
}
main();
Other files Link
https://github.com/anil-sidhu/gen-ai-with-node-js/blob/embeddings-basic/embedding.json
https://github.com/anil-sidhu/gen-ai-with-node-js/blob/embeddings-basic/embedding1.json