Generative AI with Node JS in Hindi #21 What is Embedding

Embedding


Steps of video:-

  1. What is Embedding
  2. How it work with Ml
  3. Generate embedding with openAI


What is Embedding:-

  1. Convert Data (words or images, or anything) into numbers so a computer can understand their meaning.
  2. Vector help them to make relation between data, compare, categories etc


We can Store embedding in Vector Databases

Pinecone, Weaviate, Milvus, Qdrant, FAISS



Operations

  1. Insert
  2. Similarity Search
  3. Distance Metrics
  4. Update
  5. Delete
  6. Filter


Index.js Code


import OpenAI from "openai";
import dotenv from 'dotenv'
import { writeFileSync } from 'fs'
dotenv.config();
const client = new OpenAI({ apiKey: process.env.openAI_Key })
const data = ["cat", "dog", "apple"]
async function main() {

const response = await client.embeddings.create({
model: "text-embedding-3-small",
input: data
})

const manageEmbedding = response.data.map((item, index) => {
const itemKey = data[index]
return { [itemKey]: item.embedding }
})

writeFileSync("embedding.json1", JSON.stringify(manageEmbedding))

}

main();


Other files Link

https://github.com/anil-sidhu/gen-ai-with-node-js/blob/embeddings-basic/embedding.json

https://github.com/anil-sidhu/gen-ai-with-node-js/blob/embeddings-basic/embedding1.json