embedchain

PyPI Slack Discord Twitter Substack Open in Colab codecov

Embedchain is a Data Platform for LLMs - load, index, retrieve, and sync any unstructured data. Using embedchain, you can easily create LLM powered apps over any data. If you want a javascript version, check out embedchain-js

Community

  • Join embedchain community on slack by accepting this invite

馃 Schedule a 1-on-1 Session

Book a 1-on-1 Session with Taranjeet, the founder, to discuss any issues, provide feedback, or explore how we can improve Embedchain for you.

馃敡 Quick install

pip install --upgrade embedchain

馃攳 Demo

Try out embedchain in your browser:

Open in Colab

馃摉 Documentation

The documentation for embedchain can be found at docs.embedchain.ai.

馃捇 Usage

Embedchain empowers you to create ChatGPT like apps, on your own dynamic dataset.

Data Types Supported

  • Youtube video
  • PDF file
  • Web page
  • Sitemap
  • Doc file
  • JSON file
  • Code documentation website loader
  • Notion
  • Unstructured file loader and many more

You can find the full list of data types on our documentation.

Queries

For example, you can use Embedchain to create an Elon Musk bot using the following code:

import os
from embedchain import App

# Create a bot instance
os.environ["OPENAI_API_KEY"] = "YOUR API KEY"
elon_bot = App()

# Embed online resources
elon_bot.add("https://en.wikipedia.org/wiki/Elon_Musk")
elon_bot.add("https://www.forbes.com/profile/elon-musk")
elon_bot.add("https://www.youtube.com/watch?v=RcYjXbSJBN8")

# Query the bot
elon_bot.query("How many companies does Elon Musk run and name those?")
# Answer: Elon Musk currently runs several companies. As of my knowledge, he is the CEO and lead designer of SpaceX, the CEO and product architect of Tesla, Inc., the CEO and founder of Neuralink, and the CEO and founder of The Boring Company. However, please note that this information may change over time, so it's always good to verify the latest updates.

Examples

LLMGoogle ColabReplit
OpenAIOpen In ColabTry with Replit Badge
AnthropicOpen In ColabTry with Replit Badge
Azure OpenAIOpen In ColabTry with Replit Badge
VertexAIOpen In ColabTry with Replit Badge
CohereOpen In ColabTry with Replit Badge
Hugging FaceOpen In ColabTry with Replit Badge
JinaChatOpen In ColabTry with Replit Badge
GPT4AllOpen In ColabTry with Replit Badge
Llama2Open In ColabTry with Replit Badge
Embedding modelGoogle ColabReplit
OpenAIOpen In ColabTry with Replit Badge
VertexAIOpen In ColabTry with Replit Badge
GPT4AllOpen In ColabTry with Replit Badge
Hugging FaceOpen In ColabTry with Replit Badge
Vector DBGoogle ColabReplit
ChromaDBOpen In ColabTry with Replit Badge
ElasticsearchOpen In ColabTry with Replit Badge
OpensearchOpen In ColabTry with Replit Badge
PineconeOpen In ColabTry with Replit Badge

馃 Contributing

Contributions are welcome! Please check out the issues on the repository, and feel free to open a pull request. For more information, please see the contributing guidelines.

For more reference, please go through Development Guide and Documentation Guide.

Telemetry

We collect anonymous usage metrics to enhance our package's quality and user experience. This includes data like feature usage frequency and system info, but never personal details. The data helps us prioritize improvements and ensure compatibility. If you wish to opt-out, set the app.config.collect_metrics = False in the code. We prioritize data security and don't share this data externally.

Citation

If you utilize this repository, please consider citing it with:

@misc{embedchain,
  author = {Taranjeet Singh, Deshraj Yadav},
  title = {Embedchain: Data platform for LLMs - load, index, retrieve, and sync any unstructured data},
  year = {2023},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{https://github.com/embedchain/embedchain}},
}