In this article we show how to leverage a Large Language Model and a Vector Database to search private data without touching the internet. Why worry? Well, for instance, 11% of data employees paste into ChatGPT is confidential! On premise AI for business is not as difficult as it may sound… This article will guide […]
We’ll convert png to jpg, but the same concept will apply to doing the reverse of this. You can grab png datasets from Kaggle If you just want to skip to the code, check out these links: What is a JPEG ? Let’s first understand the structure of a *.jpg file The structure of a […]
Introduction FastEmbed is a lightweight and fast Python library designed for generating high-quality text embeddings. FastEmbed supports a variety of popular text models and is continuously expanding to include more. At its core, FastEmbed utilizes the Flag Embedding model from the MTEB leaderboard, offering distinct “query” and “passage” prefixes for input text. This feature makes […]
Introduction In this guide, we will compare Rust and Python for asynchronous and multithreaded operations, particularly focusing on uploading data to a Qdrant vector search engine. We will evaluate how using Arc in Rust and AsyncQdrantClient in Python impacts performance. Imagine you get approached by a company to speed up their code and you improve […]
Rust is an ideal choice for image preprocessing due to its combination of performance, safety, and concurrency. Its low-level control allows for highly efficient image manipulation, crucial for handling large datasets or performing complex transformations. Image preprocessing involves transforming raw image data into a format that is usable and meaningful. If you want a fast […]
To begin with, when learning about ML/AI you may just use the model specified in the tutorial you’re doing, but later on you’ll want to research, test, and evaluate different models based on size, performance and write your code to suit. Let’s compare output using 2 different models that I used in a recent project […]
Webdock – Fast Cloud VPS Linux Hosting Introduction Let’s see how to create a text similarity search web app using Flask, a pre-trained BERT model, and FAISS for efficient similarity search! Section 1: Importing Libraries “First, we need to import all the necessary libraries. We’ll be using Flask to create our web application, Hugging Face’s […]
This article describes a Python script that leverages LangChain, Qdrant, and the GPT-3.5 Turbo model to perform question-answering on text data. The script combines various libraries to create an end-to-end pipeline for text retrieval and question answering. Overview The provided Python script showcases how to integrate multiple libraries to build a powerful question-answering system: Prerequisites […]
This article describes a Python script that demonstrates how to efficiently process text data, create embeddings, and upsert the embeddings into a Qdrant database using Python. Overview In today’s era of big data and machine learning, efficient text processing and vectorization are crucial for various natural language processing (NLP) tasks. The provided Python script showcases […]
