All Posts

  • This article explores the evolution from Transformers to Large Language Models (LLMs), detailing the mechanisms of self-attentiBut greedy decoding is **short-sighted** - Can get trapped in local minima (good "local" choice of token, but poor text at the end, with no way to backtrack)n and multi-head attention, the role of position embeddings, various types of transformer models, and the training and fine-tuning processes of LLMs.

    Blog Cover
    Read more →
  • In this article, we delve into Vector Databases by using Pinecone and explore the fundamentals of vector embeddings, indexes, and essential components of these databases. Furthermore, it will provide a guide on setting up a Vector Database on Pinecone, walking through the installation process, obtaining API keys, and initializing client connections.

    Blog Cover
    Read more →
  • A data visualization, while creatively pleasing, should also serve a functional purpose in effectively communicating data - which refer as combining both art and science. In this context, we can refer to data visualization as a modern art form. Instead of providing step-by-step instructions for enhancing your dashboard, this article will introduce seven design principles as a solid foundation for this “modern art” field.

    Blog Cover
    Read more →