AnalogGPT

AnalogGPT is a Large Language Model that runs fully on the paper.

Explore the docs »

View Demo · Report Bug · Request Feature

_{This is the Youtube Video about AnalogGPT!}

Table of Contents

1. About The Project
   • Built With
2. Getting Started
   • Prerequisites
   • Installation
3. Contributing
4. Contact

About The Project

🚨 To download the PDF file, please hit a star on this repo, then click AnalogGPT.pdf, press download raw file button on the upper right corner.

🥫 These days, a lot of companies and even countries are trying to get their hands on GPUs. Modern AI needs a ton of GPU power for calculation. But imagine this — what if there’s a large language model that doesn’t need a GPU at all? Or even run without a computer? I created AnalogGPT which is a fully paper-based version of GPT built from scratch.

🚀 Via AnalogGPT you can fully understand how Generative Pretrained Transformer works by calculating with your bare hands. You are becoming a GPU that calculates these numbers. As the model size is 15K, it's representation capacity is limited. I'll notify the hyper parameters below. Feel free to modify my code and test various things.

(back to top)

Key Features

🖥️ [No GPU] You don't need a GPU or even computer to run this model.
💡 [Learn how Transformer works] With calculating with your bare hands, you can understand what attention is.
🔧 [Next Token Prediction] This is dedicated for next token prediction task.

Built With

• 
• 

(back to top)

Prerequisites

💫 Before using, please hit star on this repo!
📜 You can download the PDF from github
If you want to modify the code or train more, follow the following steps.

Installation

1. Clone the repo

   git clone https://github.com/DutchVandaline/Analog_GPT.git

2. Excecute on PyCharm
3. Use your code to modify the model.

(back to top)

Contributing

If you liked this project, please buy me a coffee! It helps me do creative stuffs.

Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.

If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement". Don't forget to give the project a star! Thanks again!

1. Fork the Project
2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
3. Commit your Changes (git commit -m 'Add some AmazingFeature')
4. Push to the Branch (git push origin feature/AmazingFeature)
5. Open a Pull Request

(back to top)

Contact

Dutch Vanaline - developerha0013@gmail.com

Project Link: https://github.com/DutchVandaline?tab=repositories

(back to top)