Let's install a completely local ChatGPT-like bot on an Android phone - with a few commands, sorry iPhone people.. >>> The Q&A
September 30, 2024 #ollama #A.I. #Chatbots #Generative A.I. #LocalLlama #Android LLMs #klog.website #Large Language Models #ollama #ChatGPT #Open Source Large Language Models #K_log WebsiteThere is no stupid questions any sort of clearing out or connecting the dots you want to do is welcome. We have premium access and usually early access to all the latest and greatest models and chatbots as well so if you want to know what one of their answers might look like is and how they perform, just mention it when you ask the question. Send a message on matrix or Instagram. You can stay anonymous or just use some nickname as well!
Q : So what is Ollama?
A : Ollama is a wrapper / framework for another framework / library that kinda became it's own framework. (Yeah I know) And LLMs are just binary files at he end of the day so you need a way of reading / executing them. ChatGPT is essentially Google's idea ( Transformers paper )with facebook's framework ( Pytorch which by the way is much more complete than Ollama. Because it allows for the training / making of LLM files not just using them ). And because ChatGPT ( Or any LLM ) is just a clever way mapping out the text values to numerical ones and trying to continue the sequence based on everything you mapped out until then ("The training phase" - By the way there's a lot of human tweaking, labeling and fine-tuning that goes into the training phase ( the mapping ) before getting something like ChatGPT, which is probably not even a single LLM.. Just so you don't think something like that mimics human responses and human interaction this well just develops randomly. So in short Ollama is like a book, computer or even a phone as you saw now, that let's you read your clever way of mapping and interacting with numbers. Pytorch would be more like a backpack with books, pens and pencils in this analogy but it's far from perfect.. We will be going over many tools so get your nix with flakes ready if you wanna.
Q : So what is Nix?
A :You can think of Nix as something like an app store it just works on a much lower level. We have an entire post about it so do check it out!