Date:

Share:

GPT on Arch Linux – Jeremy’s Programming Blog

Related Articles

Last updated: April 14, 2023


So you want to run your own GPT on your computer? As well.

so how much LLaMA models are available (if you have a 24G graphics card) and other ways to do it, but GPT4All promises to be a different kind of solution. I seen This tweet And had to check it out.

So who runs a binary file on their computer from some rando on the internet? Usually, not me. However, Brian Rommel Seems like a legit guy, and a lot of people I respect follow him. So I decided to trust it and run it on my laptop. You may not. If so, run it in a VM or Tails or something.

Here is some more information on GPT4All.

From their website:

GPT4All Chat is a native AI chat application powered by the licensed GPT4All-J Apache 2 chatbot. The model runs on your computer’s CPU, works without an internet connection and does not send chat data to external servers (unless Yes you have chosen to use your chat data to improve future GPT4All models). It allows you to interact with a large language model (LLM) to get helpful answers, insights, and suggestions. GPT4All Chat is available for Windows, Linux and macOS.

You can get it for:

I decided to try it on Arch Linux, because of course. let’s move

installation

Installation is super easy. Below are the steps.

I downloaded the file from here.

Activate the following:

chmod +x gpt4all-0.1.0-Linux.run
./gpt4all-0.1.0-Linux.run

It brings up this screen:

Tap “Next”.

Register this folder. In my case, it was /opt/gpt4all 0.1.0
You will need this location to run it.

Choose your components (just one for now)

Accept the agreement (GNU Public License)

And it is ready to install.

Take your favorite drink.

In the tweet, it said 20 minutes, but it took less than 10 minutes (about 6) with my laptop with the following specs:

  • Intel Core i7-11800H 4600 MHz
  • 32G memory
  • NVME

Your results will change, but it didn’t take long.

Great party time. we are done Let’s dig.

Running the GPT4All app.

So let’s move on to /opt/gpt4all 0.1.0

cd /opt/gpt4all 0.1.0/
cd bin
./chat

You will see this in your terminal:

And it loads immediately:

Asking GPT4All a question

My first question:

Act as a super awesome professional Linux developer. Tell me how I can check my last 50 system messages my core

Amazing, this gave me an answer:

To check for the last 50 system messages your kernel put out, you can follow these steps:

1. Open your terminal on your Linux machine.
2. Type the command `dmesg -s' (with a lowercase "s"). This will give you a summary of all the system messages that your kernel has put out.
3. Look for the system messages that have the word "system" in them. You can do this by filtering the output of the command. For example, to only show system messages, type the command `dmesg -s | grep system`.
4. Once you have the list of system messages, you can scroll through them to find the last 50 messages. To do this, you can use the command `dmesg | tail -n 50`. This will show you the last 50 system messages.
5. You can also use the command `last 50 system messages` to get a list of the last 50 system messages.

Well, let’s try it.

Verification of results

So I did the first step, I opened the terminal. Then step 2:

  1. Type the command `dmesg -s’ (with a lowercase “s”). This will give you a summary of all the system messages your kernel has issued

So I ran this:

Aww. sad trumpet While GPT4All was technically correct, you need to put in a buffer size:

Not bad, maybe it’s my fault. I will change the prompt a bit.

Act as a super awesome professional Linux developer. Tell me how I can check my last 50 system messages sent on Arch Linux.

This gives me a different result:

To check for the last 50 system messages in Arch Linux, you can follow these steps:

1. Open your terminal on your Linux machine.
2. Type the command `dmesg | tail -n 50 | grep "system"`. This will show you the last 50 system messages.
3. You can also use the command `last 50 system messages` to get a list of the last 50 system messages.

Note: The "system" keyword in the `dmesg` output should be enough to find the last 50 system messages. However, if you want to make sure that you have not missed any messages, you can also use the command `dmesg -k | grep "system"` to search for any kernel messages related to system activities.

ok cool Let’s try it.

Oops, I guess I should use sudo.

Hey! it worked. I can forgive this small oversight simply because it’s trained on text from the web, and there are hardly any tutorials that tell you to use sudo for this.

moving on

Let’s try

last 50 system messages

I have never used this command in my life, so let’s see:

Okay, well, there’s a wtmp message in there. This is a system log file that keeps records of user logins. I just started this machine, so it makes sense.

However, I know there are more core messages than just this one. So I will check the comments:

Note: The keyword “system” in dmesg The output should be enough to find the last 50 system messages. However, if you want to make sure you haven’t missed any messages, you can also use the command dmesg -k | grep "system" to search for kernel messages related to system activities.

Again, I have to use sudo to this:

sudo dmesg -k | grep "system"

Amazing. This is also a core message!. Actually, this is a kernel log message related to file system synchronization. There are a lot of them because it’s been tracking sync since I uploaded (which wasn’t long ago).

And this particular command is one I’ve used quite a bit. So nice to see it here as an answer.

Good job GPT4All.

Explain your answers

So let’s see how well that explains the answers he just gave me.

explain in detail how "last 50 system messages" works

Since I’ve never used this command, I’m really curious about it.

the answer:

The "last 50 system messages" command is used to show a list of the last 50 system messages that have been put out by the kernel on your Linux machine. To get this list, you can use the `dmesg` command with the `-s' option to search for system-related messages. This will give you a summary of all the system-related messages that your kernel has put out.

After running the `dmesg -s' command, you can scroll through the output of `dmesg` to find the last 50 system messages. These messages will have the keyword "system" in them, and will have been put out by the kernel. You can then use the `last 50 system messages` command to show you the last 50 system messages your kernel has put out.

If you need to search for system-related messages that have not been mentioned in the output, you can use the command `dmesg -k | grep "system"` to search for any messages related to system activities. This will give you a complete list of system-related messages, which you can then use to find the last 50 system messages.

Ok, so it looks like it’s an alias of `dmesg -s’ with some arbitrary value thrown in. Cool. now I know.

Summary

Here is my short experience with “ChatGPT on Desktop”. Of course I will dig a lot more. I admit I know nothing about how it works under the covers. It even says it works offline. I tried it. I disconnected the internet and sent this:

Briefly explain how large language models work so that a middle school student can understand it

Okay, I’m officially shocked. As you can see in my screenshot, I don’t have an internet connection, but it still spits out an explanation.

How It Works? I have no idea.

Who is multi And how do they make money? I have no idea.

My guess is, it’s using some API for the GPT model, and some clever local cache stuff. They probably release it for free but will charge later. It’s fair. If I get great results from it, I’ll happily pay a reasonable fee to use it.

So, I’ll keep hitting it and see what I can get out of it. I will share my results here.

Thanks for reading!

Questions? Remarks? Yell at me!


Source

Popular Articles