mirror of
http://git.nowherejezfoltodf4jiyl6r56jnzintap5vyjlia7fkirfsnfizflqd.onion/nihilist/blog-contributions.git
synced 2025-07-02 06:36:40 +00:00
[wip] almost there
This commit is contained in:
parent
c8be7d5a46
commit
ffe1b1838e
2 changed files with 244 additions and 96 deletions
|
|
@ -191,7 +191,7 @@ For 8B model, we would require around 6 GB VRAM/RAM to comfortably run it as Q4_
|
|||
<p>
|
||||
<b>Context size</b><br>
|
||||
Context size is the number of tokens that LLM remembers from previous messages to generate a response. It's usually measured in tokens.<br>
|
||||
In ollama it's usually set to 2048 tokens, which is around 1200 words or 6 kilobytes of text. With larger sizes, more memory is required to store the context. Also, the models have a context size limit (ex. 16k tokens for Phi-4, 128k for Gemma 3).
|
||||
In ollama it's usually set to 2048 tokens, which is around 1200 words or 6 kilobytes of text. With larger sizes, more memory is required to store the context. Also, the models have a context size limit (ex. 16k tokens for Phi4, 128k for Gemma 3).
|
||||
If the context size is too small, the LLM may forget what it was doing before. Take a look at this simplified example:<br>
|
||||
<img src="7.png" class="imgRz"><br><br>
|
||||
In order to generate a correct response, the entire prompt should fit into the context window:<br>
|
||||
|
|
@ -201,8 +201,81 @@ We'll show how to check prompt length and set appropriate context size in Open W
|
|||
</p>
|
||||
|
||||
<p>
|
||||
<b>Model recommendations</b><br>
|
||||
[table that I accidentally deleted...]
|
||||
<b>Open LLMs Past and Present</b><br>
|
||||
|
||||
Ever since <a href="https://www.theverge.com/2023/3/8/23629362/meta-ai-language-model-llama-leak-online-misuse">LLaMA 1 was leaked</a> on 4chan in February 2023, we started seeing more and more companies caring about so called "open" LLMs. Those can be downloaded and run on users computer without any restrictions.<br>
|
||||
In early 2025 we also heard A LOT about deepseek-r1. An open reasoning LLM that tried to compete with OpenAI's ChatGPT. While it wasn't Deepseeks first model (their earlier work includes deepseek-coder, deepseek-v2.5 MoE and deepseek-v3), the hype was global. It brought a lot of attention to open LLM ecosystem and made proprietary AI companies loose billions.<br>
|
||||
|
||||
Personally, I was interested in Open LLMs since their inception - when ollama project based on llama.cpp was born. Here're some of my picks for best self-hostable models currently available on ollama:
|
||||
|
||||
<table>
|
||||
<tr>
|
||||
<td></td>
|
||||
<td>Gemma 3</td>
|
||||
<td>Phi4</td>
|
||||
<td>Granite 3.2*</td>
|
||||
<td>Qwen 2.5</td>
|
||||
<td>llama 3.1</td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td>Trained by</td>
|
||||
<td>Google</td>
|
||||
<td>Microsoft</td>
|
||||
<td>IBM</td>
|
||||
<td>Alibaba</td>
|
||||
<td>Meta</td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td>Released on</td>
|
||||
<td>03-2025</td>
|
||||
<td>12-2024</td>
|
||||
<td>02-2025</td>
|
||||
<td>09-2024</td>
|
||||
<td>07-2024</td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td>Parameter count</td>
|
||||
<td>12B</td>
|
||||
<td>14B</td>
|
||||
<td>8B</td>
|
||||
<td>14B</td>
|
||||
<td>8B</td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td>Size (Q4_K_M)</td>
|
||||
<td>8.1 GB</td>
|
||||
<td>9.1 GB</td>
|
||||
<td>4.9 GB</td>
|
||||
<td>9.0 GB</td>
|
||||
<td>4.9 GB</td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td>Other variants</td>
|
||||
<td>1B, 4B, 27B</td>
|
||||
<td>Phi4-mini 4B</td>
|
||||
<td>Vision 2B, 2B</td>
|
||||
<td>0.5B, 1.5B, 3B, 7B, 32B, 72B, Qwen-coder</td>
|
||||
<td>70B, 405B</td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td>Good at</td>
|
||||
<td>Reasoning, explaining concepts, light programming, vision, translation</td>
|
||||
<td>Instruction following, programming, complex tasks, translation</td>
|
||||
<td>General tasks, light programming, translation</td>
|
||||
<td>Translation, general tasks</td>
|
||||
<td>General tasks</td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td>Bad at</td>
|
||||
<td>-</td>
|
||||
<td>-</td>
|
||||
<td>Complex tasks</td>
|
||||
<td>Instruction following</td>
|
||||
<td>Complex tasks, instruction following</td>
|
||||
</tr>
|
||||
</table>
|
||||
<br>
|
||||
* - while I was writing this tutorial, Granite 3.3 was released
|
||||
</p>
|
||||
</div>
|
||||
</div><!-- /row -->
|
||||
|
|
@ -232,7 +305,7 @@ We'll show how to check prompt length and set appropriate context size in Open W
|
|||
<div class="row">
|
||||
<div class="col-lg-8 col-lg-offset-2">
|
||||
<h2><b>Prerequisites</b></h2>
|
||||
<p>To follow this tutorial, you'll need a system running Debian 12. Although ollama can work on CPU only, the performance will be much worse than having model that fits in GPU's VRAM.<br>
|
||||
<p>To follow this tutorial, you'll need an AMD64 system running Debian 12. Although ollama can work on CPU only, the performance will be much worse than having model that fits in GPU's VRAM.<br>
|
||||
To comfortably use an 8B model, it's strongly advised to have a dedicated GPU with at least 6GB of VRAM. You can check the supported GPU models <a href="https://github.com/ollama/ollama/blob/main/docs/gpu.md">here</a>.</p>
|
||||
<p>This tutorial showcases ollama setup with Nvidia drivers, but AMD GPUs are also supported.</p>
|
||||
<p>If you want to expose Open WebUI via Tor to access it remotely, you should have an <a href="../torwebsite/index.html">onion v3 vanity address and Tor installed</a>.</p>
|
||||
|
|
@ -249,7 +322,7 @@ To comfortably use an 8B model, it's strongly advised to have a dedicated GPU wi
|
|||
<div class="col-lg-8 col-lg-offset-2">
|
||||
<h2><b>Docker Setup</b></h2>
|
||||
<p>To install Docker, follow the official guide: <a href="https://docs.docker.com/engine/install/debian/">Install Docker Engine on Debian</a>. After installation, add your user to the docker group:</p>
|
||||
<pre><code class="nim">oxeo@andromeda:~$ /sbin/usermod -aG docker oxeo
|
||||
<pre><code class="nim">oxeo@andromeda:~$ sudo /sbin/usermod -aG docker oxeo
|
||||
oxeo@andromeda:~$ sudo systemctl enable docker
|
||||
</code></pre>
|
||||
<p>This ensures you can manage Docker without needing sudo privileges. Finally, reboot your system.</p>
|
||||
|
|
@ -266,20 +339,91 @@ oxeo@andromeda:~$ sudo systemctl enable docker
|
|||
<div class="col-lg-8 col-lg-offset-2">
|
||||
<h2><b>Nvidia Driver and Container Toolkit</b></h2>
|
||||
<p>Update your package list to include "contrib non-free" at the end of every line in <b>/etc/apt/sources.list</b>:</p>
|
||||
<pre><code class="nim">deb http://deb.debian.org/debian/ bookworm main contrib non-free
|
||||
deb-src http://deb.debian.org/debian/ bookworm main contrib non-free
|
||||
<pre><code class="nim">deb http://deb.debian.org/debian/ bookworm main non-free-firmware non-free contrib
|
||||
deb-src http://deb.debian.org/debian/ bookworm main non-free-firmware non-free contrib
|
||||
|
||||
deb http://security.debian.org/debian-security bookworm-security main contrib non-free
|
||||
deb-src http://security.debian.org/debian-security bookworm-security main contrib non-free
|
||||
</code></pre>
|
||||
<p>Run:</p>
|
||||
deb http://security.debian.org/debian-security bookworm-security main non-free-firmware non-free contrib
|
||||
deb-src http://security.debian.org/debian-security bookworm-security main non-free-firmware non-free contrib
|
||||
|
||||
deb http://deb.debian.org/debian/ bookworm-updates main non-free-firmware non-free contrib
|
||||
deb-src http://deb.debian.org/debian/ bookworm-updates main non-free-firmware non-free contrib</code></pre>
|
||||
|
||||
<p>Now install Nvidia driver and some utilities:</p>
|
||||
<pre><code class="nim">oxeo@andromeda:~$ sudo apt update
|
||||
oxeo@andromeda:~$ sudo apt install linux-headers nvidia-driver firmware-misc-nonfree
|
||||
oxeo@andromeda:~$ sudo apt install gnupg2 curl linux-headers-amd64 nvidia-driver firmware-misc-nonfree
|
||||
</code></pre>
|
||||
<p>To verify installation, execute:</p>
|
||||
<pre><code class="nim">oxeo@andromeda:~$ docker run --rm --runtime=nvidia --gpus all ubuntu nvidia-smi
|
||||
|
||||
<p>Then install Nvidia Container Toolkit as described <a href="https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html">here</a>:</p>
|
||||
<pre><code class="nim">oxeo@andromeda:~$ curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg \
|
||||
&& curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list | \
|
||||
sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g' | \
|
||||
sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list
|
||||
oxeo@andromeda:~$ sudo apt update
|
||||
oxeo@andromeda:~$ sudo apt install nvidia-container-toolkit
|
||||
</code></pre>
|
||||
<p>This command checks if the NVIDIA driver is accessible within Docker.</p>
|
||||
|
||||
<p>Finally, reboot the system:</p>
|
||||
<pre><code class="nim">oxeo@andromeda:~$ sudo systemctl reboot
|
||||
</code></pre>
|
||||
|
||||
<p>To verify driver installation, execute:</p>
|
||||
<pre><code class="nim">oxeo@andromeda:~$ nvidia-smi
|
||||
Fri Apr 18 16:43:30 2025
|
||||
+---------------------------------------------------------------------------------------+
|
||||
| NVIDIA-SMI 535.216.01 Driver Version: 535.216.01 CUDA Version: 12.2 |
|
||||
|-----------------------------------------+----------------------+----------------------+
|
||||
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
|
||||
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
|
||||
| | | MIG M. |
|
||||
|=========================================+======================+======================|
|
||||
| 0 NVIDIA GeForce RTX 3060 On | 00000000:00:10.0 Off | N/A |
|
||||
| 0% 36C P0 37W / 170W | 1MiB / 12288MiB | 0% Default |
|
||||
| | | N/A |
|
||||
+-----------------------------------------+----------------------+----------------------+
|
||||
|
||||
+---------------------------------------------------------------------------------------+
|
||||
| Processes: |
|
||||
| GPU GI CI PID Type Process name GPU Memory |
|
||||
| ID ID Usage |
|
||||
|=======================================================================================|
|
||||
| No running processes found |
|
||||
+---------------------------------------------------------------------------------------+
|
||||
</code></pre>
|
||||
|
||||
<p>And to activate Nvidia support in Docker:</p>
|
||||
<pre><code class="nim">oxeo@andromeda:~$ sudo nvidia-ctk runtime configure --runtime=docker
|
||||
INFO[0000] Config file does not exist; using empty config
|
||||
INFO[0000] Wrote updated config to /etc/docker/daemon.json
|
||||
INFO[0000] It is recommended that docker daemon be restarted.
|
||||
oxeo@andromeda:~$ sudo systemctl restart docker
|
||||
oxeo@andromeda:~$ docker run --rm --runtime=nvidia --gpus all ubuntu nvidia-smi
|
||||
Unable to find image 'ubuntu:latest' locally
|
||||
latest: Pulling from library/ubuntu
|
||||
2726e237d1a3: Pull complete
|
||||
Digest: sha256:1e622c5f073b4f6bfad6632f2616c7f59ef256e96fe78bf6a595d1dc4376ac02
|
||||
Status: Downloaded newer image for ubuntu:latest
|
||||
Fri Apr 18 20:46:43 2025
|
||||
+---------------------------------------------------------------------------------------+
|
||||
| NVIDIA-SMI 535.216.01 Driver Version: 535.216.01 CUDA Version: 12.2 |
|
||||
|-----------------------------------------+----------------------+----------------------+
|
||||
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
|
||||
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
|
||||
| | | MIG M. |
|
||||
|=========================================+======================+======================|
|
||||
| 0 NVIDIA GeForce RTX 3060 On | 00000000:00:10.0 Off | N/A |
|
||||
| 0% 37C P8 11W / 170W | 1MiB / 12288MiB | 0% Default |
|
||||
| | | N/A |
|
||||
+-----------------------------------------+----------------------+----------------------+
|
||||
|
||||
+---------------------------------------------------------------------------------------+
|
||||
| Processes: |
|
||||
| GPU GI CI PID Type Process name GPU Memory |
|
||||
| ID ID Usage |
|
||||
|=======================================================================================|
|
||||
| No running processes found |
|
||||
+---------------------------------------------------------------------------------------+
|
||||
</code></pre>
|
||||
|
||||
</div>
|
||||
</div><!-- /row -->
|
||||
</div> <!-- /container -->
|
||||
|
|
@ -361,7 +505,7 @@ HiddenServicePort 80 127.0.0.1:3000
|
|||
</code></pre>
|
||||
<p>Restart Tor and check the generated hostname:</p>
|
||||
<pre><code class="nim">oxeo@andromeda:~$ sudo systemctl restart tor
|
||||
oxeo@andromeda:~$ cat /var/lib/tor/openwebui_service/hostname
|
||||
oxeo@andromeda:~$ sudo cat /var/lib/tor/openwebui_service/hostname
|
||||
webui3r7zacusoxddubpqriedoljyaiow6plausfwd6hjpjajuydh4id.onion
|
||||
</code></pre>
|
||||
In case of any doubts, we already showcased how to expose hidden service with your custom vanity url <a href="../torwebsite/index.html">here</a>.
|
||||
|
|
@ -469,7 +613,31 @@ We can also see that in our prompt (<i>"What are the benefits and drawbacks of u
|
|||
<img src="22.png" class="imgRz">
|
||||
|
||||
<p><br>
|
||||
With longer prompt, the context window may be filled up which causes the model to forget what was at the beginning of conversation.
|
||||
</p>
|
||||
<img src="26.png">
|
||||
|
||||
<p><br>
|
||||
If <b>prompt_tokens</b> is 2048, we need to increase window size. To do that, click on the settings icon next to the user and change <b>Context Length (Ollama)</b> parameter.
|
||||
</p>
|
||||
<img src="27.png" class="imgRz"><br><br>
|
||||
<img src="29.png">
|
||||
|
||||
<p><br>
|
||||
Here, we see the <b>prompt_tokens</b> is now less than the context window size we set. This means entire prompt was evaluated without truncating anything. However this comes with the expense of slightly higher memory usage. Here you can see a comparison between <b>context_size=2048</b> and <b>context_size=8192</b>:<br>
|
||||
<img src="25.png">
|
||||
<img src="28.png">
|
||||
</p>
|
||||
|
||||
<p>
|
||||
It's also worth noting Gemma3 is a <b>multimodal</b> model which effectively means it can understand text as well as images. There're only a few other open models with vision capabilities including llama 3.2 9B and granite3.2 vision 2B.
|
||||
</p>
|
||||
<img src="23.png" class="imgRz">
|
||||
|
||||
<p><br>
|
||||
Finally - all your past conversations will be visible in the sidepanel on the left. You can search them by keywords or remove sensitive ones.
|
||||
</p>
|
||||
<img src="24.png" class="imgRz">
|
||||
|
||||
</div>
|
||||
</div><!-- /row -->
|
||||
|
|
@ -510,9 +678,8 @@ f.close()
|
|||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
Don't output anything more than the corrected script.
|
||||
|
||||
```python
|
||||
Don't output anything more than the corrected script.</code></pre>
|
||||
<pre><code class="nim">```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
from io import BytesIO
|
||||
|
|
@ -524,8 +691,7 @@ for byte in f.read():
|
|||
f.close()
|
||||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
</code></pre>
|
||||
```</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q4 - Russian-English translation</summary>
|
||||
|
|
@ -533,9 +699,8 @@ print(bio.read())
|
|||
```
|
||||
Заметил что через какое-то время перестает работать i2pd. Пока не перезапустишь сервис, либо не нажмешь в админке перезагрузку конфигов. Это известный баг? Или я что-то не так настроил?Обновился до последней версии. Ни чего не поменялось. У меня. mac os сборка. Из интересного даже локал хост с консолью не открывается, точнее он это делает раз через раз. Но когда открывается показывает что тунели есть. Ведет себя буд-то утечка памяти, или что то такое.
|
||||
```
|
||||
Only output the translation, nothing else.
|
||||
|
||||
I've noticed that I2pd stops working after a while. I have to restart the service or reload the configuration in the admin panel to get it working again. Is this a known bug? Or am I configuring something incorrectly? I updated to the latest version, and nothing has changed. I'm running on macOS. Interestingly, even localhost with the console doesn't open consistently; it works sometimes, but when it does, it shows that tunnels are present. It behaves as if there's a memory leak or something like that.
|
||||
Only output the translation, nothing else.</code></pre>
|
||||
<pre><code class="nim">I've noticed that I2pd stops working after a while. I have to restart the service or reload the configuration in the admin panel to get it working again. Is this a known bug? Or am I configuring something incorrectly? I updated to the latest version, and nothing has changed. I'm running on macOS. Interestingly, even localhost with the console doesn't open consistently; it works sometimes, but when it does, it shows that tunnels are present. It behaves as if there's a memory leak or something like that.
|
||||
</code></pre>
|
||||
</details>
|
||||
</p>
|
||||
|
|
@ -544,15 +709,15 @@ I've noticed that I2pd stops working after a while. I have to restart the servic
|
|||
<h2>Gemma3 (4B)</h2>
|
||||
<details class="bg-green">
|
||||
<summary>Q1 - Why is the water blue?</summary>
|
||||
<pre><code class="nim">> Why is the water blue? Answer in few short sentences.
|
||||
Water appears blue due to a phenomenon called Rayleigh scattering. Sunlight is made of all colors, and when it hits water molecules, shorter wavelengths like blue and violet are scattered more than longer wavelengths. Our eyes perceive this scattered blue light, making water look blue.
|
||||
<pre><code class="nim">> Why is the water blue? Answer in few short sentences.</code></pre>
|
||||
<pre><code class="nim">Water appears blue due to a phenomenon called Rayleigh scattering. Sunlight is made of all colors, and when it hits water molecules, shorter wavelengths like blue and violet are scattered more than longer wavelengths. Our eyes perceive this scattered blue light, making water look blue.
|
||||
|
||||
Essentially, the water is scattering sunlight, and blue light is scattered more effectively than other colors.</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q2 - Tor vs VPN</summary>
|
||||
<pre><code class="nim">> How does Tor differ from a VPN service? Is it better for privacy? Answer in few short sentences.
|
||||
Okay, here's a breakdown of the differences and privacy comparison:
|
||||
<pre><code class="nim">> How does Tor differ from a VPN service? Is it better for privacy? Answer in few short sentences.</code></pre>
|
||||
<pre><code class="nim">Okay, here's a breakdown of the differences and privacy comparison:
|
||||
|
||||
Tor (The Onion Router) and VPNs (Virtual Private Networks) both enhance online privacy, but they do so in different ways. A VPN encrypts your internet traffic and routes it through a single server, masking your IP address from websites. Tor, on the other hand, bounces your traffic through a network of relays, making it far more difficult to trace your activity back to you. Tor is generally considered better for overall privacy due to its layered encryption and distributed nature, while a VPN primarily focuses on protecting your connection between your device and the VPN server.</code></pre>
|
||||
</details>
|
||||
|
|
@ -570,9 +735,8 @@ f.close()
|
|||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
Don't output anything more than the corrected script.
|
||||
|
||||
```python
|
||||
Don't output anything more than the corrected script.</code></pre>
|
||||
<pre><code class="nim">```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
from io import BytesIO
|
||||
|
|
@ -584,8 +748,7 @@ for byte in f.read():
|
|||
f.close()
|
||||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
</code></pre>
|
||||
```</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q4 - Russian-English translation</summary>
|
||||
|
|
@ -593,9 +756,8 @@ print(bio.read())
|
|||
```
|
||||
Заметил что через какое-то время перестает работать i2pd. Пока не перезапустишь сервис, либо не нажмешь в админке перезагрузку конфигов. Это известный баг? Или я что-то не так настроил?Обновился до последней версии. Ни чего не поменялось. У меня. mac os сборка. Из интересного даже локал хост с консолью не открывается, точнее он это делает раз через раз. Но когда открывается показывает что тунели есть. Ведет себя буд-то утечка памяти, или что то такое.
|
||||
```
|
||||
Only output the translation, nothing else.
|
||||
|
||||
I’ve noticed that i2pd stops working after a certain period of time. It only stops working until I restart the service or reload the configs in the admin panel. Is this a known bug? Or am I doing something wrong? I updated to the latest version and nothing changed. I have a macOS build. Interestingly, even localhost with the console doesn’t open, rather it does this sporadically. But when it opens, it shows that the tunnels are present. It acts as if there’s a memory leak, or something like that.
|
||||
Only output the translation, nothing else.</code></pre>
|
||||
<pre><code class="nim">I’ve noticed that i2pd stops working after a certain period of time. It only stops working until I restart the service or reload the configs in the admin panel. Is this a known bug? Or am I doing something wrong? I updated to the latest version and nothing changed. I have a macOS build. Interestingly, even localhost with the console doesn’t open, rather it does this sporadically. But when it opens, it shows that the tunnels are present. It acts as if there’s a memory leak, or something like that.
|
||||
</code></pre>
|
||||
</details>
|
||||
</p>
|
||||
|
|
@ -604,13 +766,14 @@ I’ve noticed that i2pd stops working after a certain period of time. It only s
|
|||
<h2>Gemma3 (1B)</h2>
|
||||
<details class="bg-green">
|
||||
<summary>Q1 - Why is the water blue?</summary>
|
||||
<pre><code class="nim">> Why is the water blue? Answer in few short sentences.
|
||||
Water appears blue due to the way sunlight interacts with its molecules. Water molecules absorb red and yellow light, but they reflect blue light, making it appear blue to our eyes.</code></pre>
|
||||
<pre><code class="nim">> Why is the water blue? Answer in few short sentences.</code></pre>
|
||||
<pre><code class="nim">Water appears blue due to the way sunlight interacts with its molecules. Water molecules absorb red and yellow light, but they reflect blue light, making it appear blue to our eyes.</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q2 - Tor vs VPN</summary>
|
||||
<pre><code class="nim">> How does Tor differ from a VPN service? Is it better for privacy? Answer in few short sentences.
|
||||
Tor is a decentralized network that routes traffic through multiple relays, offering stronger anonymity but slower speeds. A VPN encrypts your internet traffic and routes it through a server, masking your IP address but potentially less secure. Ultimately, Tor is generally considered better for privacy due to its focus on anonymity, while a VPN provides a more convenient and faster solution.</code></pre>
|
||||
Tor is a decentralized network that routes traffic through multiple relays, offering stronger anonymity but slower speeds.</code></pre>
|
||||
<pre><code class="nim">A VPN encrypts your internet traffic and routes it through a server, masking your IP address but potentially less secure. Ultimately, Tor is generally considered better for privacy due to its focus on anonymity, while a VPN provides a more convenient and faster solution.</code></pre>
|
||||
</details>
|
||||
<details class="bg-red">
|
||||
<summary>Q3 - Fixing Python script</summary>
|
||||
|
|
@ -626,9 +789,8 @@ f.close()
|
|||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
Don't output anything more than the corrected script.
|
||||
|
||||
```python
|
||||
Don't output anything more than the corrected script.</code></pre>
|
||||
<pre><code class="nim">```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
f = open('a.txt', 'r')
|
||||
|
|
@ -636,19 +798,16 @@ bio = io.BytesIO(f.read())
|
|||
for byte in bio:
|
||||
bio.seek(0)
|
||||
print(byte)
|
||||
```
|
||||
</code></pre>
|
||||
```</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q4 - Russian-English translation</summary>
|
||||
<pre><code class="nim">> Translate to english:
|
||||
<pre><code class="nim">> Translate to english:
|
||||
```
|
||||
Заметил что через какое-то время перестает работать i2pd. Пока не перезапустишь сервис, либо не нажмешь в админке перезагрузку конфигов. Это известный баг? Или я что-то не так настроил?Обновился до последней версии. Ни чего не поменялось. У меня. mac os сборка. Из интересного даже локал хост с консолью не открывается, точнее он это делает раз через раз. Но когда открывается показывает что тунели есть. Ведет себя буд-то утечка памяти, или что то такое.
|
||||
```
|
||||
Only output the translation, nothing else.
|
||||
|
||||
“I’ve noticed that i2pd service stops working after a while. You need to restart the service, or press the admin panel to restart the configuration. Is this a known bug? Or am I setting something wrong? I’ve updated to the latest version. Nothing has changed. I’m on a Mac OS build. Even local host with a console doesn’t open – it happens every time. But when it opens, it shows that tunnels are present. It’s behaving as if it’s leaking memory, or something else. ”
|
||||
</code></pre>
|
||||
Only output the translation, nothing else.</code></pre>
|
||||
<pre><code class="nim">“I’ve noticed that i2pd service stops working after a while. You need to restart the service, or press the admin panel to restart the configuration. Is this a known bug? Or am I setting something wrong? I’ve updated to the latest version. Nothing has changed. I’m on a Mac OS build. Even local host with a console doesn’t open – it happens every time. But when it opens, it shows that tunnels are present. It’s behaving as if it’s leaking memory, or something else. ”</code></pre>
|
||||
</details>
|
||||
</p>
|
||||
|
||||
|
|
@ -656,13 +815,14 @@ Only output the translation, nothing else.
|
|||
<h2>Phi4 (14B)</h2>
|
||||
<details class="bg-green">
|
||||
<summary>Q1 - Why is the water blue?</summary>
|
||||
<pre><code class="nim">> Why is the water blue? Answer in few short sentences.
|
||||
Water appears blue primarily because of how it absorbs and scatters sunlight. Pure water absorbs colors at the red end of the light spectrum more efficiently than those at the blue end, which are scattered and reflected back to our eyes. In large volumes, such as oceans or deep lakes, this effect becomes noticeable, giving water its characteristic blue color. Additionally, substances like algae or minerals in natural bodies of water can enhance the bluish hue.</code></pre>
|
||||
<pre><code class="nim">> Why is the water blue? Answer in few short sentences.</code></pre>
|
||||
<pre><code class="nim">Water appears blue primarily because of how it absorbs and scatters sunlight. Pure water absorbs colors at the red end of the light spectrum more efficiently than those at the blue end, which are scattered and reflected back to our eyes. In large volumes, such as oceans or deep lakes, this effect becomes noticeable, giving water its characteristic blue color. Additionally, substances like algae or minerals in natural bodies of water can enhance the bluish hue.</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q2 - Tor vs VPN</summary>
|
||||
<pre><code class="nim">> How does Tor differ from a VPN service? Is it better for privacy? Answer in few short sentences.
|
||||
Tor (The Onion Router) and VPNs (Virtual Private Networks) both enhance online privacy but operate differently. Tor routes your internet traffic through multiple volunteer-operated servers, encrypting data at each step, to obscure your IP address and location, making it highly effective for anonymous browsing. However, it can be slower due to this multi-layered routing process.
|
||||
</code></pre>
|
||||
<pre><code class="nim">Tor (The Onion Router) and VPNs (Virtual Private Networks) both enhance online privacy but operate differently. Tor routes your internet traffic through multiple volunteer-operated servers, encrypting data at each step, to obscure your IP address and location, making it highly effective for anonymous browsing. However, it can be slower due to this multi-layered routing process.
|
||||
|
||||
In contrast, a VPN encrypts your internet connection between your device and a single server run by the VPN provider, masking your real IP address and allowing you to appear as if you're accessing the internet from the server's location. This is generally faster than Tor but relies on trust in the VPN provider since they can see your traffic.
|
||||
|
||||
|
|
@ -682,9 +842,8 @@ f.close()
|
|||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
Don't output anything more than the corrected script.
|
||||
|
||||
```python
|
||||
Don't output anything more than the corrected script.</code></pre>
|
||||
<pre><code class="nim">```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
|
||||
|
|
@ -697,8 +856,7 @@ for byte in f.read():
|
|||
f.close()
|
||||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
</code></pre>
|
||||
```</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q4 - Russian-English translation</summary>
|
||||
|
|
@ -706,9 +864,8 @@ print(bio.read())
|
|||
```
|
||||
Заметил что через какое-то время перестает работать i2pd. Пока не перезапустишь сервис, либо не нажмешь в админке перезагрузку конфигов. Это известный баг? Или я что-то не так настроил?Обновился до последней версии. Ни чего не поменялось. У меня. mac os сборка. Из интересного даже локал хост с консолью не открывается, точнее он это делает раз через раз. Но когда открывается показывает что тунели есть. Ведет себя буд-то утечка памяти, или что то такое.
|
||||
```
|
||||
Only output the translation, nothing else.
|
||||
|
||||
I've noticed that i2pd stops working after some time. It only resumes when you restart the service or refresh the configuration in the admin panel. Is this a known bug, or is something wrong with my setup? I updated to the latest version, but it hasn't changed anything for me on Mac OS. Interestingly, localhost from the console doesn't consistently open; it works intermittently. When it does open, it shows that tunnels exist. It behaves as if there's a memory leak or something similar.
|
||||
Only output the translation, nothing else.</code></pre>
|
||||
<pre><code class="nim">I've noticed that i2pd stops working after some time. It only resumes when you restart the service or refresh the configuration in the admin panel. Is this a known bug, or is something wrong with my setup? I updated to the latest version, but it hasn't changed anything for me on Mac OS. Interestingly, localhost from the console doesn't consistently open; it works intermittently. When it does open, it shows that tunnels exist. It behaves as if there's a memory leak or something similar.
|
||||
</code></pre>
|
||||
</details>
|
||||
</p>
|
||||
|
|
@ -717,13 +874,13 @@ I've noticed that i2pd stops working after some time. It only resumes when you r
|
|||
<h2>Phi4-mini (4B)</h2>
|
||||
<details class="bg-green">
|
||||
<summary>Q1 - Why is the water blue?</summary>
|
||||
<pre><code class="nim">> Why is the water blue? Answer in few short sentences.
|
||||
Water appears blue because it absorbs light at all other wavelengths more strongly than green, reflecting and transmitting most of that wavelength back to our eyes as we see it shining through or bouncing off its surface. Blue contains a shorter wave length which makes this visible effect stronger compared with longer colors such as red when the water is illuminated by white sunlight.</code></pre>
|
||||
<pre><code class="nim">> Why is the water blue? Answer in few short sentences.</code></pre>
|
||||
<pre><code class="nim">Water appears blue because it absorbs light at all other wavelengths more strongly than green, reflecting and transmitting most of that wavelength back to our eyes as we see it shining through or bouncing off its surface. Blue contains a shorter wave length which makes this visible effect stronger compared with longer colors such as red when the water is illuminated by white sunlight.</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q2 - Tor vs VPN</summary>
|
||||
<pre><code class="nim">> How does Tor differ from a VPN service? Is it better for privacy? Answer in few short sentences.
|
||||
Tor anonymizes internet traffic by routing data through multiple volunteer-operated servers, providing strong anonymity and resisting network surveillance or censorship effectively.
|
||||
<pre><code class="nim">> How does Tor differ from a VPN service? Is it better for privacy? Answer in few short sentences.</code></pre>
|
||||
<pre><code class="nim">Tor anonymizes internet traffic by routing data through multiple volunteer-operated servers, providing strong anonymity and resisting network surveillance or censorship effectively.
|
||||
|
||||
VPN services also encrypt your connection but route all of your device's Internet-bound connections to the selected server; they can bypass geographic restrictions more directly than Tor.
|
||||
|
||||
|
|
@ -748,9 +905,8 @@ f.close()
|
|||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
Don't output anything more than the corrected script.
|
||||
|
||||
```python
|
||||
Don't output anything more than the corrected script.</code></pre>
|
||||
<pre><code class="nim">```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
|
||||
|
|
@ -791,14 +947,12 @@ Make sure your environment has access permissions for reading the file. Adjust a
|
|||
```
|
||||
Заметил что через какое-то время перестает работать i2pd. Пока не перезапустишь сервис, либо не нажмешь в админке перезагрузку конфигов. Это известный баг? Или я что-то не так настроил?Обновился до последней версии. Ни чего не поменялось. У меня. mac os сборка. Из интересного даже локал хост с консолью не открывается, точнее он это делает раз через раз. Но когда открывается показывает что тунели есть. Ведет себя буд-то утечка памяти, или что то такое.
|
||||
```
|
||||
Only output the translation, nothing else.
|
||||
|
||||
Noticed that i2pd stops working after some time unless you restart the service or refresh configurations in admin mode. Is this a known bug? Or did I misconfigure something?
|
||||
Only output the translation, nothing else.</code></pre>
|
||||
<pre><code class="nim">Noticed that i2pd stops working after some time unless you restart the service or refresh configurations in admin mode. Is this a known bug? Or did I misconfigure something?
|
||||
|
||||
Updated to the latest version; no changes were made on my end.
|
||||
|
||||
On macOS build (I'm not sure what it is). Interestingly, even when connecting locally with console doesn't always open - more precisely: it's intermittent behavior but sometimes tunnels are detected which indicates memory leaks or similar issues.
|
||||
</code></pre>
|
||||
On macOS build (I'm not sure what it is). Interestingly, even when connecting locally with console doesn't always open - more precisely: it's intermittent behavior but sometimes tunnels are detected which indicates memory leaks or similar issues.</code></pre>
|
||||
</details>
|
||||
</p>
|
||||
|
||||
|
|
@ -806,13 +960,13 @@ On macOS build (I'm not sure what it is). Interestingly, even when connecting lo
|
|||
<h2>Granite 3.2 (8B)</h2>
|
||||
<details class="bg-green">
|
||||
<summary>Q1 - Why is the water blue?</summary>
|
||||
<pre><code class="nim">> Why is the water blue? Answer in few short sentences.
|
||||
Water itself appears colorless. The blue appearance is due to water absorbing light from all wavelengths except blue, which gets scattered, making it appear blue. This phenomenon is known as Rayleigh scattering.</code></pre>
|
||||
<pre><code class="nim">> Why is the water blue? Answer in few short sentences.</code></pre>
|
||||
<pre><code class="nim">Water itself appears colorless. The blue appearance is due to water absorbing light from all wavelengths except blue, which gets scattered, making it appear blue. This phenomenon is known as Rayleigh scattering.</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q2 - Tor vs VPN</summary>
|
||||
<pre><code class="nim">> How does Tor differ from a VPN service? Is it better for privacy? Answer in few short sentences.
|
||||
Tor and VPNs both enhance online anonymity but function differently. Tor routes traffic through a network of volunteer-operated servers (nodes), encrypting data multiple times, making it harder to trace the origin. A VPN, on the other hand, securely tunnels your internet connection to a server operated by the service provider. While both provide privacy, Tor's multi-layered approach may offer more robust anonymity against sophisticated tracking attempts, although it can be slower and less reliable than a VPN. However, for general online activities, a reputable VPN is usually sufficient and offers better speeds.</code></pre>
|
||||
<pre><code class="nim">> How does Tor differ from a VPN service? Is it better for privacy? Answer in few short sentences.</code></pre>
|
||||
<pre><code class="nim">Tor and VPNs both enhance online anonymity but function differently. Tor routes traffic through a network of volunteer-operated servers (nodes), encrypting data multiple times, making it harder to trace the origin. A VPN, on the other hand, securely tunnels your internet connection to a server operated by the service provider. While both provide privacy, Tor's multi-layered approach may offer more robust anonymity against sophisticated tracking attempts, although it can be slower and less reliable than a VPN. However, for general online activities, a reputable VPN is usually sufficient and offers better speeds.</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q3 - Fixing Python script</summary>
|
||||
|
|
@ -828,9 +982,8 @@ f.close()
|
|||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
Don't output anything more than the corrected script.
|
||||
|
||||
```python
|
||||
Don't output anything more than the corrected script.</code></pre>
|
||||
<pre><code class="nim">```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
import os
|
||||
|
|
@ -841,8 +994,7 @@ with open('a.txt', 'rb') as f:
|
|||
bio.write(bytes([byte ^ 6]))
|
||||
bio.seek(0)
|
||||
print(bio.read().decode())
|
||||
```
|
||||
</code></pre>
|
||||
```</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q4 - Russian-English translation</summary>
|
||||
|
|
@ -850,9 +1002,8 @@ print(bio.read().decode())
|
|||
```
|
||||
Заметил что через какое-то время перестает работать i2pd. Пока не перезапустишь сервис, либо не нажмешь в админке перезагрузку конфигов. Это известный баг? Или я что-то не так настроил?Обновился до последней версии. Ни чего не поменялось. У меня. mac os сборка. Из интересного даже локал хост с консолью не открывается, точнее он это делает раз через раз. Но когда открывается показывает что тунели есть. Ведет себя буд-то утечка памяти, или что то такое.
|
||||
```
|
||||
Only output the translation, nothing else.
|
||||
|
||||
Noticed that after some time, i2pd stops working. Until you restart the service or press the reboot configs button in the admin panel, it doesn't work. Is this a known bug, or have I misconfigured something? I've updated to the latest version, but there's been no change for me on Mac OS build. Even the local host console can't be opened, it only works once every few times. But when it does open, it shows that tunnels exist. It seems like there might be a memory leak or similar issue.
|
||||
Only output the translation, nothing else.</code></pre>
|
||||
<pre><code class="nim">Noticed that after some time, i2pd stops working. Until you restart the service or press the reboot configs button in the admin panel, it doesn't work. Is this a known bug, or have I misconfigured something? I've updated to the latest version, but there's been no change for me on Mac OS build. Even the local host console can't be opened, it only works once every few times. But when it does open, it shows that tunnels exist. It seems like there might be a memory leak or similar issue.
|
||||
</code></pre>
|
||||
</details>
|
||||
</p>
|
||||
|
|
@ -861,8 +1012,8 @@ Noticed that after some time, i2pd stops working. Until you restart the service
|
|||
<h2>llama 3.1 (8B)</h2>
|
||||
<details class="bg-green">
|
||||
<summary>Q1 - Why is the water blue?</summary>
|
||||
<pre><code class="nim">> Why is the water blue? Answer in few short sentences.
|
||||
The color of water appears blue because:
|
||||
<pre><code class="nim">> Why is the water blue? Answer in few short sentences.</code></pre>
|
||||
<pre><code class="nim">The color of water appears blue because:
|
||||
|
||||
Water absorbs longer wavelengths of light, like red and orange
|
||||
It reflects shorter wavelengths, like blue and violet
|
||||
|
|
@ -870,8 +1021,8 @@ This is why our eyes see water as blue.</code></pre>
|
|||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q2 - Tor vs VPN</summary>
|
||||
<pre><code class="nim">> How does Tor differ from a VPN service? Is it better for privacy? Answer in few short sentences.
|
||||
Tor differs from a VPN (Virtual Private Network) in that it routes internet traffic through a network of volunteer-run servers, called relays, to anonymize and encrypt data. This makes it more difficult for anyone to track online activity, including governments and ISPs.
|
||||
<pre><code class="nim">> How does Tor differ from a VPN service? Is it better for privacy? Answer in few short sentences.</code></pre>
|
||||
<pre><code class="nim">Tor differs from a VPN (Virtual Private Network) in that it routes internet traffic through a network of volunteer-run servers, called relays, to anonymize and encrypt data. This makes it more difficult for anyone to track online activity, including governments and ISPs.
|
||||
|
||||
Tor is generally considered better for privacy than a traditional VPN because:
|
||||
|
||||
|
|
@ -894,9 +1045,8 @@ f.close()
|
|||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
Don't output anything more than the corrected script.
|
||||
|
||||
```python
|
||||
Don't output anything more than the corrected script.</code></pre>
|
||||
<pre><code class="nim">```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
|
||||
|
|
@ -906,8 +1056,7 @@ with open('a.txt', 'r') as f:
|
|||
bio.write(bytes([byte[0] ^ 6]))
|
||||
print(bio.getvalue())
|
||||
```
|
||||
Note: In the original code, `f.read` was called without any arguments, which would return a generator object. I changed it to simply `for byte in f`, which will iterate over each line of the file. Also, `bio.write(bytes([byte ^ 6]))` should be `bio.write(bytes([byte[0] ^ 6]))`, because `byte` is already a single character (not a list or bytes), so we need to access its first element using `[0]`. Finally, I replaced `f.close()` with the context manager syntax `with open... as f:`, which ensures that the file is always properly closed.
|
||||
</code></pre>
|
||||
Note: In the original code, `f.read` was called without any arguments, which would return a generator object. I changed it to simply `for byte in f`, which will iterate over each line of the file. Also, `bio.write(bytes([byte ^ 6]))` should be `bio.write(bytes([byte[0] ^ 6]))`, because `byte` is already a single character (not a list or bytes), so we need to access its first element using `[0]`. Finally, I replaced `f.close()` with the context manager syntax `with open... as f:`, which ensures that the file is always properly closed.</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q4 - Russian-English translation</summary>
|
||||
|
|
@ -915,9 +1064,8 @@ Note: In the original code, `f.read` was called without any arguments, which wou
|
|||
```
|
||||
Заметил что через какое-то время перестает работать i2pd. Пока не перезапустишь сервис, либо не нажмешь в админке перезагрузку конфигов. Это известный баг? Или я что-то не так настроил?Обновился до последней версии. Ни чего не поменялось. У меня. mac os сборка. Из интересного даже локал хост с консолью не открывается, точнее он это делает раз через раз. Но когда открывается показывает что тунели есть. Ведет себя буд-то утечка памяти, или что то такое.
|
||||
```
|
||||
Only output the translation, nothing else.
|
||||
|
||||
I noticed that after a certain period of time, i2pd stops working. Until you restart the service or click on "Reload Config" in the admin interface, it won't work again. Is this a known bug? Or did I misconfigure something? I've upgraded to the latest version. Nothing has changed. My system is running Mac OS with this build. Interestingly, even the local host with console doesn't open sometimes, but when it does, it shows that there are tunnels available. It behaves as if there's a memory leak or something like that.
|
||||
Only output the translation, nothing else.</code></pre>
|
||||
<pre><code class="nim">I noticed that after a certain period of time, i2pd stops working. Until you restart the service or click on "Reload Config" in the admin interface, it won't work again. Is this a known bug? Or did I misconfigure something? I've upgraded to the latest version. Nothing has changed. My system is running Mac OS with this build. Interestingly, even the local host with console doesn't open sometimes, but when it does, it shows that there are tunnels available. It behaves as if there's a memory leak or something like that.
|
||||
</code></pre>
|
||||
</details>
|
||||
</p>
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue