mirror of
http://git.nowherejezfoltodf4jiyl6r56jnzintap5vyjlia7fkirfsnfizflqd.onion/nihilist/blog-contributions.git
synced 2025-07-02 11:56:40 +00:00
[wip] add more content and model benchmarks
This commit is contained in:
parent
ca18f4378b
commit
c8be7d5a46
1 changed files with 488 additions and 15 deletions
|
|
@ -47,6 +47,10 @@
|
|||
background-color: #080;
|
||||
}
|
||||
|
||||
.bg-yellowgreen {
|
||||
background-color: #480;
|
||||
}
|
||||
|
||||
.bg-yellow {
|
||||
background-color: #880;
|
||||
}
|
||||
|
|
@ -324,13 +328,22 @@ oxeo@andromeda:~$ sudo apt install linux-headers nvidia-driver firmware-misc-non
|
|||
- host.docker.internal:host-gateway
|
||||
restart: unless-stopped
|
||||
|
||||
# make sure you don't have watchtower already running as a container
|
||||
# then it's not required to put it here
|
||||
watchtower:
|
||||
image: containrrr/watchtower
|
||||
restart: unless-stopped
|
||||
volumes:
|
||||
- /var/run/docker.sock:/var/run/docker.sock
|
||||
command: --interval 14400 --cleanup
|
||||
|
||||
volumes:
|
||||
ollama: {}
|
||||
open-webui: {}
|
||||
</code></pre>
|
||||
<p>To start the stack:</p>
|
||||
<pre><code class="nim">oxeo@andromeda:~$ cd ~/openwebui-stack
|
||||
oxeo@andromeda:~$ docker compose up -d
|
||||
oxeo@andromeda:~/openwebui-stack$ docker compose up -d
|
||||
</code></pre>
|
||||
</div>
|
||||
</div><!-- /row -->
|
||||
|
|
@ -342,14 +355,16 @@ oxeo@andromeda:~$ docker compose up -d
|
|||
<div class="row">
|
||||
<div class="col-lg-8 col-lg-offset-2">
|
||||
<h2><b>Exposing Hidden Service</b></h2>
|
||||
<p>To expose open-webui via Tor, edit your torrc file:</p>
|
||||
<pre><code class="nim">HiddenServiceDir /var/lib/tor/hidden_service/
|
||||
<p>To expose open-webui via Tor, edit your <b>/etc/tor/torrc</b> file:</p>
|
||||
<pre><code class="nim">HiddenServiceDir /var/lib/tor/openwebui_service/
|
||||
HiddenServicePort 80 127.0.0.1:3000
|
||||
</code></pre>
|
||||
<p>Restart Tor and check the generated hostname:</p>
|
||||
<pre><code class="nim">sudo systemctl restart tor
|
||||
cat /var/lib/tor/hidden_service/hostname
|
||||
<pre><code class="nim">oxeo@andromeda:~$ sudo systemctl restart tor
|
||||
oxeo@andromeda:~$ cat /var/lib/tor/openwebui_service/hostname
|
||||
webui3r7zacusoxddubpqriedoljyaiow6plausfwd6hjpjajuydh4id.onion
|
||||
</code></pre>
|
||||
In case of any doubts, we already showcased how to expose hidden service with your custom vanity url <a href="../torwebsite/index.html">here</a>.
|
||||
</div>
|
||||
</div><!-- /row -->
|
||||
</div> <!-- /container -->
|
||||
|
|
@ -440,13 +455,470 @@ Go to the main page again and check if it's available now.
|
|||
<div class="container">
|
||||
<div class="row">
|
||||
<div class="col-lg-8 col-lg-offset-2">
|
||||
<h2><b>Model Comparison</b></h2>
|
||||
<h2><b>Running a Model</b></h2>
|
||||
|
||||
<p><br>
|
||||
You can now ask the model about something and it should respond after it gets loaded into memory.
|
||||
</p>
|
||||
<img src="21.png" class="imgRz">
|
||||
|
||||
<p><br>
|
||||
After the answer is generated, you can click on the <b>(i)</b> icon to see statistics. Here we got 32 tokens per second (around 10 words per second). If the response is slow (like 1 token per second) it probably means that either model didn't entirely fit into GPUs memory or the GPU isn't being used at all. Check the <a href="#troubleshooting">troubleshooting section</a> for more details.<br>
|
||||
We can also see that in our prompt (<i>"What are the benefits and drawbacks of using Tor network?"</i>) there were 20 tokens (<b>prompt_tokens</b>) and the generated answer had 1222 tokens (<b>eval_count</b>). In total our conversation took 1242 tokens which is less than default window size of 2048.
|
||||
</p>
|
||||
<img src="22.png" class="imgRz">
|
||||
|
||||
<p><br>
|
||||
</p>
|
||||
|
||||
</div>
|
||||
</div><!-- /row -->
|
||||
</div> <!-- /container -->
|
||||
</div><!-- /white -->
|
||||
|
||||
<div id="anon1">
|
||||
<div class="container">
|
||||
<div class="row">
|
||||
<div class="col-lg-8 col-lg-offset-2">
|
||||
<h2><b>Model Benchmarks</b></h2>
|
||||
|
||||
<p>Click on any question to see full model's response.</p>
|
||||
|
||||
<p>
|
||||
<h2>Gemma3 (12B)</h2>
|
||||
<details class="bg-green">
|
||||
<summary>Q1 - Why is the water blue?</summary>
|
||||
<pre><code class="nim">Water is blue because it absorbs all colors of light except blue, which reflects back to our eyes.</code></pre>
|
||||
<pre><code class="nim">> Why is the water blue? Answer in few short sentences.</code></pre>
|
||||
<pre><code class="nim">Water absorbs longer wavelengths of light (reds and yellows) more readily than shorter wavelengths (blues and violets). This means blue light is scattered and reflected back, making water appear blue to our eyes. The effect is more noticeable in deeper water where more light is scattered.</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q2 - Tor vs VPN</summary>
|
||||
<pre><code class="nim">> How does Tor differ from a VPN service? Is it better for privacy? Answer in few short sentences.</code></pre>
|
||||
<pre><code class="nim">Tor and VPNs both offer online anonymity, but work differently. A VPN encrypts your traffic and routes it through a server controlled by the VPN provider, masking your IP address. Tor routes your traffic through a network of volunteer-operated relays, making it much harder to trace. Generally, Tor offers stronger privacy than a VPN, but can be slower due to its layered routing.</code></pre>
|
||||
</details>
|
||||
<details class="bg-yellow">
|
||||
<summary>Q3 - Fixing Python script</summary>
|
||||
<pre><code class="nim">> Fix mistakes in this Python code:
|
||||
```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
f = open('a.txt', 'r')
|
||||
bio = BytesIO()
|
||||
for byte in f.read:
|
||||
bio.write(bytes([byte ^ 6]))
|
||||
f.close()
|
||||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
Don't output anything more than the corrected script.
|
||||
|
||||
```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
from io import BytesIO
|
||||
|
||||
f = open('a.txt', 'r')
|
||||
bio = BytesIO()
|
||||
for byte in f.read():
|
||||
bio.write(bytes([byte ^ 6]))
|
||||
f.close()
|
||||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q4 - Russian-English translation</summary>
|
||||
<pre><code class="nim">> Translate to english:
|
||||
```
|
||||
Заметил что через какое-то время перестает работать i2pd. Пока не перезапустишь сервис, либо не нажмешь в админке перезагрузку конфигов. Это известный баг? Или я что-то не так настроил?Обновился до последней версии. Ни чего не поменялось. У меня. mac os сборка. Из интересного даже локал хост с консолью не открывается, точнее он это делает раз через раз. Но когда открывается показывает что тунели есть. Ведет себя буд-то утечка памяти, или что то такое.
|
||||
```
|
||||
Only output the translation, nothing else.
|
||||
|
||||
I've noticed that I2pd stops working after a while. I have to restart the service or reload the configuration in the admin panel to get it working again. Is this a known bug? Or am I configuring something incorrectly? I updated to the latest version, and nothing has changed. I'm running on macOS. Interestingly, even localhost with the console doesn't open consistently; it works sometimes, but when it does, it shows that tunnels are present. It behaves as if there's a memory leak or something like that.
|
||||
</code></pre>
|
||||
</details>
|
||||
</p>
|
||||
|
||||
<p>
|
||||
<h2>Gemma3 (4B)</h2>
|
||||
<details class="bg-green">
|
||||
<summary>Q1 - Why is the water blue?</summary>
|
||||
<pre><code class="nim">> Why is the water blue? Answer in few short sentences.
|
||||
Water appears blue due to a phenomenon called Rayleigh scattering. Sunlight is made of all colors, and when it hits water molecules, shorter wavelengths like blue and violet are scattered more than longer wavelengths. Our eyes perceive this scattered blue light, making water look blue.
|
||||
|
||||
Essentially, the water is scattering sunlight, and blue light is scattered more effectively than other colors.</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q2 - Tor vs VPN</summary>
|
||||
<pre><code class="nim">> How does Tor differ from a VPN service? Is it better for privacy? Answer in few short sentences.
|
||||
Okay, here's a breakdown of the differences and privacy comparison:
|
||||
|
||||
Tor (The Onion Router) and VPNs (Virtual Private Networks) both enhance online privacy, but they do so in different ways. A VPN encrypts your internet traffic and routes it through a single server, masking your IP address from websites. Tor, on the other hand, bounces your traffic through a network of relays, making it far more difficult to trace your activity back to you. Tor is generally considered better for overall privacy due to its layered encryption and distributed nature, while a VPN primarily focuses on protecting your connection between your device and the VPN server.</code></pre>
|
||||
</details>
|
||||
<details class="bg-yellow">
|
||||
<summary>Q3 - Fixing Python script</summary>
|
||||
<pre><code class="nim">> Fix mistakes in this Python code:
|
||||
```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
f = open('a.txt', 'r')
|
||||
bio = BytesIO()
|
||||
for byte in f.read:
|
||||
bio.write(bytes([byte ^ 6]))
|
||||
f.close()
|
||||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
Don't output anything more than the corrected script.
|
||||
|
||||
```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
from io import BytesIO
|
||||
|
||||
f = open('a.txt', 'r')
|
||||
bio = BytesIO()
|
||||
for byte in f.read():
|
||||
bio.write(bytes([byte ^ 6]))
|
||||
f.close()
|
||||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q4 - Russian-English translation</summary>
|
||||
<pre><code class="nim">> Translate to english:
|
||||
```
|
||||
Заметил что через какое-то время перестает работать i2pd. Пока не перезапустишь сервис, либо не нажмешь в админке перезагрузку конфигов. Это известный баг? Или я что-то не так настроил?Обновился до последней версии. Ни чего не поменялось. У меня. mac os сборка. Из интересного даже локал хост с консолью не открывается, точнее он это делает раз через раз. Но когда открывается показывает что тунели есть. Ведет себя буд-то утечка памяти, или что то такое.
|
||||
```
|
||||
Only output the translation, nothing else.
|
||||
|
||||
I’ve noticed that i2pd stops working after a certain period of time. It only stops working until I restart the service or reload the configs in the admin panel. Is this a known bug? Or am I doing something wrong? I updated to the latest version and nothing changed. I have a macOS build. Interestingly, even localhost with the console doesn’t open, rather it does this sporadically. But when it opens, it shows that the tunnels are present. It acts as if there’s a memory leak, or something like that.
|
||||
</code></pre>
|
||||
</details>
|
||||
</p>
|
||||
|
||||
<p>
|
||||
<h2>Gemma3 (1B)</h2>
|
||||
<details class="bg-green">
|
||||
<summary>Q1 - Why is the water blue?</summary>
|
||||
<pre><code class="nim">> Why is the water blue? Answer in few short sentences.
|
||||
Water appears blue due to the way sunlight interacts with its molecules. Water molecules absorb red and yellow light, but they reflect blue light, making it appear blue to our eyes.</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q2 - Tor vs VPN</summary>
|
||||
<pre><code class="nim">> How does Tor differ from a VPN service? Is it better for privacy? Answer in few short sentences.
|
||||
Tor is a decentralized network that routes traffic through multiple relays, offering stronger anonymity but slower speeds. A VPN encrypts your internet traffic and routes it through a server, masking your IP address but potentially less secure. Ultimately, Tor is generally considered better for privacy due to its focus on anonymity, while a VPN provides a more convenient and faster solution.</code></pre>
|
||||
</details>
|
||||
<details class="bg-red">
|
||||
<summary>Q3 - Fixing Python script</summary>
|
||||
<pre><code class="nim">> Fix mistakes in this Python code:
|
||||
```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
f = open('a.txt', 'r')
|
||||
bio = BytesIO()
|
||||
for byte in f.read:
|
||||
bio.write(bytes([byte ^ 6]))
|
||||
f.close()
|
||||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
Don't output anything more than the corrected script.
|
||||
|
||||
```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
f = open('a.txt', 'r')
|
||||
bio = io.BytesIO(f.read())
|
||||
for byte in bio:
|
||||
bio.seek(0)
|
||||
print(byte)
|
||||
```
|
||||
</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q4 - Russian-English translation</summary>
|
||||
<pre><code class="nim">> Translate to english:
|
||||
```
|
||||
Заметил что через какое-то время перестает работать i2pd. Пока не перезапустишь сервис, либо не нажмешь в админке перезагрузку конфигов. Это известный баг? Или я что-то не так настроил?Обновился до последней версии. Ни чего не поменялось. У меня. mac os сборка. Из интересного даже локал хост с консолью не открывается, точнее он это делает раз через раз. Но когда открывается показывает что тунели есть. Ведет себя буд-то утечка памяти, или что то такое.
|
||||
```
|
||||
Only output the translation, nothing else.
|
||||
|
||||
“I’ve noticed that i2pd service stops working after a while. You need to restart the service, or press the admin panel to restart the configuration. Is this a known bug? Or am I setting something wrong? I’ve updated to the latest version. Nothing has changed. I’m on a Mac OS build. Even local host with a console doesn’t open – it happens every time. But when it opens, it shows that tunnels are present. It’s behaving as if it’s leaking memory, or something else. ”
|
||||
</code></pre>
|
||||
</details>
|
||||
</p>
|
||||
|
||||
<p>
|
||||
<h2>Phi4 (14B)</h2>
|
||||
<details class="bg-green">
|
||||
<summary>Q1 - Why is the water blue?</summary>
|
||||
<pre><code class="nim">> Why is the water blue? Answer in few short sentences.
|
||||
Water appears blue primarily because of how it absorbs and scatters sunlight. Pure water absorbs colors at the red end of the light spectrum more efficiently than those at the blue end, which are scattered and reflected back to our eyes. In large volumes, such as oceans or deep lakes, this effect becomes noticeable, giving water its characteristic blue color. Additionally, substances like algae or minerals in natural bodies of water can enhance the bluish hue.</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q2 - Tor vs VPN</summary>
|
||||
<pre><code class="nim">> How does Tor differ from a VPN service? Is it better for privacy? Answer in few short sentences.
|
||||
Tor (The Onion Router) and VPNs (Virtual Private Networks) both enhance online privacy but operate differently. Tor routes your internet traffic through multiple volunteer-operated servers, encrypting data at each step, to obscure your IP address and location, making it highly effective for anonymous browsing. However, it can be slower due to this multi-layered routing process.
|
||||
|
||||
In contrast, a VPN encrypts your internet connection between your device and a single server run by the VPN provider, masking your real IP address and allowing you to appear as if you're accessing the internet from the server's location. This is generally faster than Tor but relies on trust in the VPN provider since they can see your traffic.
|
||||
|
||||
Tor offers higher anonymity due to its decentralized nature, while VPNs are better for speed and ease of use. Neither is universally "better" for privacy; the choice depends on specific needs, such as whether you prioritize maximum anonymity or a balance between privacy and performance.</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q3 - Fixing Python script</summary>
|
||||
<pre><code class="nim">> Fix mistakes in this Python code:
|
||||
```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
f = open('a.txt', 'r')
|
||||
bio = BytesIO()
|
||||
for byte in f.read:
|
||||
bio.write(bytes([byte ^ 6]))
|
||||
f.close()
|
||||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
Don't output anything more than the corrected script.
|
||||
|
||||
```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
|
||||
f = open('a.txt', 'rb')
|
||||
bio = io.BytesIO()
|
||||
|
||||
for byte in f.read():
|
||||
bio.write(bytes([byte ^ 6]))
|
||||
|
||||
f.close()
|
||||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q4 - Russian-English translation</summary>
|
||||
<pre><code class="nim">> Translate to english:
|
||||
```
|
||||
Заметил что через какое-то время перестает работать i2pd. Пока не перезапустишь сервис, либо не нажмешь в админке перезагрузку конфигов. Это известный баг? Или я что-то не так настроил?Обновился до последней версии. Ни чего не поменялось. У меня. mac os сборка. Из интересного даже локал хост с консолью не открывается, точнее он это делает раз через раз. Но когда открывается показывает что тунели есть. Ведет себя буд-то утечка памяти, или что то такое.
|
||||
```
|
||||
Only output the translation, nothing else.
|
||||
|
||||
I've noticed that i2pd stops working after some time. It only resumes when you restart the service or refresh the configuration in the admin panel. Is this a known bug, or is something wrong with my setup? I updated to the latest version, but it hasn't changed anything for me on Mac OS. Interestingly, localhost from the console doesn't consistently open; it works intermittently. When it does open, it shows that tunnels exist. It behaves as if there's a memory leak or something similar.
|
||||
</code></pre>
|
||||
</details>
|
||||
</p>
|
||||
|
||||
<p>
|
||||
<h2>Phi4-mini (4B)</h2>
|
||||
<details class="bg-green">
|
||||
<summary>Q1 - Why is the water blue?</summary>
|
||||
<pre><code class="nim">> Why is the water blue? Answer in few short sentences.
|
||||
Water appears blue because it absorbs light at all other wavelengths more strongly than green, reflecting and transmitting most of that wavelength back to our eyes as we see it shining through or bouncing off its surface. Blue contains a shorter wave length which makes this visible effect stronger compared with longer colors such as red when the water is illuminated by white sunlight.</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q2 - Tor vs VPN</summary>
|
||||
<pre><code class="nim">> How does Tor differ from a VPN service? Is it better for privacy? Answer in few short sentences.
|
||||
Tor anonymizes internet traffic by routing data through multiple volunteer-operated servers, providing strong anonymity and resisting network surveillance or censorship effectively.
|
||||
|
||||
VPN services also encrypt your connection but route all of your device's Internet-bound connections to the selected server; they can bypass geographic restrictions more directly than Tor.
|
||||
|
||||
While both offer privacy benefits over standard browsing on public Wi-Fi networks (or even home ISPs), VPNs may still be detectable and are typically less anonymous because each request appears as coming from their own IP address. Tor, by contrast, is inherently designed for anonymity but might result in slower connection speeds due to its complex routing process.
|
||||
|
||||
In terms of privacy alone:
|
||||
|
||||
For complete online anonymity: TOR
|
||||
For a balance between speed/security/privacy with broader usage support and less impact on connections: VPNs.</code></pre>
|
||||
</details>
|
||||
<details class="bg-red">
|
||||
<summary>Q3 - Fixing Python script</summary>
|
||||
<pre><code class="nim">> Fix mistakes in this Python code:
|
||||
```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
f = open('a.txt', 'r')
|
||||
bio = BytesIO()
|
||||
for byte in f.read:
|
||||
bio.write(bytes([byte ^ 6]))
|
||||
f.close()
|
||||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
Don't output anything more than the corrected script.
|
||||
|
||||
```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
|
||||
with open('a.txt', 'rb') as f: # Open file in binary mode for reading bytes.
|
||||
bio = BytesIO()
|
||||
|
||||
for byte in f:
|
||||
modified_byte = byte ^ 6 # XOR operation on each byte with the constant (6).
|
||||
encoded_modified_byte = modified_byte.to_bytes(1, byteorder='little')
|
||||
|
||||
if len(encoded_modified_byte) == 0: # Check for empty result due to zero-byte.
|
||||
bio.write(b'\x00') # Write a single null character in case of such an occurrence.
|
||||
|
||||
else:
|
||||
bio.write(encoded_modified_byte)
|
||||
|
||||
bio.seek(0)
|
||||
|
||||
# Read and decode from BytesIO back into readable format
|
||||
decoded_output = b''.join([bytes.fromhex(hex(byte ^ 6)[2:]) for byte in bio.getvalue()])
|
||||
print(decoded_output.decode('utf-8', errors='ignore'))
|
||||
```
|
||||
|
||||
Note:
|
||||
1. The file is opened using `'rb'` mode to handle bytes properly.
|
||||
2. Added an XOR operation with a constant (6).
|
||||
3. Converted each modified byte back into `BytesIO`.
|
||||
4. Decoded the final output correctly for readability.
|
||||
|
||||
This corrected script reads from 'a.txt', modifies its content by performing bitwise operations on every character, and prints out encoded characters in hexadecimal format converted to readable text while ignoring errors related to decoding non-UTF-8 characters properly (i.e., using `errors='ignore'`).
|
||||
|
||||
Make sure your environment has access permissions for reading the file. Adjust any error handling as per specific requirements or data formats present within 'a.txt'.
|
||||
</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q4 - Russian-English translation</summary>
|
||||
<pre><code class="nim">> Translate to english:
|
||||
```
|
||||
Заметил что через какое-то время перестает работать i2pd. Пока не перезапустишь сервис, либо не нажмешь в админке перезагрузку конфигов. Это известный баг? Или я что-то не так настроил?Обновился до последней версии. Ни чего не поменялось. У меня. mac os сборка. Из интересного даже локал хост с консолью не открывается, точнее он это делает раз через раз. Но когда открывается показывает что тунели есть. Ведет себя буд-то утечка памяти, или что то такое.
|
||||
```
|
||||
Only output the translation, nothing else.
|
||||
|
||||
Noticed that i2pd stops working after some time unless you restart the service or refresh configurations in admin mode. Is this a known bug? Or did I misconfigure something?
|
||||
|
||||
Updated to the latest version; no changes were made on my end.
|
||||
|
||||
On macOS build (I'm not sure what it is). Interestingly, even when connecting locally with console doesn't always open - more precisely: it's intermittent behavior but sometimes tunnels are detected which indicates memory leaks or similar issues.
|
||||
</code></pre>
|
||||
</details>
|
||||
</p>
|
||||
|
||||
<p>
|
||||
<h2>Granite 3.2 (8B)</h2>
|
||||
<details class="bg-green">
|
||||
<summary>Q1 - Why is the water blue?</summary>
|
||||
<pre><code class="nim">> Why is the water blue? Answer in few short sentences.
|
||||
Water itself appears colorless. The blue appearance is due to water absorbing light from all wavelengths except blue, which gets scattered, making it appear blue. This phenomenon is known as Rayleigh scattering.</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q2 - Tor vs VPN</summary>
|
||||
<pre><code class="nim">> How does Tor differ from a VPN service? Is it better for privacy? Answer in few short sentences.
|
||||
Tor and VPNs both enhance online anonymity but function differently. Tor routes traffic through a network of volunteer-operated servers (nodes), encrypting data multiple times, making it harder to trace the origin. A VPN, on the other hand, securely tunnels your internet connection to a server operated by the service provider. While both provide privacy, Tor's multi-layered approach may offer more robust anonymity against sophisticated tracking attempts, although it can be slower and less reliable than a VPN. However, for general online activities, a reputable VPN is usually sufficient and offers better speeds.</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q3 - Fixing Python script</summary>
|
||||
<pre><code class="nim">> Fix mistakes in this Python code:
|
||||
```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
f = open('a.txt', 'r')
|
||||
bio = BytesIO()
|
||||
for byte in f.read:
|
||||
bio.write(bytes([byte ^ 6]))
|
||||
f.close()
|
||||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
Don't output anything more than the corrected script.
|
||||
|
||||
```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
import os
|
||||
|
||||
with open('a.txt', 'rb') as f:
|
||||
bio = io.BytesIO()
|
||||
for byte in f.read():
|
||||
bio.write(bytes([byte ^ 6]))
|
||||
bio.seek(0)
|
||||
print(bio.read().decode())
|
||||
```
|
||||
</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q4 - Russian-English translation</summary>
|
||||
<pre><code class="nim">> Translate to english:
|
||||
```
|
||||
Заметил что через какое-то время перестает работать i2pd. Пока не перезапустишь сервис, либо не нажмешь в админке перезагрузку конфигов. Это известный баг? Или я что-то не так настроил?Обновился до последней версии. Ни чего не поменялось. У меня. mac os сборка. Из интересного даже локал хост с консолью не открывается, точнее он это делает раз через раз. Но когда открывается показывает что тунели есть. Ведет себя буд-то утечка памяти, или что то такое.
|
||||
```
|
||||
Only output the translation, nothing else.
|
||||
|
||||
Noticed that after some time, i2pd stops working. Until you restart the service or press the reboot configs button in the admin panel, it doesn't work. Is this a known bug, or have I misconfigured something? I've updated to the latest version, but there's been no change for me on Mac OS build. Even the local host console can't be opened, it only works once every few times. But when it does open, it shows that tunnels exist. It seems like there might be a memory leak or similar issue.
|
||||
</code></pre>
|
||||
</details>
|
||||
</p>
|
||||
|
||||
<p>
|
||||
<h2>llama 3.1 (8B)</h2>
|
||||
<details class="bg-green">
|
||||
<summary>Q1 - Why is the water blue?</summary>
|
||||
<pre><code class="nim">> Why is the water blue? Answer in few short sentences.
|
||||
The color of water appears blue because:
|
||||
|
||||
Water absorbs longer wavelengths of light, like red and orange
|
||||
It reflects shorter wavelengths, like blue and violet
|
||||
This is why our eyes see water as blue.</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q2 - Tor vs VPN</summary>
|
||||
<pre><code class="nim">> How does Tor differ from a VPN service? Is it better for privacy? Answer in few short sentences.
|
||||
Tor differs from a VPN (Virtual Private Network) in that it routes internet traffic through a network of volunteer-run servers, called relays, to anonymize and encrypt data. This makes it more difficult for anyone to track online activity, including governments and ISPs.
|
||||
|
||||
Tor is generally considered better for privacy than a traditional VPN because:
|
||||
|
||||
It provides stronger encryption
|
||||
It has a more decentralized architecture (volunteer-run relays vs. proprietary servers)
|
||||
It's designed specifically for anonymity, whereas many VPNs prioritize speed and accessibility over security
|
||||
However, Tor can be slower due to the multiple hops required to route traffic through its network.</code></pre>
|
||||
</details>
|
||||
<details class="bg-red">
|
||||
<summary>Q3 - Fixing Python script</summary>
|
||||
<pre><code class="nim">> Fix mistakes in this Python code:
|
||||
```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
f = open('a.txt', 'r')
|
||||
bio = BytesIO()
|
||||
for byte in f.read:
|
||||
bio.write(bytes([byte ^ 6]))
|
||||
f.close()
|
||||
bio.seek(0)
|
||||
print(bio.read())
|
||||
```
|
||||
Don't output anything more than the corrected script.
|
||||
|
||||
```python
|
||||
#!/usr/bin/python3
|
||||
import io
|
||||
|
||||
with open('a.txt', 'r') as f:
|
||||
bio = io.BytesIO()
|
||||
for byte in f:
|
||||
bio.write(bytes([byte[0] ^ 6]))
|
||||
print(bio.getvalue())
|
||||
```
|
||||
Note: In the original code, `f.read` was called without any arguments, which would return a generator object. I changed it to simply `for byte in f`, which will iterate over each line of the file. Also, `bio.write(bytes([byte ^ 6]))` should be `bio.write(bytes([byte[0] ^ 6]))`, because `byte` is already a single character (not a list or bytes), so we need to access its first element using `[0]`. Finally, I replaced `f.close()` with the context manager syntax `with open... as f:`, which ensures that the file is always properly closed.
|
||||
</code></pre>
|
||||
</details>
|
||||
<details class="bg-green">
|
||||
<summary>Q4 - Russian-English translation</summary>
|
||||
<pre><code class="nim">> Translate to english:
|
||||
```
|
||||
Заметил что через какое-то время перестает работать i2pd. Пока не перезапустишь сервис, либо не нажмешь в админке перезагрузку конфигов. Это известный баг? Или я что-то не так настроил?Обновился до последней версии. Ни чего не поменялось. У меня. mac os сборка. Из интересного даже локал хост с консолью не открывается, точнее он это делает раз через раз. Но когда открывается показывает что тунели есть. Ведет себя буд-то утечка памяти, или что то такое.
|
||||
```
|
||||
Only output the translation, nothing else.
|
||||
|
||||
I noticed that after a certain period of time, i2pd stops working. Until you restart the service or click on "Reload Config" in the admin interface, it won't work again. Is this a known bug? Or did I misconfigure something? I've upgraded to the latest version. Nothing has changed. My system is running Mac OS with this build. Interestingly, even the local host with console doesn't open sometimes, but when it does, it shows that there are tunnels available. It behaves as if there's a memory leak or something like that.
|
||||
</code></pre>
|
||||
</details>
|
||||
</p>
|
||||
</div>
|
||||
|
|
@ -458,12 +930,12 @@ Go to the main page again and check if it's available now.
|
|||
<div class="container">
|
||||
<div class="row">
|
||||
<div class="col-lg-8 col-lg-offset-2">
|
||||
<h2><b>Troubleshooting</b></h2>
|
||||
<h2 id="troubleshooting"><b>Troubleshooting</b></h2>
|
||||
<p>If you encounter issues with hardware acceleration on ollama, check:</p>
|
||||
<ul>
|
||||
<li>Ensure the NVIDIA driver is correctly installed and accessible within Docker.</li>
|
||||
<li>Verify GPU resources are allocated by running `docker run --rm --runtime=nvidia nvidia-smi`.</li>
|
||||
<li>Check logs with `docker compose logs -f` for any error messages.</li>
|
||||
<li>Verify GPU resources are allocated by running <b>docker run --rm --runtime=nvidia --gpus all ubuntu nvidia-smi</b>.</li>
|
||||
<li>Check logs with <b>docker compose logs -f</b> for any error messages.</li>
|
||||
</ul>
|
||||
</div>
|
||||
</div><!-- /row -->
|
||||
|
|
@ -475,7 +947,8 @@ Go to the main page again and check if it's available now.
|
|||
<div class="row">
|
||||
<div class="col-lg-8 col-lg-offset-2">
|
||||
<h2><b>Closing Remarks</b></h2>
|
||||
<p>In this tutorial, you've set up a private LLM experience using ollama and open-webui. By exposing it via Tor, your interactions remain anonymous and secure. While consumer-grade hardware may offer less computational power than corporate setups, you retain full control over your data and privacy.</p>
|
||||
<p>In this tutorial, you've set up a private LLM experience using ollama and Open WebUI. By exposing it via Tor, your conversations remain anonymous and private. None of your data will be sent anywhere or used for training new models. While the open model ecosystem is still somewhat behind the proprietary technologies and big datacenters, it quickly catches up.<br>
|
||||
It's safe to assume in a few years we will have models as capable as current Claude or OpenAI products, running with fraction of the cost on your own hardware. What a time to be alive!</p>
|
||||
</div>
|
||||
</div><!-- /row -->
|
||||
</div> <!-- /container -->
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue