oxeo0/blog-contributions
1
0
Fork 0
mirror of http://git.nowherejezfoltodf4jiyl6r56jnzintap5vyjlia7fkirfsnfizflqd.onion/nihilist/blog-contributions.git synced 2025-07-02 11:56:40 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

[wip] finish downloading model section

Browse source
This commit is contained in:
oxeo0 2025-04-18 12:33:26 +02:00
parent f52a71dbc9
commit ea000ece54
1 changed files with 36 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

37
opsec/openwebuilocalllms/index.html
View file

@ -370,13 +370,48 @@ Go to the <b>Admin settings</b> and proceed with next steps.
<div class="container"> <div class="container">
<div class="row"> <div class="row">
<div class="col-lg-8 col-lg-offset-2"> <div class="col-lg-8 col-lg-offset-2">
<h2><b>Downloading Model</b></h2> <h2><b>Downloading a Model</b></h2>
<p> <p>
To see available models, head to <a href="https://ollama.com/library">ollama library</a>. Sadly they block Tor traffic so if you have to use Tor, use their <a href="https://ollama.org.cn/library">chinese mirror</a>.<br> To see available models, head to <a href="https://ollama.com/library">ollama library</a>. Sadly they block Tor traffic so if you have to use Tor, use their <a href="https://ollama.org.cn/library">chinese mirror</a>.<br>
Next, pick a model you want to download. In our case, we want <b>Gemma 3</b>. Then click on <b>Tags</b> to see all available variants. Next, pick a model you want to download. In our case, we want <b>Gemma 3</b>. Then click on <b>Tags</b> to see all available variants.
</p> </p>
<img src="30.png"> <img src="30.png">
<img src="31.png" class="imgRz"> <img src="31.png" class="imgRz">
<p><br>
Now, you'll see different sizes and quantization variants the model is available in.
We want to download <b>12B</b> variant in <b>Q4_K_M</b> quantization. Comparing the hashes, we see the default <b>gemma3:12b</b> is the same as <b>gemma3:12b-it-q4_K_M</b>. Additionally, you can see that if we put just <b>gemma3</b>, we would get the <b>4B</b> variant.</p>
<img src="32.png">
<p><br>
Then, copy the model name we got after clicking on desired variant. If you want to download it via ollama CLI, we also get the full command. In our case Open WebUI needs to know just the <b>model_name:size</b>.
</p>
<img src="33.png" class="imgRz">
<p><br>
Now, go back to Open WebUI's <b>Admin Settings</b> we opened in the previous section and click on <b>Models</b> tab, then the download icon:
</p>
<img src="16.png" class="imgRz">
<br><br>
<img src="17.png" class="imgRz">
<p><br>
In the <b>Enter model tag</b> field, type <b>gemma3:12b</b> and click the download icon again. It will automatically pull the appropriate model from the <a href="https://ollama.com/library">ollama library</a>.
</p>
<img src="18.png">
<p><br>
After that, just wait for the model download to complete.
</p>
<img src="19.png">
<p><br>
Once the progress bar reaches 100%, the model should be added to your library automatically.<br>
Go to the main page again and check if it's available now.
</p>
<img src="20.png" class="imgRz">
</div> </div>
</div><!-- /row --> </div><!-- /row -->
</div> <!-- /container --> </div> <!-- /container -->