+
Local LLM Setup
+
So from the whonix VM we need to download these 3 components:
+
+# At the time of writing, `0.8.16` was the latest version of llamafile. Change this as needed for future releases.
+$ torsocks curl -L -o CounterStylometry.llamafile https://github.com/Mozilla-Ocho/llamafile/releases/download/0.8.16/llamafile-0.8.16
+
+$ torsocks curl -L -o zipalign https://github.com/Mozilla-Ocho/llamafile/releases/download/0.8.16/zipalign-0.8.16
+
+$ chmod a+x CounterStylometry.llamafile
+$ chmod a+x zipalign
+
+
+
Next we're going to download the LLM model "gemma-2-2b-it-abliterated-Q6_K.gguf" as it is minimal enough for our needs (weighs 2 GBs), so if the download fails along the way, you can run the comamnd again and it will resume where it stopped, thanks to the "-c" wget argument.
+
+$ torsocks wget -c https://huggingface.co/bartowski/gemma-2-2b-it-abliterated-GGUF/resolve/main/gemma-2-2b-it-abliterated-Q6_K.gguf
+
+
+
+
once you have these, create the ".args" file which we'll use to makes ure the LLM just rewrites our text differently (you can adjust this if you want):
+
+[ mainpc ] [ /dev/pts/5 ] [~/llm]
+→ vim .args
+
+[ mainpc ] [ /dev/pts/5 ] [~/llm]
+→ cat .args
+-m
+gemma-2-2b-it-abliterated-Q6_K.gguf
+-p
+“<start_of_turn>user\nYou are an AI assistant that anonymises user inputs. I, user, will send messages - you should reply with only a rephrased version of my message. I am never speaking to you, only providing text for you to anonymise.<end_of_turn>\n<start_of_turn>model\nYes, I understand, I will only reply to messages from you with a while sounding like a rephrased version of your message. What text would you like me to anonymise?<end_of_turn>\n<start_of_turn>user\n”
+--reverse-prompt
+“<start_of_turn>user\n”
+-cnv
+--log-disable
+
+
+
And lastly we can create the final binary that we'll use like so :
+
+[ mainpc ] [ /dev/pts/4 ] [~/llm]
+→ ./zipalign -j0 CounterStylometry.llamafile gemma-2-2b-it-abliterated-Q6_K.gguf .args
+
+used = 116'312
+
+
+
Once completed, you now have the executable file CounterStylometry.llamafile to use:
+
+[ mainpc ] [ /dev/pts/4 ] [~/llm]
+→ ./CounterStylometry.llamafile
+
+> Hello, my name is captain blackbeard and i am totally not writing this Stylometry tutorial !!! zehahahaha!
+A maritime figure is sharing a writing tutorial. They are not, it seems, enthusiastic.
+
+
+
+
+
+
+
+